Anh’s Status 4/13/2015 – 4/24/2015

 Highlight: 

• Completed section:

1) Completed fixing staging krns job

2) Pager duty this week. 

3)  Completed . 

     Completed setting up to schedule this job to run nightly.

4)  Emailed ddls scripts to Analytix per their request to create tables below:

MYSQL Tables : title_db2

 SQLSERVER Tables:      UCI_LD_CSF_TRACKER_SNAPSHOT_T, employee_basic, agingreport_det_kfs, agingreportcon_kfs

To protect sensitive data in the file, I used webfiles with password to send agingreportdet.dat 

5)  Completed 

6) Completed new job syncInvoiceNumberSundryDebtors for  

7) Completed the change to sd-nebula to remaining talend jobs

• Not complete yet section: 

1)  Make changes to new host sd-nova

2)  Export all talend jobs on new server

3)  ACCOUNT_CG_PRPSL_NBR not being populated in dss_kfs.KFS_D_ACCOUNT

4)  Change host name to ods talend jobs to replace Nebula

5)  Need to fix 

6)  Need to schedule syncInvoiceNumberSundryDebtors to run on production

Anh’s Status 3/28/2015 – 4/10/2015

 Highlight: 

• Completed section:

1)  Fixed uciSmsGIFeed.  ods_kfs.UCI_SMS_FEED_DETAIL_T table now has all records for Feb. data with batch date ’06-MAR-15’, matching Oracle side:  31,647 records, debit amount total is $3,647,165,482.52. 

2)  dwhreader: 

• • Completed ap,ar,cm,fp,fs,kr,krew,krim,ld,pdp,pur,sh,tem,uci 
  • Completed staging_uc:  Talend is buggy that it loads uci tables not just uc (without the i)  when using UC_%.  Talend sucks.  The syntax to make the staging_uc job work is:
    "1 = 2) union select table_name as tname from all_tables where (owner = '" + context.KFSINT1_Schema  + "' and TABLE_NAME like 'UC_%' and TABLE_NAME not like 'UC_HOME_DEPT_T' and TABLE_NAME not like 'UC_ACCT_NBR_GEN_T' and TABLE_NAME not like 'UCI_%'"
  • Completed  OLTP jobs: utilities_award_data_to_dwhm_fs, utilities_award_data_to_dwhm_ods, utilities_ldap_all_tables, utilities_CostSharing, utilities_webservices, copy_ods_data_dss, copy_dss_kfs_data_to_dss, copy_dss_data_to_dss_2, prod_verify_kfs_data, kill_long_suspended_queries, uciLoadTitle
  • Completed ODS jobs: ods_ca, ods_pur_po, prod_ods_etl_and_accounting, ods_kfs_pcard, ods_kfs_tem, ods_kfs_pdp, ods_kbm_employee_snapshot, ods_kfs_ldap_people_employee_basic, Outbound_External_Interface_Table_ETL, uciBud100PopulateTablesJob,uciStf100PopulateTablesJob, uciStf200PopulateTablesJob, uciUcopCafpJob, uciUcopCfsbalJob, uciUcopEfa100Job, uciSmsGlFeedJob, uciUcopEfa200Job

3)  Staging_TEM job ran fine after Warren cleaned up in Oracle side.

4)  Received ODBC installed on PC.  Informatica can connect to Oracle production

5)  Analytix:  Provided our versions of our DBs that they asked.  They confirmed access to talenddev server.  Attended weekly status meeting this Friday morning.  They're going to send me a list of sqlsver tables so I can send them DDLs to them to create these tables.

6)  uciSmsGIFeed:  The job loaded month-end data this month without problem.  FYI -  Following day, this was the 2nd time this month that Jarrod reran, regenerated the trigger.  The job ran fine 2nd time. 

7)  Completed

• Not complete yet section: 

  1)  Staging krns job loaded all tables but Talend sent false notification.  I need to debug this job.
  2)  Export all talend jobs on new server
  3)  ACCOUNT_CG_PRPSL_NBR not being populated in dss_kfs.KFS_D_ACCOUNT

          4)  Change host name to ods talend jobs to replace Nebula

5)  SBSO:  with the newest revision to the re-mapping logic:  When I came back from my 1-day vacation (due to many accumulated vacation hours, use it or loose it), I was told that we hold off on this task until further direction. 

6) Pager duty next week. 

Anh’s Status 3/16/2015 – 3/27/2015

Highlight: 

• Completed section:

1)  Fixed prod_all_ldap_tables by increasing length of LAST_UPDATE_TS from 23 to 30. 

2)  Fixed doc details job from failing due to error "java.lang.OutOfMemoryError: GC overhead limit exceeded".   I increased to 15G.  Job ran fine.  Data is up-to-date.

3)  dwhreader: 

a)  Completed dev_AssetDimensionMaster_creates_trigger

b)  The staging_cg job failed at the iterate in toraclelist component due to tables as synonyms in dwhreader.   Thanks Valerie.  I put in the fix.  This job now ran fine.   Completed.

c)  Completed dev_dim_account_master_creates_trigger.

d)  Completed dev_staging_ca has the new change.

4)  JIRA KFSDW-612:  Users confirmed the fix.  It's now closed. 

5)  Fixed prod_dim_asset_master, prod_dim_account_master by using the older version in tac.  The cause of the jobs failed is unknown, and is under investigation.  The only change made was in tOracleList component in the staging_cg job in dev for talend to see dwhreader schema.   To solve this problem, I used the previous version before the change in tOracleList.  The job has been running fine without problem. 

 6)  Created JIRA,  linked with JIRA  

7)  Debugged prod_staging_krew job that failed on production last night.  I’m in the process of debugging all 50+ krew tables, 1 by 1. So far loaling table KREW_DOC_HDR_EXT_DT_T from kfsprd caused error "java.sql.SQLException: Only dates between January 1, 1753 and December 31, 9999 are accepted.".   Some records that with value of VAL (only date column in this table) has date that is out-of-range mentioned above.  I brought this up to Warren's attention.  He deleted these records.  The nightly job ran fine after that.

8)  Staging_TEM job failed with date out-of-range error.  Warren identified the mistyped date from users, said that he will clean up data this week end.

• Not complete yet section:
      
        1)  dwhreader: 
      
                  a)       staging_uc has Incorrect syntax near ')' after trying many different      syntaxes.
                  b)       Remaining staging jobs:      ap,ar,cm,fp,fs,kr,krew,krim,krns,ld,pdp,pur,sh,tem,uci 
      
       2)  uciSmsGIFeed: The request was not approved for adding the time      next to the date to Jarrod's JIRA kfsi-11864.    I still      need to proceed with creating an additional key using batch_date in order      to load the Feb data.  Steps required are:  Move all data      from 'ods_kfs.UCI_SMS_FEED_DETAIL_T to a temp table before dropping      it in order to add another key to this table.  Move data from the      temp table back to it, including data for Feb that was saved in      [dss_kfs].[ods_kfs].[z_temp_from_oracle_UCI_SMS_FEED_DETAIL_T]
      
       3)  Export all talend jobs on new server
      
       4)  ACCOUNT_CG_PRPSL_NBR not being populated in dss_kfs.KFS_D_ACCOUNT

          5)  SBSO:  with the newest revision to the re-mapping logic

  6)  Change host name to ods talend jobs to replace Nebula