Data, Analytics & AI Platform

Page tree


You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

Job Details

As part of HR DQ project, we have developed the below Talend jobs which gets the data from SuccessFactor tables and ingest data into the respective STG/ODS tables. We are following the DataOcean standard jobs. 


Talend Job nameSuccessFactor Table nameTalend projectGCP ProjectSTG TableODS table
F010_SAP_SF_EmpJob_SAP_SF_to_ODSEmpJobDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_EmpJobODS_SFC_0000_F001_F_D_EmpJob
F009_SAP_SF_EmpEmployment_SAP_SF_to_ODSEmpEmploymentDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_EmpEmploymentODS_SFC_0000_F001_F_D_EmpEmployment
F005_SAP_SF_EmpEmploymentTermination_SAP_SF_to_ODSEmpEmploymentTerminationDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_EmpEmploymentTerminationODS_SFC_0000_F001_F_D_EmpEmploymentTermination
F006_SAP_SF_EmpPayCompRecurring_SAP_SF_to_ODSEmpPayCompRecurringDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_EmpPayCompRecurringODS_SFC_0000_F001_F_D_EmpPayCompRecurring
F007_SAP_SF_EmpCompensation_SAP_SF_to_ODSEmpCompensationDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_EmpCompensationODS_SFC_0000_F001_F_W_EmpCompensation
F008_SAP_SF_FOPayComponent_SAP_SF_to_ODSFOPayComponentDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_FOPayComponentODS_SFC_0000_F001_F_D_FOPayComponent
F004_SAP_SF_EmpJobRelationships_SAP_SF_to_ODSEmpJobRelationshipsDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_EmpJobRelationshipsODS_SFC_0000_F001_F_D_EmpJobRelationships
F001_SAP_SF_PerEmail_SAP_SF_to_ODSPerEmailDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_PerEmailODS_SFC_0000_F001_F_D_PerEmail
F002_SAP_SF_PerPersonal_SAP_SF_to_ODSPerPersonDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_PerPersonODS_SFC_0000_F001_F_D_PerPerson
F003_SAP_SF_PerPerson_SAP_SF_to_ODSPerPersonalDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_D_PerPersonalODS_SFC_0000_F001_F_D_PerPersonal
F011_SAP_SF_FOEventReason_csv_to_GCSFOEventReasonDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_FOEventReasonODS_SFC_0000_F001_F_W_FOEventReason
F012_SAP_SF_UserAccount_csv_to_GCSUserAccountDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_UserAccountODS_SFC_0000_F001_F_W_UserAccount
F014_SAP_FOLocationGroup_SAP_SF_to_ODSFOLocationGroupDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_FOLocationGroupODS_SFC_0000_F001_F_W_FOLocationGroup
F015_SAP_FOCompany_SAP_SF_to_ODSFOCompanyDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_FOCompanyODS_SFC_0000_F001_F_W_FOCompany
F016_SAP_FOCostCenter_SAP_SF_to_ODSFOCostCenterDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_FOCostCenterODS_SFC_0000_F001_F_W_FOCostCenter
F017_SAP_FOBusinessUnit_SAP_SF_to_ODSFOBusinessUnitDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_FOBusinessUnitODS_SFC_0000_F001_F_W_FOBusinessUnit
F018_SAP_PickListValueV2_SAP_SF_to_ODSPickListValueV2DATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_PickListValueV2ODS_SFC_0000_F001_F_W_PickListValueV2
F019_SAP_Position_SAP_SF_to_ODSPositionDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_PositionODS_SFC_0000_F001_F_W_Position
F020_SAP_EmpWorkPermit_SAP_SF_to_ODSEmpWorkPermitDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_EmpWorkPermitODS_SFC_0000_F001_F_W_EmpWorkPermit
F021_SAP_FOLocation_SAP_SF_to_ODSFOLocationDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_FOLocationODS_SFC_0000_F001_F_W_FOLocation
F012_SAP_User_SAP_SF_to_ODSUserDATA_OCEAN_DOMAIN_HRprj-data-dm-hr-prodSTG_SFC_0000_0000_F001_F_W_UserODS_SFC_0000_F001_F_W_User
FlowNameTasksDescriptionSource_table/queryTarget_TableComplex transformation, if Yes,then logic
F001_*J001_*
J002_*
J003_*		<job description><source table details><target table details>
F100_*J100_*
J101_*
J103_*		<job description><source table details><target table details>
F200_*J200_*
J201_*
J202_*		<job description><source table details><target table details>


Data Validation/Troubleshoot queries

Data Validation:

<Provide the SQL queries to validate the data or the record count in the BQ target tables>

Logging:

<Details about the log tables in Big query>

Troubleshoot steps:

<Provide the steps to debug the ETL flow in case of failure. For example, if an ETL job fails, how should we trigger it? Can we directly rerun the job, or are there steps to delete the data from the previous execution before rerunning the job? or any change should be made in the context table for date executions>


Powered by Atlassian Confluence and Brikit Theme Press