Page tree


You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

Description

Tools: Talend

Detail job

  • F010_Helix_Incidents


  • F040_Helix_Measurement


  • F050_Helix_Request


  • F030_Helix_ServiceRequestStub


  • F021_Helix_WorkInfo


  • F011_Helix_Worklog


  • F020_Helix_WorkOrder_json

Flow job

Below are the list of plan names which are used to invoke the above mentioned Talend jobs.

  • PL_DT_F020_Helix_WorkOrder_json
  • PL_DT_F011_Helix_Worklog
  • PL_DT_F021_Helix_WorkInfo
  • PL_DT_F030_Helix_ServiceRequestStub
  • PL_DT_F050_Helix_Request
  • PL_DT_F040_Helix_Measurement
  • PL_DT_F010_Helix_Incidents

Access rights

Source

Format

  • JSON

Destination

Location

The data will keep in

Bucket = cs-ew1-prj-data-dm-dt-[dev]-staging/xxx

DataOean GCP = prj-data-dm-dt-[env]

Product GCP = ??

To save the data into GCP Industrial Data Ocean, service account is required

Format

Same as the source

Sizing


Assessment

How to validate that the generated output is valid: 

Loading

1.1 Incremental Load

1.2 Full load

1.3. Reloading data

1.4 Plan to schedule

1.5 Timing

The average time expected for  loading:

Criticality

High/Medium/Low

Logging