Page tree


You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Next »

Description


Tools: Talend

Detail job

Flow job

Access rights


Source

           

Format

The format of the source data

Destination

Location

The data will keep in

Bucket = cs-ew1-prj-data-dm-dt-[dev]-staging/xxx

DataOean GCP = prj-data-dm-dt-[env]

Product GCP = ??

To save the data into GCP Industrial Data Ocean, service account is required

Format

Same as the source

Sizing


Assessment

How to validate that the generated output is valid: 

Scheduling

Plan to schedule

1. Loading

1.1 Incremental Load

1.2 Full load

1.3. Reloading data

Timing

The average time expected for  loading:

Criticality

High/Medium/Low

Logging