Description

Tools: Talend

Detail job

Flow job

Access rights

Source

Format

The format of the source data

Destination

Location

The data will keep in

Bucket = cs-ew1-prj-data-dm-dt-[dev]-staging/xxx

DataOean GCP = prj-data-dm-dt-[env]

Product GCP = ??

To save the data into GCP Industrial Data Ocean, service account is required

Format

Same as the source

Sizing

Assessment

How to validate that the generated output is valid: 

Scheduling

Plan to schedule

1. Loading

1.1 Incremental Load

1.2 Full load

1.3. Reloading data

Timing

The average time expected for  loading:

Criticality

High/Medium/Low

Logging