Description
Tools: Talend
Detail job
- F090_Jira_search_to_ODS
Flow job
- PL_DT_F090_Jira_search_to_ODS (Name of the plan which is used to schedule the Talend job in the TMC)
Access rights
Source
Format
- JSON
Destination
Location
The data will keep in
- Bucket = cs-ew1-prj-data-dm-dt-[dev]-staging/xxx
- DataOean GCP = prj-data-dm-dt-[env]
- STG Table name = prj-data-dm-dt-[env].STG.STG_JIR_0000_0000_F001_I_H_JiraSearch
- ODS Table name = prj-data-dm-dt-[Env].ODS.ODS_JIR_0000_F001_I_H_JiraSearch
- DPL View name = To be updated
To save the data into GCP Industrial Data Ocean, service account is required
Format
- columnar format
Sizing
Assessment
How to validate that the generated output is valid:
Loading
1.1 Incremental Load
1.2 Full load
1.3. Reloading data
1.4 Plan to schedule
1.5 Timing
The average time expected for loading:
Criticality
High/Medium/Low