I am a data engineer and I am asked to bring a BW table into the ODS of the marketing domain. What should I do?
I should use the dedited project for the domain, in this case the one for marketing. The list of Talend project can be found here.
In case the data architect does not know to which project it belongs, you should use the common domain.
Your job consists in combining Talend jobs to comply with the Data Ocean architecture.
First you should store data in a bucket, then the file will be moved into Staging and then into the ODS data. The job show is a template you can use.
The Talend job XX can be used as a template, where you can change the data extraction component depending on your specific use case.
You should use the GCP project of the desired domain. The full list can found here.
The files should be named following our naming convention. The file names depend on the source from where you are extracting as well as from the type of extraction.
You can use this Google Sheet to create your file name by providing information about the source. The file will also generate the name of the staging and ODS table that you will need to create.