The job allows you to get files from a shared folder based on a title mask. The files whose title matches the mask, will be upload into a Google Cloud Storage bucket.
PREREQUISITES
- Be sure that the Talend remote engine account is authorized to access the folder otherwise.
HOW TO USE THIS JOB?
- Copy the job from the DATA_OCEAN project and paste it into your project
- Drag and drop the copied job into your Talend flow
- Provide the necessary parameters to make the job work
The parameters that you have to provide are highlighted here below.
CONTEXT VARIABLE | DESCRIPTION |
|---|---|
| l_PATHDIR_SHARED_FOLDER | The full path of the shared folder that |
| l_VAR_FILE_MASK | The pattern used to only get the necessary files |
| l_PATHDIR_SERVICE_ACCOUNT_KEY | l_PATHDIR_SERVICE_ACCOUNT_KEY |
| l_VAR_BUCKET_NAME | The name of the GCS bucket that will store the files |
| l_VAR_BUCKET_FOLDER | The bucket folder where the file will be stored |
| l_PATHDIR_LOCAL_FOLDER | The local folder where the file will be temporarily staged |