View Source

The job allows you to get files from a shared folder based on a title mask. The files whose title matches the mask, will be upload into a Google Cloud Storage bucket.

Data Ocean > J001_SharedFolder_to_GCS - Upload files from a shared folder > image2023-6-6_15-44-52.png

PREREQUISITES

Be sure that the Talend remote engine account is authorized to access the folder otherwise.

HOW TO USE THIS JOB?

Copy the job from the DATA_OCEAN project and paste it into your project
Drag and drop the copied job into your Talend flow
Provide the necessary parameters to make the job work

The parameters that you have to provide are highlighted here below.

CONTEXT VARIABLE	DESCRIPTION
l_PATHDIR_SHARED_FOLDER	The full path of the shared folder that
l_VAR_FILE_MASK	The pattern used to only get the necessary files
l_PATHDIR_SERVICE_ACCOUNT_KEY	l_PATHDIR_SERVICE_ACCOUNT_KEY
l_VAR_BUCKET_NAME	The name of the GCS bucket that will store the files
l_VAR_BUCKET_FOLDER	The bucket folder where the file will be stored
l_PATHDIR_LOCAL_FOLDER	The local folder where the file will be temporarily staged