This job allows you to upload all the files of a Google Drive folder into a Google Cloud Storage bucket

PREREQUISTES

• The GCP service account must have at least read access on the Google Drive folder.

JOB DESCRIPTION

1 - The job tries to connect to the desired Google Drive folder, if the connection fails, the job will stop and raise an error

2 - The job creates a subfolder inside the output folder that you specified. This folder will be used to save locally the Google Drive files during the processing.

3 - The job will download all the files locally.

4 - The files are uploaded into the desired Google Cloud Storage bucket.

5 - The subfolder (with all its files) is deleted

HOW TO USE THIS JOB?

The job is fully dynamic. So you can :

• Copy the job from the DATA_OCEAN project and paste it into your project
• Drag and drop the copied job into your Talend flow
• Provide the necessary parameters to make the job work.