This job shows how you upload the content of a Google Sheet file in a Google Cloud Storage bucket as a CSV file.
The job is not fully dynamic because this component does not support the Dyanamic column type.
PREREQUISITES
- In order to read the Google Sheet file you must have a .P12 key file of the GCP service account
- The Google Sheet be "homogeneous" i.e. you will provide a start and end row and data should be consistent within this range
JOB DESCRIPTION
1 - Reads the content of a Google Sheet tab and save it as a CSV file in the local pc or remote engine
2 - Upload the file to a folder in the desired Google Cloud Storage bucket
3 - Delete the file from the remote engine.
HOW TO USE THIS JOB?
This job is not fully dynamic so you will have to manually provide the schema of the Google Sheet input file.
1 - Copy the job from the DATA_OCEAN project into yours. Each copy will be used for a specific file.
2 - Enter the job and modify the schema of the component so that it matches the one of the Google Sheet
3 - You can drag and drop the modified job into your flow and provide the necessary parameters.