Upload data from Local Filesystem to Google Cloud Storage¶
The Google Cloud Storage (GCS) is used to store large data from various applications. This page shows how to upload data from local filesystem to GCS.
LocalFilesystemToGCSOperator allows you to upload
data from local filesystem to GCS.
When you use this operator, you can optionally compress the data being uploaded.
Below is an example of using this operator to upload a file to GCS.
upload_file = LocalFilesystemToGCSOperator( task_id="upload_file", src=PATH_TO_UPLOAD_FILE, dst=DESTINATION_FILE_LOCATION, bucket=BUCKET_NAME, )