Upload data from Local Filesystem to Google Cloud Storage¶

The Google Cloud Storage (GCS) is used to store large data from various applications. This page shows how to upload data from local filesystem to GCS.

Prerequisite Tasks¶

LocalFilesystemToGCSOperator¶

LocalFilesystemToGCSOperator allows you to upload data from local filesystem to GCS.

When you use this operator, you can optionally compress the data being uploaded.

Below is an example of using this operator to upload a file to GCS.

tests/system/providers/google/gcs/example_gcs_upload_download.py

    upload_file = LocalFilesystemToGCSOperator(
        task_id="upload_file",
        src=UPLOAD_FILE_PATH,
        dst=FILE_NAME,
        bucket=BUCKET_NAME,
    )

Reference¶

For further information, look at:

Google Cloud Storage Documentation