Google Cloud Storage to Amazon S3 transfer operator

Use the GCSToS3Operator transfer to copy the data from Google Cloud Storage to Amazon Simple Storage Service (S3).

Prerequisite Tasks

To use these operators, you must do a few things:

Operators

Google Cloud Storage to Amazon S3

To copy data from a Google Cloud Storage bucket to an Amazon S3 bucket you can use GCSToS3Operator

Example usage:

tests/system/providers/amazon/aws/example_gcs_to_s3.py[source]

gcs_to_s3 = GCSToS3Operator(
    task_id="gcs_to_s3",
    bucket=s3_bucket,
    dest_s3_key=s3_key,
    replace=True,
)

Was this entry helpful?