airflow.providers.google.cloud.example_dags.example_cloud_storage_transfer_service_gcp¶
Example Airflow DAG that demonstrates interactions with Google Cloud Transfer.
This DAG relies on the following OS environment variables
GCP_PROJECT_ID - Google Cloud Project to use for the Google Cloud Transfer Service.
GCP_TRANSFER_FIRST_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied from AWS. It is also a source bucket in next step
GCP_TRANSFER_SECOND_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied
Module Contents¶
- airflow.providers.google.cloud.example_dags.example_cloud_storage_transfer_service_gcp.GCP_PROJECT_ID[source]¶
- airflow.providers.google.cloud.example_dags.example_cloud_storage_transfer_service_gcp.GCP_TRANSFER_FIRST_TARGET_BUCKET[source]¶
- airflow.providers.google.cloud.example_dags.example_cloud_storage_transfer_service_gcp.GCP_TRANSFER_SECOND_TARGET_BUCKET[source]¶
- airflow.providers.google.cloud.example_dags.example_cloud_storage_transfer_service_gcp.gcs_to_gcs_transfer_body[source]¶