tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp¶
Example Airflow DAG that demonstrates interactions with Google Cloud Transfer.
This DAG relies on the following OS environment variables
GCP_PROJECT_ID - Google Cloud Project to use for the Google Cloud Transfer Service.
GCP_TRANSFER_FIRST_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied from AWS. It is also a source bucket in next step
GCP_TRANSFER_SECOND_TARGET_BUCKET - Google Cloud Storage bucket to which files are copied
Module Contents¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.ENV_ID[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.PROJECT_ID_TRANSFER[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.DAG_ID = 'example_gcp_transfer'[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.BUCKET_NAME_SRC[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.BUCKET_NAME_DST[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.FILE_NAME = 'file'[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.FILE_URI[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.CURRENT_FOLDER[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.FILE_LOCAL_PATH[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.gcs_to_gcs_transfer_body[source]¶
- tests.system.providers.google.cloud.storage_transfer.example_cloud_storage_transfer_service_gcp.update_body[source]¶