Airflow Summit 2025 is coming October 07-09. Register now for early bird ticket!

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable¶

Example Airflow DAG for testing Google Dataflow Beam Pipeline Operator with Asynchronous Python in the deferrable mode.

Attributes¶

`ENV_ID`
`DAG_ID`
`RESOURCE_DATA_BUCKET`
`BUCKET_NAME`
`GCS_TMP`
`GCS_STAGING`
`GCS_OUTPUT`
`GCS_PYTHON_SCRIPT`
`LOCATION`
`default_args`
`create_bucket`
`test_run`

Module Contents¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.ENV_ID[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.DAG_ID = 'dataflow_sensors_deferrable'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.RESOURCE_DATA_BUCKET = 'airflow-system-tests-resources'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.BUCKET_NAME = 'bucket_dataflow_sensors_deferrable_Uninferable'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.GCS_TMP = 'gs://bucket_dataflow_sensors_deferrable_Uninferable/temp/'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.GCS_STAGING = 'gs://bucket_dataflow_sensors_deferrable_Uninferable/staging/'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.GCS_OUTPUT = 'gs://bucket_dataflow_sensors_deferrable_Uninferable/output'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.GCS_PYTHON_SCRIPT = 'gs://airflow-system-tests-resources/dataflow/python/wordcount_debugging.py'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.LOCATION = 'europe-west3'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.default_args[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.create_bucket[source]¶

tests.system.google.cloud.dataflow.example_dataflow_sensors_deferrable.test_run[source]¶

Was this entry helpful?