Airflow Summit 2025 is coming October 07-09. Register now for early bird ticket!

tests.system.google.cloud.dataflow.example_dataflow_native_python_async¶

Example Airflow DAG for testing Google Dataflow Beam Pipeline Operator with Asynchronous Python.

Attributes¶

`ENV_ID`
`DAG_ID`
`RESOURCE_DATA_BUCKET`
`BUCKET_NAME`
`GCS_TMP`
`GCS_STAGING`
`GCS_OUTPUT`
`GCS_PYTHON_SCRIPT`
`LOCATION`
`default_args`
`create_bucket`
`test_run`

Module Contents¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.ENV_ID[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.DAG_ID = 'dataflow_native_python_async'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.RESOURCE_DATA_BUCKET = 'airflow-system-tests-resources'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.BUCKET_NAME = 'bucket_dataflow_native_python_async_Uninferable'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.GCS_TMP = 'gs://bucket_dataflow_native_python_async_Uninferable/temp/'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.GCS_STAGING = 'gs://bucket_dataflow_native_python_async_Uninferable/staging/'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.GCS_OUTPUT = 'gs://bucket_dataflow_native_python_async_Uninferable/output'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.GCS_PYTHON_SCRIPT = 'gs://airflow-system-tests-resources/dataflow/python/wordcount_debugging.py'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.LOCATION = 'europe-west3'[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.default_args[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.create_bucket[source]¶

tests.system.google.cloud.dataflow.example_dataflow_native_python_async.test_run[source]¶

Was this entry helpful?