Airflow Summit 2025 is coming October 07-09. Register now for early bird ticket!

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable¶

Example Airflow DAG for DataprocSubmitJobOperator with spark job in deferrable mode.

Attributes¶

`ENV_ID`
`DAG_ID`
`PROJECT_ID`
`REGION`
`BATCH_ID`
`BATCH_CONFIG`
`create_batch`
`test_run`

Module Contents¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.ENV_ID[source]¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.DAG_ID = 'dataproc_batch_deferrable'[source]¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.PROJECT_ID[source]¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.REGION = 'europe-north1'[source]¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.BATCH_ID = ''[source]¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.BATCH_CONFIG[source]¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.create_batch[source]¶

tests.system.google.cloud.dataproc.example_dataproc_batch_deferrable.test_run[source]¶

Was this entry helpful?