tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable

Example Airflow DAG for DataprocSubmitJobOperator with spark job in deferrable mode.

Module Contents

tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.ENV_ID[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.DAG_ID = 'dataproc_batch_deferrable'[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.PROJECT_ID[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.REGION = 'europe-west1'[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.BATCH_ID[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.BATCH_CONFIG[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.create_batch[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_batch_deferrable.test_run[source]

Was this entry helpful?