`tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable`¶

Example Airflow DAG for DataprocSubmitJobOperator with spark job in deferrable mode.

Module Contents¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.ENV_ID[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.DAG_ID = dataproc_spark[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.PROJECT_ID[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.CLUSTER_NAME[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.REGION = europe-west1[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.ZONE = europe-west1-b[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.CLUSTER_CONFIG[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.TIMEOUT[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.SPARK_JOB[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.create_cluster[source]¶

tests.system.providers.google.cloud.dataproc.example_dataproc_spark_deferrable.test_run[source]¶

Was this entry helpful?