tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator

Example Airflow DAG testing Dataproc operators for managing a cluster and submitting jobs.

Module Contents

tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.ENV_ID[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.DAG_ID = dataproc_cluster_generation[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.PROJECT_ID[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.BUCKET_NAME[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.CLUSTER_NAME[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.REGION = europe-west1[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.ZONE = europe-west1-b[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.INIT_FILE_SRC[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.INIT_FILE = pip-install.sh[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.CLUSTER_GENERATOR_CONFIG[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.TIMEOUT[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.create_bucket[source]
tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.test_run[source]

Was this entry helpful?