tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator
¶
Example Airflow DAG testing Dataproc operators for managing a cluster and submitting jobs.
Module Contents¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.DAG_ID = 'dataproc_cluster_generation'[source]¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.BUCKET_NAME[source]¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.CLUSTER_NAME[source]¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.REGION = 'europe-west1'[source]¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.ZONE = 'europe-west1-b'[source]¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.INIT_FILE_SRC[source]¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.INIT_FILE = 'pip-install.sh'[source]¶
- tests.system.providers.google.cloud.dataproc.example_dataproc_cluster_generator.CLUSTER_GENERATOR_CONFIG[source]¶