tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable¶

Example Airflow DAG for Managed Spark workflow operators.

Attributes¶

`ENV_ID`
`DAG_ID`
`PROJECT_ID`
`REGION`
`CLUSTER_NAME_BASE`
`CLUSTER_NAME_FULL`
`CLUSTER_NAME`
`CLUSTER_CONFIG`
`PIG_JOB`
`WORKFLOW_NAME`
`WORKFLOW_TEMPLATE`
`create_workflow_template`
`test_run`

Module Contents¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.ENV_ID[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.DAG_ID = 'dataproc_workflow_def'[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.PROJECT_ID[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.REGION = 'europe-west1'[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.CLUSTER_NAME_BASE = ''[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.CLUSTER_NAME_FULL[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.CLUSTER_NAME = ''[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.CLUSTER_CONFIG[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.PIG_JOB[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.WORKFLOW_NAME = 'airflow-dataproc-test-def'[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.WORKFLOW_TEMPLATE[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.create_workflow_template[source]¶

tests.system.google.cloud.dataproc.example_dataproc_workflow_deferrable.test_run[source]¶

Was this entry helpful?