airflow.providers.google.cloud.operators.datapipeline

This module contains Google Data Pipelines operators.

Module Contents

Classes

CreateDataPipelineOperator

Creates a new Data Pipelines instance from the Data Pipelines API.

RunDataPipelineOperator

Runs a Data Pipelines Instance using the Data Pipelines API.
class airflow.providers.google.cloud.operators.datapipeline.CreateDataPipelineOperator(*, body, project_id=PROVIDE_PROJECT_ID, location=DEFAULT_DATAFLOW_LOCATION, gcp_conn_id='google_cloud_default', impersonation_chain=None, **kwargs)[source]

Bases: airflow.providers.google.cloud.operators.dataflow.DataflowCreatePipelineOperator

Creates a new Data Pipelines instance from the Data Pipelines API.

class airflow.providers.google.cloud.operators.datapipeline.RunDataPipelineOperator(data_pipeline_name, project_id=PROVIDE_PROJECT_ID, location=DEFAULT_DATAFLOW_LOCATION, gcp_conn_id='google_cloud_default', **kwargs)[source]

Bases: airflow.providers.google.cloud.operators.dataflow.DataflowRunPipelineOperator

Runs a Data Pipelines Instance using the Data Pipelines API.

Was this entry helpful?