airflow.contrib.operators.emr_create_job_flow_operator

Module Contents

class airflow.contrib.operators.emr_create_job_flow_operator.EmrCreateJobFlowOperator(aws_conn_id='s3_default', emr_conn_id='emr_default', job_flow_overrides=None, region_name=None, *args, **kwargs)[source]

Bases: airflow.models.BaseOperator

Creates an EMR JobFlow, reading the config from the EMR connection. A dictionary of JobFlow overrides can be passed that override the config from the connection.

Parameters

  • aws_conn_id (str) – aws connection to uses

  • emr_conn_id (str) – emr connection to use

  • job_flow_overrides (dict) – boto3 style arguments to override emr_connection extra. (templated)

template_fields = ['job_flow_overrides'][source]
template_ext = [][source]
ui_color = #f9c915[source]
execute(self, context)[source]

Was this entry helpful?