airflow.contrib.operators.emr_add_steps_operator

Module Contents

class airflow.contrib.operators.emr_add_steps_operator.EmrAddStepsOperator(job_flow_id, aws_conn_id='s3_default', steps=None, *args, **kwargs)[source]

Bases: airflow.models.BaseOperator

An operator that adds steps to an existing EMR job_flow.

Parameters

  • job_flow_id (str) – id of the JobFlow to add steps to. (templated)

  • aws_conn_id (str) – aws connection to uses

  • steps (list) – boto3 style steps to be added to the jobflow. (templated)

template_fields = ['job_flow_id', 'steps'][source]
template_ext = [][source]
ui_color = #f9c915[source]
execute(self, context)[source]

Was this entry helpful?