airflow.contrib.sensors.emr_job_flow_sensor

Module Contents

class airflow.contrib.sensors.emr_job_flow_sensor.EmrJobFlowSensor(job_flow_id, *args, **kwargs)[source]

Bases: airflow.contrib.sensors.emr_base_sensor.EmrBaseSensor

Asks for the state of the JobFlow until it reaches a terminal state. If it fails the sensor errors, failing the task.

Parameters

job_flow_id (str) – job_flow_id to check the state of

NON_TERMINAL_STATES = ['STARTING', 'BOOTSTRAPPING', 'RUNNING', 'WAITING', 'TERMINATING'][source]
FAILED_STATE = ['TERMINATED_WITH_ERRORS'][source]
template_fields = ['job_flow_id'][source]
template_ext = [][source]
get_emr_response(self)[source]
static state_from_response(response)[source]
static failure_message_from_response(response)[source]

Was this entry helpful?