airflow.contrib.hooks.emr_hook

Module Contents

class airflow.contrib.hooks.emr_hook.EmrHook(emr_conn_id=None, region_name=None, *args, **kwargs)[source]

Bases: airflow.contrib.hooks.aws_hook.AwsHook

Interact with AWS EMR. emr_conn_id is only necessary for using the create_job_flow method.

get_conn(self)[source]
get_cluster_id_by_name(self, emr_cluster_name, cluster_states)[source]
create_job_flow(self, job_flow_overrides)[source]

Creates a job flow using the config from the EMR connection. Keys of the json extra hash may have the arguments of the boto3 run_job_flow method. Overrides for this config may be passed as the job_flow_overrides.

Was this entry helpful?