`airflow.contrib.hooks.emr_hook`¶

Module Contents¶

class airflow.contrib.hooks.emr_hook.EmrHook(emr_conn_id=None, region_name=None, *args, **kwargs)[source]¶

Bases: airflow.contrib.hooks.aws_hook.AwsHook

Interact with AWS EMR. emr_conn_id is only necessary for using the create_job_flow method.

get_conn(self)[source]¶

get_cluster_id_by_name(self, emr_cluster_name, cluster_states)[source]¶

create_job_flow(self, job_flow_overrides)[source]¶: Creates a job flow using the config from the EMR connection. Keys of the json extra hash may have the arguments of the boto3 run_job_flow method. Overrides for this config may be passed as the job_flow_overrides.

Was this entry helpful?