airflow.providers.amazon.aws.sensors.glue

Module Contents

Classes

GlueJobSensor

Waits for an AWS Glue Job to reach any of the status below.
class airflow.providers.amazon.aws.sensors.glue.GlueJobSensor(*, job_name, run_id, verbose=False, aws_conn_id='aws_default', **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Waits for an AWS Glue Job to reach any of the status below.

‘FAILED’, ‘STOPPED’, ‘SUCCEEDED’

See also

For more information on how to use this sensor, take a look at the guide: Wait on an AWS Glue job state

Parameters

  • job_name (str) – The AWS Glue Job unique name

  • run_id (str) – The AWS Glue current running job identifier

  • verbose (bool) – If True, more Glue Job Run logs show in the Airflow Task Logs. (default: False)

template_fields: Sequence[str] = ('job_name', 'run_id')[source]
hook()[source]
poke(context)[source]

Function defined by the sensors while deriving this class should override.

Was this entry helpful?