airflow.providers.amazon.aws.sensors.glue_crawler

Module Contents

Classes

GlueCrawlerSensor

Waits for an AWS Glue crawler to reach any of the statuses below

class airflow.providers.amazon.aws.sensors.glue_crawler.GlueCrawlerSensor(*, crawler_name, aws_conn_id='aws_default', **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Waits for an AWS Glue crawler to reach any of the statuses below ‘FAILED’, ‘CANCELLED’, ‘SUCCEEDED’

See also

For more information on how to use this sensor, take a look at the guide: Wait on an AWS Glue crawler state

Parameters
  • crawler_name (str) – The AWS Glue crawler unique name

  • aws_conn_id (str) – aws connection to use, defaults to ‘aws_default’

template_fields :Sequence[str] = ['crawler_name'][source]
poke(context)[source]

Function defined by the sensors while deriving this class should override.

get_hook()[source]

Returns a new or pre-existing GlueCrawlerHook

Was this entry helpful?