airflow.providers.amazon.aws.sensors.glue_crawler

Module Contents

Classes

GlueCrawlerSensor

Waits for an AWS Glue crawler to reach any of the statuses below.
class airflow.providers.amazon.aws.sensors.glue_crawler.GlueCrawlerSensor(*, crawler_name, aws_conn_id='aws_default', **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Waits for an AWS Glue crawler to reach any of the statuses below.

‘FAILED’, ‘CANCELLED’, ‘SUCCEEDED’

See also

For more information on how to use this sensor, take a look at the guide: Wait on an AWS Glue crawler state

Parameters

  • crawler_name (str) – The AWS Glue crawler unique name

  • aws_conn_id (str | None) – aws connection to use, defaults to ‘aws_default’ If this is None or empty then the default boto3 behaviour is used. If running Airflow in a distributed manner and aws_conn_id is None or empty, then default boto3 configuration would be used (and must be maintained on each worker node).

template_fields: Sequence[str] = ('crawler_name',)[source]
poke(context)[source]

Override when deriving this class.

get_hook()[source]

Return a new or pre-existing GlueCrawlerHook.

hook()[source]

Was this entry helpful?