airflow.providers.amazon.aws.triggers.glue_crawler

Module Contents

Classes

GlueCrawlerCompleteTrigger

Watches for a glue crawl, triggers when it finishes.
class airflow.providers.amazon.aws.triggers.glue_crawler.GlueCrawlerCompleteTrigger(crawler_name, poll_interval=None, aws_conn_id='aws_default', waiter_delay=5, waiter_max_attempts=1500)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Watches for a glue crawl, triggers when it finishes.

Parameters

  • crawler_name (str) – name of the crawler to watch

  • poll_interval (int | None) – The amount of time in seconds to wait between attempts.

  • aws_conn_id (str) – The Airflow connection used for AWS credentials.

hook()[source]

Override in subclasses to return the right hook.

Was this entry helpful?