airflow.providers.amazon.aws.sensors.glue_crawler

Module Contents

Classes

GlueCrawlerSensor

Waits for an AWS Glue crawler to reach any of the statuses below

AwsGlueCrawlerSensor

This sensor is deprecated. Please use
class airflow.providers.amazon.aws.sensors.glue_crawler.GlueCrawlerSensor(*, crawler_name: str, aws_conn_id: str = 'aws_default', **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Waits for an AWS Glue crawler to reach any of the statuses below 'FAILED', 'CANCELLED', 'SUCCEEDED'

Parameters

  • crawler_name (str) -- The AWS Glue crawler unique name

  • aws_conn_id (str) -- aws connection to use, defaults to 'aws_default'

poke(self, context: airflow.utils.context.Context)[source]

Function that the sensors defined while deriving this class should override.

get_hook(self) → airflow.providers.amazon.aws.hooks.glue_crawler.GlueCrawlerHook[source]

Returns a new or pre-existing GlueCrawlerHook

class airflow.providers.amazon.aws.sensors.glue_crawler.AwsGlueCrawlerSensor(*args, **kwargs)[source]

Bases: GlueCrawlerSensor

This sensor is deprecated. Please use airflow.providers.amazon.aws.sensors.glue_crawler.GlueCrawlerSensor.

Was this entry helpful?