airflow.providers.amazon.aws.hooks.glue_crawler
¶
Module Contents¶
Classes¶
Interacts with AWS Glue Crawler. |
- class airflow.providers.amazon.aws.hooks.glue_crawler.GlueCrawlerHook(*args, **kwargs)[source]¶
Bases:
airflow.providers.amazon.aws.hooks.base_aws.AwsBaseHook
Interacts with AWS Glue Crawler.
Provide thin wrapper around
boto3.client("glue")
.Additional arguments (such as
aws_conn_id
) may be specified and are passed down to the underlying AwsBaseHook.- has_crawler(crawler_name)[source]¶
Check if the crawler already exists.
- Parameters
crawler_name – unique crawler name per AWS account
- Returns
Returns True if the crawler already exists and False if not.
- Return type
- update_crawler(**crawler_kwargs)[source]¶
Update crawler configurations.
See also
- Parameters
crawler_kwargs – Keyword args that define the configurations used for the crawler
- Returns
True if crawler was updated and false otherwise
- Return type
- create_crawler(**crawler_kwargs)[source]¶
Create an AWS Glue Crawler.
See also
- Parameters
crawler_kwargs – Keyword args that define the configurations used to create the crawler
- Returns
Name of the crawler
- Return type