airflow.providers.amazon.aws.triggers.glue_databrew

Module Contents

Classes

GlueDataBrewJobCompleteTrigger

Watches for a Glue DataBrew job, triggers when it finishes.
class airflow.providers.amazon.aws.triggers.glue_databrew.GlueDataBrewJobCompleteTrigger(job_name, run_id, waiter_delay=30, waiter_max_attempts=60, aws_conn_id='aws_default', **kwargs)[source]

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Watches for a Glue DataBrew job, triggers when it finishes.

Parameters

  • job_name (str) – Glue DataBrew job name

  • run_id (str) – the ID of the specific run to watch for that job

  • waiter_delay (int) – Number of seconds to wait between two checks. Default is 30 seconds.

  • waiter_max_attempts (int) – Maximum number of attempts to wait for the job to complete. Default is 60 attempts.

  • aws_conn_id (str | None) – The Airflow connection used for AWS credentials.

hook()[source]

Override in subclasses to return the right hook.

Was this entry helpful?