airflow.providers.amazon.aws.triggers.redshift_cluster¶

Classes¶

`RedshiftCreateClusterTrigger`	Trigger for RedshiftCreateClusterOperator.
`RedshiftPauseClusterTrigger`	Trigger for RedshiftPauseClusterOperator.
`RedshiftCreateClusterSnapshotTrigger`	Trigger for RedshiftCreateClusterSnapshotOperator.
`RedshiftResumeClusterTrigger`	Trigger for RedshiftResumeClusterOperator.
`RedshiftDeleteClusterTrigger`	Trigger for RedshiftDeleteClusterOperator.
`RedshiftClusterTrigger`	RedshiftClusterTrigger is fired as deferred class with params to run the task in trigger worker.

Module Contents¶

class airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftCreateClusterTrigger(*, cluster_identifier, aws_conn_id='aws_default', region_name=None, waiter_delay=15, waiter_max_attempts=999999, **kwargs)[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger for RedshiftCreateClusterOperator.

The trigger will asynchronously poll the boto3 API and wait for the Redshift cluster to be in the available state.

Parameters:

cluster_identifier (str) – A unique identifier for the cluster.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.
region_name (str | None) – The AWS region where the cluster is. Used to build the hook.
verify – Whether or not to verify SSL certificates. Used to build the hook.
botocore_config – Configuration dictionary for the botocore client. Used to build the hook.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftPauseClusterTrigger(*, cluster_identifier, aws_conn_id='aws_default', region_name=None, waiter_delay=15, waiter_max_attempts=999999, **kwargs)[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger for RedshiftPauseClusterOperator.

The trigger will asynchronously poll the boto3 API and wait for the Redshift cluster to be in the paused state.

Parameters:

cluster_identifier (str) – A unique identifier for the cluster.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.
region_name (str | None) – The AWS region where the cluster is. Used to build the hook.
verify – Whether or not to verify SSL certificates. Used to build the hook.
botocore_config – Configuration dictionary for the botocore client. Used to build the hook.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftCreateClusterSnapshotTrigger(*, cluster_identifier, aws_conn_id='aws_default', region_name=None, waiter_delay=15, waiter_max_attempts=999999, **kwargs)[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger for RedshiftCreateClusterSnapshotOperator.

The trigger will asynchronously poll the boto3 API and wait for the Redshift cluster snapshot to be in the available state.

Parameters:

cluster_identifier (str) – A unique identifier for the cluster.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.
region_name (str | None) – The AWS region where the cluster is. Used to build the hook.
verify – Whether or not to verify SSL certificates. Used to build the hook.
botocore_config – Configuration dictionary for the botocore client. Used to build the hook.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftResumeClusterTrigger(*, cluster_identifier, aws_conn_id='aws_default', region_name=None, waiter_delay=15, waiter_max_attempts=999999, **kwargs)[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger for RedshiftResumeClusterOperator.

The trigger will asynchronously poll the boto3 API and wait for the Redshift cluster to be in the available state.

Parameters:

cluster_identifier (str) – A unique identifier for the cluster.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.
region_name (str | None) – The AWS region where the cluster is. Used to build the hook.
verify – Whether or not to verify SSL certificates. Used to build the hook.
botocore_config – Configuration dictionary for the botocore client. Used to build the hook.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftDeleteClusterTrigger(*, cluster_identifier, aws_conn_id='aws_default', region_name=None, waiter_delay=30, waiter_max_attempts=30, **kwargs)[source]¶

Bases: airflow.providers.amazon.aws.triggers.base.AwsBaseWaiterTrigger

Trigger for RedshiftDeleteClusterOperator.

Parameters:

cluster_identifier (str) – A unique identifier for the cluster.
waiter_max_attempts (int) – The maximum number of attempts to be made.
aws_conn_id (str | None) – The Airflow connection used for AWS credentials.
waiter_delay (int) – The amount of time in seconds to wait between attempts.
region_name (str | None) – The AWS region where the cluster is. Used to build the hook.
verify – Whether or not to verify SSL certificates. Used to build the hook.
botocore_config – Configuration dictionary for the botocore client. Used to build the hook.

hook()[source]¶

Override in subclasses to return the right hook.

class airflow.providers.amazon.aws.triggers.redshift_cluster.RedshiftClusterTrigger(aws_conn_id, cluster_identifier, target_status, poke_interval)[source]¶

Bases: airflow.triggers.base.BaseTrigger

RedshiftClusterTrigger is fired as deferred class with params to run the task in trigger worker.

Parameters:

aws_conn_id (str | None) – Reference to AWS connection id for redshift
cluster_identifier (str) – unique identifier of a cluster
target_status (str) – Reference to the status which needs to be checked
poke_interval (float) – polling period in seconds to check for the status

aws_conn_id[source]¶

cluster_identifier[source]¶

target_status[source]¶

poke_interval[source]¶

serialize()[source]¶

Serialize RedshiftClusterTrigger arguments and classpath.

async run()[source]¶

Run async until the cluster status matches the target status.