airflow.providers.amazon.aws.sensors.dms

Classes

DmsTaskBaseSensor

Contains general sensor behavior for DMS task.

DmsTaskCompletedSensor

Pokes DMS task until it is completed.

Module Contents

class airflow.providers.amazon.aws.sensors.dms.DmsTaskBaseSensor(replication_task_arn, target_statuses=None, termination_statuses=None, **kwargs)[source]

Bases: airflow.providers.amazon.aws.sensors.base_aws.AwsBaseSensor[airflow.providers.amazon.aws.hooks.dms.DmsHook]

Contains general sensor behavior for DMS task.

Subclasses should set target_statuses and termination_statuses fields.

Parameters:
  • replication_task_arn (str) – AWS DMS replication task ARN

  • target_statuses (collections.abc.Iterable[str] | None) – the target statuses, sensor waits until the task reaches any of these states

  • termination_statuses (collections.abc.Iterable[str] | None) – the termination statuses, sensor fails when the task reaches any of these states. The error includes the task’s StopReason and LastFailureMessage when DMS reports them.

  • aws_conn_id – The Airflow connection used for AWS credentials. If this is None or empty then the default boto3 behaviour is used. If running Airflow in a distributed manner and aws_conn_id is None or empty, then default boto3 configuration would be used (and must be maintained on each worker node).

  • region_name – AWS region_name. If not specified then the default boto3 behaviour is used.

  • verify – Whether or not to verify SSL certificates. See: https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html

  • botocore_config – Configuration dictionary (key-values) for botocore client. See: https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html

aws_hook_class[source]
template_fields: collections.abc.Sequence[str][source]
replication_task_arn[source]
target_statuses: collections.abc.Iterable[str] = [][source]
termination_statuses: collections.abc.Iterable[str] = [][source]
poke(context)[source]

Override when deriving this class.

class airflow.providers.amazon.aws.sensors.dms.DmsTaskCompletedSensor(**kwargs)[source]

Bases: DmsTaskBaseSensor

Pokes DMS task until it is completed.

See also

For more information on how to use this sensor, take a look at the guide: Wait for a replication task to complete

Parameters:

Was this entry helpful?