airflow.providers.amazon.aws.transfers.base

This module contains base AWS to AWS transfer operator.

Module Contents

Classes

AwsToAwsBaseOperator

Base class for AWS to AWS transfer operators.
class airflow.providers.amazon.aws.transfers.base.AwsToAwsBaseOperator(*, source_aws_conn_id=AwsBaseHook.default_conn_name, dest_aws_conn_id=NOTSET, aws_conn_id=NOTSET, **kwargs)[source]

Bases: airflow.models.BaseOperator

Base class for AWS to AWS transfer operators.

Parameters

  • source_aws_conn_id (str | None) – The Airflow connection used for AWS credentials to access DynamoDB. If this is None or empty then the default boto3 behaviour is used. If running Airflow in a distributed manner and source_aws_conn_id is None or empty, then default boto3 configuration would be used (and must be maintained on each worker node).

  • dest_aws_conn_id (str | None | airflow.utils.types.ArgNotSet) – The Airflow connection used for AWS credentials to access S3. If this is not set then the source_aws_conn_id connection is used.

  • aws_conn_id (str | None | airflow.utils.types.ArgNotSet) – The Airflow connection used for AWS credentials (deprecated; use source_aws_conn_id).

template_fields: Sequence[str] = ('source_aws_conn_id', 'dest_aws_conn_id')[source]

Was this entry helpful?