Amazon S3 to SFTP¶

Use the S3ToSFTPOperator transfer to copy the data from an Amazon Simple Storage Service (S3) file into a remote file using SFTP protocol. For more information about the service visits Amazon Transfer for SFTP API documentation.

Prerequisite Tasks¶

To use these operators, you must do a few things:

Create necessary resources using AWS Console or AWS CLI.
Install API libraries via pip.
pip install 'apache-airflow[amazon]'
Detailed information is available Installation of Airflow®
Setup Connection.

Operators¶

Amazon S3 To SFTP transfer operator¶

This operator loads data from Amazon S3 to a SFTP server.

To get more information about this operator visit: S3ToSFTPOperator

Example usage:

tests/system/amazon/aws/example_s3_to_sftp.py

create_s3_to_sftp_job = S3ToSFTPOperator(
    task_id="create_s3_to_sftp_job",
    sftp_path="sftp_path",
    s3_bucket=s3_bucket,
    s3_key=s3_key,
)

Reference¶

AWS boto3 library documentation for Amazon S3