airflow.contrib.operators.s3_to_sftp_operator

Module Contents

class airflow.contrib.operators.s3_to_sftp_operator.S3ToSFTPOperator(s3_bucket, s3_key, sftp_path, sftp_conn_id='ssh_default', s3_conn_id='aws_default', *args, **kwargs)[source]

Bases: airflow.models.BaseOperator

This operator enables the transferring of files from S3 to a SFTP server.

Parameters

  • sftp_conn_id (str) – The sftp connection id. The name or identifier for establishing a connection to the SFTP server.

  • sftp_path (str) – The sftp remote path. This is the specified file path for uploading file to the SFTP server.

  • s3_conn_id (str) – The s3 connection id. The name or identifier for establishing a connection to S3

  • s3_bucket (str) – The targeted s3 bucket. This is the S3 bucket from where the file is downloaded.

  • s3_key (str) – The targeted s3 key. This is the specified file path for downloading the file from S3.

template_fields = ['s3_key', 'sftp_path'][source]
static get_s3_key(s3_key)[source]

This parses the correct format for S3 keys regardless of how the S3 url is passed.

execute(self, context)[source]

Was this entry helpful?