tests.system.teradata.example_s3_to_teradata_transfer

Example Airflow DAG to show usage of S3StorageToTeradataOperator.

The transfer operator moves files in CSV, JSON, and PARQUET formats from S3 to Teradata tables. In the example Directed Acyclic Graph (DAG) below, it assumes Airflow Connections with the IDs teradata_default and aws_default already exist. The DAG creates tables using data from the S3, reports the number of rows inserted into the table, and subsequently drops the table.

Module Contents

tests.system.teradata.example_s3_to_teradata_transfer.ENV_ID[source]
tests.system.teradata.example_s3_to_teradata_transfer.DAG_ID = 'example_s3_to_teradata_transfer_operator'[source]
tests.system.teradata.example_s3_to_teradata_transfer.CONN_ID = 'teradata_default'[source]
tests.system.teradata.example_s3_to_teradata_transfer.transfer_data_csv[source]
tests.system.teradata.example_s3_to_teradata_transfer.test_run[source]

Was this entry helpful?