Alibaba Cloud OSS Operators¶

Overview¶

Airflow to Alibaba Cloud Object Storage Service (OSS) integration provides several operators to create and interact with OSS buckets.

OSSKeySensor

OSSCreateBucketOperator

OSSDeleteBucketOperator

OSSUploadObjectOperator

OSSDownloadObjectOperator

OSSDeleteBatchObjectOperator

OSSDeleteObjectOperator

Create and Delete Alibaba Cloud OSS Buckets¶

Purpose¶

This example dag uses OSSCreateBucketOperator and OSSDeleteBucketOperator to create a new OSS bucket with a given bucket name then delete it.

Defining tasks¶

In the following code we create a new bucket and then delete the bucket.

airflow/providers/alibaba/cloud/example_dags/example_oss_bucket.py[source]

with DAG(
    dag_id='oss_bucket_dag',
    start_date=datetime(2021, 1, 1),
    default_args={'bucket_name': 'your bucket', 'region': 'your region'},
    max_active_runs=1,
    tags=['example'],
    catchup=False,
) as dag:

    create_bucket = OSSCreateBucketOperator(task_id='task1')

    delete_bucket = OSSDeleteBucketOperator(task_id='task2')

    create_bucket >> delete_bucket