Alibaba

apache-airflow-providers-alibaba

Alibaba Cloud integration (including Alibaba Cloud).

Works with Airflow 2.11+

Install:

pip install apache-airflow-providers-alibaba==3.3.5

Version:

Airflow

2.11+

Python

>=3.10

Dependencies (6)

Show all Hide

apache-airflow>=2.11.0 apache-airflow-providers-common-compat>=1.13.0 oss2>=2.14.0 alibabacloud_adb20211201>=1.0.0 alibabacloud_tea_openapi>=0.3.7 pyodps>=0.12.2.2

Connections (4)

Modules

OSSCreateBucketOperator

This operator creates an OSS bucket.

airflow.providers.alibaba.cloud.operators.oss.OSSCreateBucketOperator

View Docs Source

OSSDeleteBatchObjectOperator

This operator to delete OSS objects.

airflow.providers.alibaba.cloud.operators.oss.OSSDeleteBatchObjectOperator

View Docs Source

OSSDeleteBucketOperator

This operator to delete an OSS bucket.

airflow.providers.alibaba.cloud.operators.oss.OSSDeleteBucketOperator

View Docs Source

OSSDeleteObjectOperator

This operator to delete an OSS object.

airflow.providers.alibaba.cloud.operators.oss.OSSDeleteObjectOperator

View Docs Source

OSSDownloadObjectOperator

This operator to Download an OSS object.

airflow.providers.alibaba.cloud.operators.oss.OSSDownloadObjectOperator

View Docs Source

OSSUploadObjectOperator

This operator to upload an file-like object.

airflow.providers.alibaba.cloud.operators.oss.OSSUploadObjectOperator

View Docs Source

AnalyticDBSparkBaseOperator

Abstract base class that defines how users develop AnalyticDB Spark.

airflow.providers.alibaba.cloud.operators.analyticdb_spark.AnalyticDBSparkBaseOperator

View Docs Source

AnalyticDBSparkBatchOperator

Submits a Spark batch application to the underlying cluster; wraps the AnalyticDB Spark REST API.

airflow.providers.alibaba.cloud.operators.analyticdb_spark.AnalyticDBSparkBatchOperator

View Docs Source

AnalyticDBSparkSQLOperator

Submits a Spark SQL application to the underlying cluster; wraps the AnalyticDB Spark REST API.

airflow.providers.alibaba.cloud.operators.analyticdb_spark.AnalyticDBSparkSQLOperator

View Docs Source

MaxComputeSQLOperator

Executes an SQL statement in MaxCompute.

airflow.providers.alibaba.cloud.operators.maxcompute.MaxComputeSQLOperator

View Docs Source

OSSHook

Interact with Alibaba Cloud OSS, using the oss2 library.

airflow.providers.alibaba.cloud.hooks.oss.OSSHook

View Docs Source

AlibabaBaseHook

A base hook for Alibaba Cloud-related hooks.

airflow.providers.alibaba.cloud.hooks.base_alibaba.AlibabaBaseHook

View Docs Source

AnalyticDBSparkHook

Hook for AnalyticDB MySQL Spark through the REST API.

airflow.providers.alibaba.cloud.hooks.analyticdb_spark.AnalyticDBSparkHook

View Docs Source

MaxComputeHook

Interact with Alibaba MaxCompute (previously known as ODPS).

airflow.providers.alibaba.cloud.hooks.maxcompute.MaxComputeHook

View Docs Source

OSSKeySensor

Waits for a key (a file-like instance on OSS) to be present in an OSS bucket.

airflow.providers.alibaba.cloud.sensors.oss_key.OSSKeySensor

View Docs Source

AnalyticDBSparkSensor

Monitor a AnalyticDB Spark session for termination.

airflow.providers.alibaba.cloud.sensors.analyticdb_spark.AnalyticDBSparkSensor

View Docs Source

OSSTaskHandler

OSSTaskHandler is a python log handler that handles and reads task instance logs.

airflow.providers.alibaba.cloud.log.oss_task_handler.OSSTaskHandler

View Docs Source