Alibaba

apache-airflow-providers-alibaba

Alibaba Cloud integration (including Alibaba Cloud).

Works with Airflow 2.11+

Install:

pip install apache-airflow-providers-alibaba==3.3.7

Version:

Airflow

2.11+

Python

>=3.10

Dependencies (7)

Show all Hide

apache-airflow>=2.11.0 apache-airflow-providers-common-compat>=1.13.0 alibabacloud-oss-v2>=1.2.0 alibabacloud_adb20211201>=1.0.0 alibabacloud_tea_openapi>=0.3.7 pyodps>=0.12.2.2; python_version < '3.13' pyodps>=0.12.5.1; python_version >= '3.13'

Connections (4)

Modules

O

OSSCreateBucketOperator

This operator creates an OSS bucket.

airflow.providers.alibaba.cloud.operators.oss.OSSCreateBucketOperator

View Docs Source

O

OSSDeleteBatchObjectOperator

This operator to delete OSS objects.

airflow.providers.alibaba.cloud.operators.oss.OSSDeleteBatchObjectOperator

View Docs Source

O

OSSDeleteBucketOperator

This operator to delete an OSS bucket.

airflow.providers.alibaba.cloud.operators.oss.OSSDeleteBucketOperator

View Docs Source

O

OSSDeleteObjectOperator

This operator to delete an OSS object.

airflow.providers.alibaba.cloud.operators.oss.OSSDeleteObjectOperator

View Docs Source

O

OSSDownloadObjectOperator

This operator to Download an OSS object.

airflow.providers.alibaba.cloud.operators.oss.OSSDownloadObjectOperator

View Docs Source

O

OSSUploadObjectOperator

This operator to upload an file-like object.

airflow.providers.alibaba.cloud.operators.oss.OSSUploadObjectOperator

View Docs Source

O

AnalyticDBSparkBaseOperator

Abstract base class that defines how users develop AnalyticDB Spark.

airflow.providers.alibaba.cloud.operators.analyticdb_spark.AnalyticDBSparkBaseOperator

View Docs Source

O

AnalyticDBSparkBatchOperator

Submits a Spark batch application to the underlying cluster; wraps the AnalyticDB Spark REST API.

airflow.providers.alibaba.cloud.operators.analyticdb_spark.AnalyticDBSparkBatchOperator

View Docs Source

O

AnalyticDBSparkSQLOperator

Submits a Spark SQL application to the underlying cluster; wraps the AnalyticDB Spark REST API.

airflow.providers.alibaba.cloud.operators.analyticdb_spark.AnalyticDBSparkSQLOperator

View Docs Source

O

MaxComputeSQLOperator

Executes an SQL statement in MaxCompute.

airflow.providers.alibaba.cloud.operators.maxcompute.MaxComputeSQLOperator

View Docs Source

H

OSSHook

Interact with Alibaba Cloud OSS, using the Alibaba Cloud OSS SDK v2.

airflow.providers.alibaba.cloud.hooks.oss.OSSHook

View Docs Source

H

AlibabaBaseHook

A base hook for Alibaba Cloud-related hooks.

airflow.providers.alibaba.cloud.hooks.base_alibaba.AlibabaBaseHook

View Docs Source

H

AnalyticDBSparkHook

Hook for AnalyticDB MySQL Spark through the REST API.

airflow.providers.alibaba.cloud.hooks.analyticdb_spark.AnalyticDBSparkHook

View Docs Source

H

MaxComputeHook

Interact with Alibaba MaxCompute (previously known as ODPS).

airflow.providers.alibaba.cloud.hooks.maxcompute.MaxComputeHook

View Docs Source

S

OSSKeySensor

Waits for a key (a file-like instance on OSS) to be present in an OSS bucket.

airflow.providers.alibaba.cloud.sensors.oss_key.OSSKeySensor

View Docs Source

S

AnalyticDBSparkSensor

Monitor a AnalyticDB Spark session for termination.

airflow.providers.alibaba.cloud.sensors.analyticdb_spark.AnalyticDBSparkSensor

View Docs Source

L

OSSTaskHandler

OSSTaskHandler is a python log handler that handles and reads task instance logs.

airflow.providers.alibaba.cloud.log.oss_task_handler.OSSTaskHandler

View Docs Source