Azure: Microsoft Azure¶

Airflow has limited support for Microsoft Azure.

Some hooks are based on airflow.providers.microsoft.azure.hooks.base_azure which authenticate Azure's Python SDK Clients.

Services¶

These integrations allow you to perform various operations within the Microsoft Azure.

Microsoft Azure¶

Hooks: airflow.providers.microsoft.azure.hooks.base_azure.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure

Microsoft Azure Batch¶

Operators: airflow.providers.microsoft.azure.operators.batch, airflow.providers.microsoft.azure.operators.azure_batch.
Hooks: airflow.providers.microsoft.azure.hooks.batch, airflow.providers.microsoft.azure.hooks.azure_batch.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure Batch

Microsoft Azure Blob Storage¶

Operators: airflow.providers.microsoft.azure.operators.wasb_delete_blob.
Hooks: airflow.providers.microsoft.azure.hooks.wasb.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure Blob Storage

Microsoft Azure Container Instances¶

Operators: airflow.providers.microsoft.azure.operators.container_instances, airflow.providers.microsoft.azure.operators.azure_container_instances.
Hooks: airflow.providers.microsoft.azure.hooks.container_volume, airflow.providers.microsoft.azure.hooks.container_registry, airflow.providers.microsoft.azure.hooks.container_instance, airflow.providers.microsoft.azure.hooks.azure_container_volume, airflow.providers.microsoft.azure.hooks.azure_container_registry, airflow.providers.microsoft.azure.hooks.azure_container_instance.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure Container Instances

Microsoft Azure Cosmos DB¶

Operators: airflow.providers.microsoft.azure.operators.cosmos, airflow.providers.microsoft.azure.operators.azure_cosmos.
Hooks: airflow.providers.microsoft.azure.hooks.cosmos, airflow.providers.microsoft.azure.hooks.azure_cosmos.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure Cosmos DB

Microsoft Azure Data Explorer¶

Operators: airflow.providers.microsoft.azure.operators.adx.
Hooks: airflow.providers.microsoft.azure.hooks.adx.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure Data Explorer

Microsoft Azure Data Factory¶

Operators: airflow.providers.microsoft.azure.operators.data_factory.
Hooks: airflow.providers.microsoft.azure.hooks.data_factory, airflow.providers.microsoft.azure.hooks.azure_data_factory.
Guides: Azure Data Factory Operators.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure Data Factory

Microsoft Azure Data Lake Storage¶

Operators: airflow.providers.microsoft.azure.operators.adls_list, airflow.providers.microsoft.azure.operators.adls_delete, airflow.providers.microsoft.azure.operators.adls.
Hooks: airflow.providers.microsoft.azure.hooks.data_lake, airflow.providers.microsoft.azure.hooks.azure_data_lake.
Guides: Azure DataLake Storage Operators.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure Data Lake Storage

Microsoft Azure FileShare¶

Hooks: airflow.providers.microsoft.azure.hooks.fileshare, airflow.providers.microsoft.azure.hooks.azure_fileshare.
Provider: apache-airflow-providers-microsoft-azure
Product documentation: Microsoft Azure FileShare

Transfers¶

These integrations allow you to copy data from/to Microsoft Azure.

Microsoft Azure FileShare to Google Cloud Storage (GCS)¶

Source product documentation: Microsoft Azure FileShare
Target product documentation: Google Cloud Storage (GCS)
Operator guide: Transfers data from Azure FileShare Storage to Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.azure_fileshare_to_gcs
Provider: apache-airflow-providers-google

Microsoft Azure Data Lake Storage to Google Cloud Storage (GCS)¶

Source product documentation: Microsoft Azure Data Lake Storage
Target product documentation: Google Cloud Storage (GCS)
Python API: airflow.providers.google.cloud.transfers.adls_to_gcs
Provider: apache-airflow-providers-google

Local to Microsoft Azure Data Lake Storage¶

Target product documentation: Microsoft Azure Data Lake Storage
Operator guide: Upload data from Local Filesystem to Azure Data Lake
Python API: airflow.providers.microsoft.azure.transfers.local_to_adls
Provider: apache-airflow-providers-microsoft-azure

Oracle to Microsoft Azure Data Lake Storage¶

Source product documentation: Oracle
Target product documentation: Microsoft Azure Data Lake Storage
Python API: airflow.providers.microsoft.azure.transfers.oracle_to_azure_data_lake
Provider: apache-airflow-providers-microsoft-azure

Local to Microsoft Azure Blob Storage¶

Target product documentation: Microsoft Azure Blob Storage
Python API: airflow.providers.microsoft.azure.transfers.file_to_wasb
Provider: apache-airflow-providers-microsoft-azure

Local to Microsoft Azure Blob Storage¶

Target product documentation: Microsoft Azure Blob Storage
Python API: airflow.providers.microsoft.azure.transfers.local_to_wasb
Provider: apache-airflow-providers-microsoft-azure

Microsoft Azure Blob Storage to Google Cloud Storage (GCS)¶

Source product documentation: Microsoft Azure Blob Storage
Target product documentation: Google Cloud Storage (GCS)
Operator guide: Azure Blob Storage Transfer Operator
Python API: airflow.providers.microsoft.azure.transfers.azure_blob_to_gcs
Provider: apache-airflow-providers-microsoft-azure

SSH File Transfer Protocol (SFTP) to Microsoft Azure Blob Storage¶

Source product documentation: SSH File Transfer Protocol (SFTP)
Target product documentation: Microsoft Azure Blob Storage
Operator guide: Azure Blob Storage Transfer Operator
Python API: airflow.providers.microsoft.azure.transfers.sftp_to_wasb
Provider: apache-airflow-providers-microsoft-azure

Was this entry helpful?