Microsoft Azure Batch Connection

The Microsoft Azure Batch connection type enables the Azure Batch Integrations.

Authenticating to Azure Batch

There is one way to connect to Azure Batch using Airflow.

  1. Use Azure Shared Key Credential i.e. add shared key credentials to the Airflow connection.

Default Connection IDs

All hooks and operators related to Microsoft Azure Batch use azure_batch_default by default.

Configuring the Connection

Login

Specify the Azure Batch Account Name used for the initial connection.

Password

Specify the Azure Batch Key used for the initial connection.

Extra

Specify the extra parameters (as json dictionary) that can be used in Azure Batch connection. The following parameters are all optional:

  • account_url: Specify the batch account url you would like to use.

When specifying the connection in environment variable you should specify it using URI syntax.

Note that all components of the URI should be URL-encoded.

For example:

export AIRFLOW_CONN_AZURE_BATCH_DEFAULT='azure-batch://batch%20acount:batch%20key@?account_url=mybatchaccount.com'

Was this entry helpful?