apache-airflow-providers-databricks

Package apache-airflow-providers-databricks

Databricks

Release: 2.2.0

Provider package

This is a provider package for databricks provider. All classes for this provider package are in airflow.providers.databricks python package.

Installation

You can install this package on top of an existing Airflow 2.1+ installation via pip install apache-airflow-providers-databricks

PIP requirements

PIP package

Version required

apache-airflow

>=2.1.0

requests

>=2.26.0, <3

Changelog

2.2.0

Features

  • Add 'wait_for_termination' argument for Databricks Operators (#20536)

  • Update connection object to ''cached_property'' in ''DatabricksHook'' (#20526)

  • Remove 'host' as an instance attr in 'DatabricksHook' (#20540)

  • Databricks: fix verification of Managed Identity (#20550)

2.1.0

Features

  • Databricks: add more methods to represent run state information (#19723)

  • Databricks - allow Azure SP authentication on other Azure clouds (#19722)

  • Databricks: allow to specify PAT in Password field (#19585)

  • Databricks jobs 2.1 (#19544)

  • Update Databricks API from 2.0 to 2.1 (#19412)

  • Authentication with AAD tokens in Databricks provider (#19335)

  • Update Databricks operators to match latest version of API 2.0 (#19443)

  • Remove db call from DatabricksHook.__init__() (#20180)

Bug Fixes

  • Fixup string concatenations (#19099)

  • Databricks hook: fix expiration time check (#20036)

2.0.2

Bug Fixes

  • Move DB call out of DatabricksHook.__init__ (#18339)

2.0.1

Misc

  • Optimise connection importing for Airflow 2.2.0

2.0.0

Breaking changes

  • Auto-apply apply_default decorator (#15667)

Warning

Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+. If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded automatically and you will have to manually run airflow upgrade db to complete the migration.

1.0.1

Updated documentation and readme files.

1.0.0

Initial version of the provider.

Was this entry helpful?