`apache-airflow-providers-common-sql`¶

Content¶

Guides

References

Python API

Resources

Commits

Detailed list of commits

Package apache-airflow-providers-common-sql¶

Common SQL Provider

Release: 1.3.1

Provider package¶

This is a provider package for common.sql provider. All classes for this provider package are in airflow.providers.common.sql python package.

Installation¶

You can install this package on top of an existing Airflow 2 installation (see Requirements below) for the minimum Airflow version supported) via pip install apache-airflow-providers-common-sql

Requirements¶

PIP package	Version required
`sqlparse`	`>=0.4.2`

Changelog¶

1.3.1¶

This release fixes a few errors that were introduced in common.sql operator while refactoring common parts:

_process_output method in SQLExecuteQueryOperator has now consistent semantics and typing, it can also modify the returned (and stored in XCom) values in the operators that derive from the SQLExecuteQueryOperator).
descriptions of all returned results are stored as descriptions property in the DBApiHook
last description of the cursor whether to return single query results values are now exposed in DBApiHook via last_description property.

Lack of consistency in the operator caused 1.3.0 to be yanked - the 1.3.0 should not be used - if you have 1.3.0 installed, upgrade to 1.3.1.

Bug Fixes¶

Restore removed (but used) methods in common.sql (#27843)
Fix errors in Databricks SQL operator introduced when refactoring (#27854)
Bump common.sql provider to 1.3.1 (#27888)
Fixing the behaviours of SQL Hooks and Operators finally (#27912)

1.3.0¶

This release of provider is only available for Airflow 2.3+ as explained in the Apache Airflow providers support policy.

Misc¶

Move min airflow version to 2.3.0 for all providers (#27196)

Features¶

Add SQLExecuteQueryOperator (#25717)
Use DbApiHook.run for DbApiHook.get_records and DbApiHook.get_first (#26944)
DbApiHook consistent insert_rows logging (#26758)

Bug Fixes¶

Common sql bugfixes and improvements (#26761)
Use unused SQLCheckOperator.parameters in SQLCheckOperator.execute. (#27599)

1.2.0¶

Features¶

Make placeholder style configurable (#25939)
Better error message for pre-common-sql providers (#26051)

Bug Fixes¶

Fix (and test) SQLTableCheckOperator on postgresql (#25821)
Don't use Pandas for SQLTableCheckOperator (#25822)
Discard semicolon stripping in SQL hook (#25855)

1.1.0¶

Features¶

Improve taskflow type hints with ParamSpec (#25173)
Move all "old" SQL operators to common.sql providers (#25350)
Deprecate hql parameters and synchronize DBApiHook method APIs (#25299)
Unify DbApiHook.run() method with the methods which override it (#23971)
Common SQLCheckOperators Various Functionality Update (#25164)

Bug Fixes¶

Allow Legacy SqlSensor to use the common.sql providers (#25293)
Fix fetch_all_handler & db-api tests for it (#25430)
Align Common SQL provider logo location (#25538)
Fix SQL split string to include ';-less' statements (#25713)

1.0.0¶

Initial version of the provider. Adds SQLColumnCheckOperator and SQLTableCheckOperator. Moves DBApiHook, SQLSensor and ConnectorProtocol to the provider.