Content¶
References
Commits
apache-airflow-providers-docker¶
Provider package¶
This is a provider package for docker provider. All classes for this provider package
are in airflow.providers.docker python package.
Installation¶
You can install this package on top of an existing Airflow 2 installation (see Requirements below)
for the minimum Airflow version supported) via
pip install apache-airflow-providers-docker
Requirements¶
The minimum Apache Airflow version supported by this provider package is 2.4.0.
PIP package |
Version required |
|---|---|
|
|
|
|
|
|
Changelog¶
3.7.0¶
Note
This release of provider is only available for Airflow 2.4+ as explained in the Apache Airflow providers support policy.
Misc¶
Bump minimum Airflow version in providers (#30917)
3.6.0¶
Features¶
Add multiple exit code handling in skip logic for 'DockerOperator' and 'KubernetesPodOperator' (#30769)In 'DockerOperator', adding an attribute 'tls_verify' to choose whether to validate certificate (#30309) (#30310)
Misc¶
Deprecate 'skip_exit_code' in 'DockerOperator' and 'KubernetesPodOperator' (#30733)
3.5.0¶
Features¶
Add correct widgets in Docker Hook (#28700)Make docker operators always use 'DockerHook' for API calls (#28363)Skip DockerOperator task when it returns a provided exit code (#28996)
Bug Fixes¶
Fix label name for 'reauth' field in Docker Connection (#28974)
3.4.0¶
Features¶
add hostname argument to DockerOperator (#27822)Move min airflow version down for Docker Provider to 2.3.0 (#28648)
3.3.0¶
Note
This release of provider is only available for Airflow 2.3+ as explained in the Apache Airflow providers support policy.
Misc¶
Move min airflow version to 2.3.0 for all providers (#27196)
Features¶
Add ipc_mode for DockerOperator (#27553)Add env-file parameter to Docker Operator (#26951)
3.2.0¶
Features¶
Add logging options to docker operator (#26653)Add pre-commit hook for custom_operator_name (#25786)Implement ExternalPythonOperator (#25780)
Bug Fixes¶
3.1.0¶
Features¶
Force-remove container after DockerOperator execution (#23160)
Bug Fixes¶
'DockerOperator' fix cli.logs giving character array instead of string (#24726)
3.0.0¶
Breaking changes¶
Note
This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy.
Misc¶
Remove 'xcom_push' from 'DockerOperator' (#23981)docker new system test (#23167)
2.7.0¶
Features¶
Add 'device_requests' parameter to 'DockerOperator' (#23554)
Bug Fixes¶
Fix new MyPy errors in main (#22884)
2.5.2¶
Bug Fixes¶
Fix mistakenly added install_requires for all providers (#22382)
Misc¶
Correct 'multiple_outputs' param descriptions mentioning lists/tuples (#22371)
2.5.1¶
Bug Fixes¶
Avoid trying to kill container when it did not succeed for Docker (#22145)
Misc¶
Add Trove classifiers in PyPI (Framework :: Apache Airflow :: Provider)
2.4.1¶
Bug Fixes¶
Fixes Docker xcom functionality (#21175)Fix docker behaviour with byte lines returned (#21429)
2.3.0¶
Features¶
Add support of placement in the DockerSwarmOperator (#18990)
Bug Fixes¶
Fixup string concatenations (#19099)Remove the docker timeout workaround (#18872)
Other¶
Move docker decorator example dag to docker provider (#18739)
2.2.0¶
Features¶
Add a Docker Taskflow decorator (#15330)
This version of Docker Provider has a new feature - TaskFlow decorator that only works in Airflow 2.2. If you try to use the decorator in pre-Airflow 2.2 version you will get an error:
AttributeError: '_TaskDecorator' object has no attribute 'docker'
2.1.1¶
Features¶
Add support for configs, secrets, networks and replicas for DockerSwarmOperator (#17474)
Misc¶
Optimise connection importing for Airflow 2.2.0
2.1.0¶
Features¶
Adds option to disable mounting temporary folder in DockerOperator (#16932)
Bug Fixes¶
[FIX] Docker provider - retry docker in docker (#17061)fix string encoding when using xcom / json (#13536)if
xcom_allis set toFalse, only the last line of the log (separated by\n) will be included in the XCom value
The DockerOperator in version 2.0.0 did not work for remote Docker Engine or Docker-In-Docker case.
That was an unintended side effect of #15843 that has been fixed in #16932. There is a fallback mode
which will make Docker Operator works with warning and you will be able to remove the warning by
using the new parameter to disable mounting the folder.
2.0.0¶
Breaking changes¶
Auto-apply apply_default decorator (#15667)
Warning
Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run airflow upgrade db to complete the migration.
Replace DockerOperator's 'volumes' arg for 'mounts' (#15843)
The volumes parameter in
airflow.providers.docker.operators.docker.DockerOperator and
airflow.providers.docker.operators.docker_swarm.DockerSwarmOperator
was replaced by the mounts parameter, which uses the newer
mount syntax instead of --bind.
1.2.0¶
Features¶
Entrypoint support in docker operator (#14642)Add PythonVirtualenvDecorator to Taskflow API (#14761)Support all terminus task states in Docker Swarm Operator (#14960)
1.0.1¶
Updated documentation and readme files.
Bug fixes¶
Remove failed DockerOperator tasks with auto_remove=True (#13532) (#13993)Fix error on DockerSwarmOperator with auto_remove True (#13532) (#13852)
1.0.0¶
Initial version of the provider.