apache-airflow-providers-elasticsearch
¶
Provider package¶
This is a provider package for elasticsearch
provider. All classes for this provider package
are in airflow.providers.elasticsearch
python package.
Installation¶
You can install this package on top of an existing Airflow 2.1+ installation via
pip install apache-airflow-providers-elasticsearch
PIP requirements¶
PIP package |
Version required |
---|---|
|
|
|
|
|
|
|
|
Changelog¶
3.0.2¶
Bug Fixes¶
Fix mistakenly added install_requires for all providers (#22382)
Fix "run_id" k8s and elasticsearch compatibility with Airflow 2.1 (#22385)
3.0.0¶
Breaking changes¶
Change default log filename template to include map_index (#21495)
Misc¶
Support for Python 3.10
2.2.0¶
Features¶
Emit "logs not found" message when ES logs appear to be missing (#21261)
Use compat data interval shim in log handlers (#21289)
Misc¶
Clarify ElasticsearchTaskHandler docstring (#21255)
2.0.3¶
Bug Fixes¶
Fix Invalid log order in ElasticsearchTaskHandler (#17551)
Misc¶
Optimise connection importing for Airflow 2.2.0
Adds secrets backend/logging/auth information to provider yaml (#17625)
2.0.1¶
Breaking changes¶
Auto-apply apply_default decorator (#15667)
Remove support Jinja templated log_id in Elasticsearch (#16465)
While undocumented, previously
[elasticsearch] log_id
supported a Jinja templated string. Support for Jinja templates has now been removed.log_id
should be a template string instead, for example:{dag_id}-{task_id}-{execution_date}-{try_number}
.If you used a Jinja template previously, the
execution_date
on your Elasticsearch documents will need to be updated to the new format.
Warning
Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run airflow upgrade db
to complete the migration.
Features¶
Support remote logging in elasticsearch with filebeat 7 (#14625)
Support non-https elasticsearch external links (#16489)
Bug fixes¶
Fix external elasticsearch logs link (#16357)
Fix Elasticsearch external log link with ''json_format'' (#16467)
1.0.4¶
Bug fixes¶
Fix 'logging.exception' redundancy (#14823)
Fix exception caused by missing keys in the ElasticSearch Record (#15163)
1.0.1¶
Updated documentation and readme files.
Bug fixes¶
Respect LogFormat when using ES logging with Json Format (#13310)
1.0.0¶
Initial version of the provider.