This is a provider package for
elasticsearch provider. All classes for this provider package
airflow.providers.elasticsearch python package.
You can install this package on top of an existing Airflow 2 installation (see
for the minimum Airflow version supported) via
pip install apache-airflow-providers-elasticsearch
This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
Apply per-run log templates to log handlers (#24153)
Fix mistakenly added install_requires for all providers (#22382)
Fix "run_id" k8s and elasticsearch compatibility with Airflow 2.1 (#22385)
Change default log filename template to include map_index (#21495)
Support for Python 3.10
Emit "logs not found" message when ES logs appear to be missing (#21261)
Use compat data interval shim in log handlers (#21289)
Clarify ElasticsearchTaskHandler docstring (#21255)
Fix Invalid log order in ElasticsearchTaskHandler (#17551)
Optimise connection importing for Airflow 2.2.0
Adds secrets backend/logging/auth information to provider yaml (#17625)
Auto-apply apply_default decorator (#15667)
Remove support Jinja templated log_id in Elasticsearch (#16465)
While undocumented, previously
[elasticsearch] log_idsupported a Jinja templated string. Support for Jinja templates has now been removed.
log_idshould be a template string instead, for example:
If you used a Jinja template previously, the
execution_dateon your Elasticsearch documents will need to be updated to the new format.
Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run
airflow upgrade db to complete the migration.
Support remote logging in elasticsearch with filebeat 7 (#14625)
Support non-https elasticsearch external links (#16489)
Fix external elasticsearch logs link (#16357)
Fix Elasticsearch external log link with ''json_format'' (#16467)
Fix 'logging.exception' redundancy (#14823)
Fix exception caused by missing keys in the ElasticSearch Record (#15163)
Updated documentation and readme files.
Respect LogFormat when using ES logging with Json Format (#13310)
Initial version of the provider.