This is a provider package for
elasticsearch provider. All classes for this provider package
airflow.providers.elasticsearch python package.
You can install this package on top of an existing Airflow 2 installation (see
for the minimum Airflow version supported) via
pip install apache-airflow-providers-elasticsearch
Cross provider package dependencies¶
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-providers-elasticsearch[common.sql]
Downloading official packages¶
You can download officially released packages and verify their checksums and signatures from the Official Apache Download site
This release of provider is only available for Airflow 2.3+ as explained in the Apache Airflow providers support policy.
Move min airflow version to 2.3.0 for all providers (#27196)
Adding ElasticserachPythonHook - ES Hook With The Python Client (#24895)
Move all SQL classes to common-sql provider (#24836)
Move fallible ti.task.dag assignment back inside try/except block (#24533) (#24592)
This release of provider is only available for Airflow 2.2+ as explained in the Apache Airflow providers support policy https://github.com/apache/airflow/blob/main/README.md#support-for-providers
Apply per-run log templates to log handlers (#24153)
Fix mistakenly added install_requires for all providers (#22382)
Fix "run_id" k8s and elasticsearch compatibility with Airflow 2.1 (#22385)
Change default log filename template to include map_index (#21495)
Support for Python 3.10
Emit "logs not found" message when ES logs appear to be missing (#21261)
Use compat data interval shim in log handlers (#21289)
Clarify ElasticsearchTaskHandler docstring (#21255)
Fix Invalid log order in ElasticsearchTaskHandler (#17551)
Optimise connection importing for Airflow 2.2.0
Adds secrets backend/logging/auth information to provider yaml (#17625)
Auto-apply apply_default decorator (#15667)
Remove support Jinja templated log_id in Elasticsearch (#16465)
While undocumented, previously
[elasticsearch] log_idsupported a Jinja templated string. Support for Jinja templates has now been removed.
log_idshould be a template string instead, for example:
If you used a Jinja template previously, the
execution_dateon your Elasticsearch documents will need to be updated to the new format.
Due to apply_default decorator removal, this version of the provider requires Airflow 2.1.0+.
If your Airflow version is < 2.1.0, and you want to install this provider version, first upgrade
Airflow to at least version 2.1.0. Otherwise your Airflow package version will be upgraded
automatically and you will have to manually run
airflow upgrade db to complete the migration.
Support remote logging in elasticsearch with filebeat 7 (#14625)
Support non-https elasticsearch external links (#16489)
Fix external elasticsearch logs link (#16357)
Fix Elasticsearch external log link with ''json_format'' (#16467)
Fix 'logging.exception' redundancy (#14823)
Fix exception caused by missing keys in the ElasticSearch Record (#15163)
Updated documentation and readme files.
Respect LogFormat when using ES logging with Json Format (#13310)
Initial version of the provider.