apache-airflow-providers-openlineage
Changelog¶
1.7.0¶
Features¶
Add lineage_job_namespace and lineage_job_name OpenLineage macros (#38829)openlineage: add 'opt-in' option (#37725)
Bug Fixes¶
fix: Remove redundant operator information from facets (#38264)fix: disabled_for_operators now stops whole event emission (#38033)fix: Add fallbacks when retrieving Airflow configuration to avoid errors being raised (#37994)fix: Fix parent id macro and remove unused utils (#37877)
Misc¶
Avoid use of 'assert' outside of the tests (#37718)Add default for 'task' on TaskInstance / fix attrs on TaskInstancePydantic (#37854)
1.6.0¶
Features¶
feat: Add OpenLineage metrics for event_size and extraction time (#37797)feat: Add OpenLineage support for File and User Airflow's lineage entities (#37744)[OpenLineage] Add support for JobTypeJobFacet properties. (#37255)chore: Update comments and logging in OpenLineage ExtractorManager (#37622)
Bug Fixes¶
fix: Check if operator is disabled in DefaultExtractor.extract_on_complete (#37392)
Misc¶
docs: Update whole OpenLineage Provider docs. (#37620)
1.3.0¶
Features¶
feat: Add parent_run_id for COMPLETE and FAIL events (#36067)Add basic metrics to stats collector. (#35368)
Bug Fixes¶
fix: Repair run_id for OpenLineage FAIL events (#36051)Fix and reapply templates for provider documentation (#35686)
Misc¶
Remove ClassVar annotations. (#36084)
1.1.0¶
Features¶
Allow to disable openlineage at operator level (#33685)
Bug Fixes¶
Fix import in 'get_custom_facets'. (#34122)
Misc¶
Improve modules import in Airflow providers by some of them into a type-checking block (#33754)Add OpenLineage support for DBT Cloud. (#33959)Refactor unneeded jumps in providers (#33833)Refactor: Replace lambdas with comprehensions in providers (#33771)
1.0.2¶
Bug Fixes¶
openlineage: don't run task instance listener in executor (#33366)openlineage: do not try to redact Proxy objects from deprecated config (#33393)openlineage: defensively check for provided datetimes in listener (#33343)
Misc¶
Add OpenLineage support for Trino. (#32910)Simplify conditions on len() in other providers (#33569)Replace repr() with proper formatting (#33520)
1.0.1¶
Bug Fixes¶
openlineage: disable running listener if not configured (#33120)Don't use database as fallback when no schema parsed. (#32959)
Misc¶
openlineage, bigquery: add openlineage method support for BigQueryExecuteQueryOperator (#31293)Move openlineage configuration to provider (#33124)
1.0.0¶
Initial version of the provider.