tests.system.openlineage.example_openlineage_manual_lineage_dag

DAG exercising the public OpenLineage manual lineage API: emit_dataset_lineage and emit_query_lineage.

It checks:

  • emit_dataset_lineage produces a RUNNING event with inputs/outputs

  • emit_dataset_lineage accepts additional_run_facets and additional_job_facets

  • datasets can carry dataset-level facets (DataQualityAssertionsDatasetFacet)

  • emit_query_lineage produces a START + COMPLETE event pair

  • query_text attaches a sql job facet

  • query_id + query_source_namespace attaches external query run facet

  • multiple emit_query_lineage calls increment the job name counter (.1, .2, .3)

  • failed query (is_successful=False) produces a FAIL event with error message run facet

  • counter resets to .1 in a new task (no cross-task spill)

  • explicit job_name= bypasses the counter

  • explicit task_instance= bypasses context resolution inside the helper

Attributes

DAG_ID

test_run

Functions

openlineage_manual_lineage_dag()

Module Contents

tests.system.openlineage.example_openlineage_manual_lineage_dag.DAG_ID = 'openlineage_manual_lineage_dag'[source]
tests.system.openlineage.example_openlineage_manual_lineage_dag.openlineage_manual_lineage_dag()[source]
tests.system.openlineage.example_openlineage_manual_lineage_dag.test_run[source]

Was this entry helpful?