airflow.providers.dbt.cloud.utils.openlineage¶
Module Contents¶
Functions¶
Generate OpenLineage events from the DBT Cloud run. |
- airflow.providers.dbt.cloud.utils.openlineage.generate_openlineage_events_from_dbt_cloud_run(operator, task_instance)[source]¶
Generate OpenLineage events from the DBT Cloud run.
This function retrieves information about a DBT Cloud run, including the associated job, project, and execution details. It processes the run’s artifacts, such as the manifest and run results, in parallel for many steps. Then it generates and emits OpenLineage events based on the executed DBT tasks.
- Parameters
operator (airflow.providers.dbt.cloud.operators.dbt.DbtCloudRunJobOperator | airflow.providers.dbt.cloud.sensors.dbt.DbtCloudJobRunSensor) – Instance of DBT Cloud operator that executed DBT tasks. It already should have run_id and dbt cloud hook.
task_instance (airflow.models.taskinstance.TaskInstance) – Currently executed task instance
- Returns
An empty OperatorLineage object indicating the completion of events generation.
- Return type
airflow.providers.openlineage.extractors.OperatorLineage