airflow.providers.google.cloud.utils.lineage¶

Attributes¶

log

Functions¶

send_hook_lineage_for_bq_job(context, job)

Send hook-level lineage for a BigQuery job to the lineage collector.

Module Contents¶

airflow.providers.google.cloud.utils.lineage.log[source]¶

airflow.providers.google.cloud.utils.lineage.send_hook_lineage_for_bq_job(context, job)[source]¶

Send hook-level lineage for a BigQuery job to the lineage collector.

Handles all four BigQuery job types: - QUERY: delegates to send_sql_hook_lineage for SQL parsing - LOAD: source URIs (GCS) as inputs, destination table as output - COPY: source tables as inputs, destination table as output - EXTRACT: source table as input, destination URIs (GCS) as outputs

Parameters:

context – The hook instance used as lineage context.
job – A BigQuery job object (QueryJob, LoadJob, CopyJob, or ExtractJob).