airflow.providers.airbyte.triggers.airbyte¶

Classes¶

AirbyteSyncTrigger

Triggers Airbyte Sync, makes an asynchronous HTTP call to get the status via a job ID.

Module Contents¶

class airflow.providers.airbyte.triggers.airbyte.AirbyteSyncTrigger(job_id, conn_id, end_time, poll_interval, execution_deadline=None)[source]¶

Bases: airflow.triggers.base.BaseTrigger

Triggers Airbyte Sync, makes an asynchronous HTTP call to get the status via a job ID.

This trigger is designed to initiate and monitor the status of Airbyte Sync jobs. It makes use of asynchronous communication to check the progress of a job run over time.

Parameters:

conn_id (str) – The connection identifier for connecting to Airbyte.
job_id (int) – The ID of an Airbyte Sync job.
end_time (float) – Absolute timestamp (in seconds since the epoch) by which the job run must reach terminal status. Defaults to 7 days from the trigger start time.
poll_interval (float) – polling period in seconds to check for the status.
execution_deadline (float | None) – Optional absolute timestamp (in seconds since the epoch) after which the task is considered timed out.

job_id[source]¶

conn_id[source]¶

end_time[source]¶

execution_deadline = None[source]¶

poll_interval[source]¶

serialize()[source]¶

Serialize AirbyteSyncTrigger arguments and classpath.

async run()[source]¶

Make async connection to Airbyte, polls for the pipeline run status.

async is_still_running(hook)[source]¶

Async function to check whether the job is submitted via async API.

If job is in running state returns True if it is still running else return False