airflow.providers.airbyte.hooks.airbyte

Module Contents

Classes

AirbyteHook

Hook for Airbyte API
class airflow.providers.airbyte.hooks.airbyte.AirbyteHook(airbyte_conn_id='airbyte_default', api_version='v1')[source]

Bases: airflow.providers.http.hooks.http.HttpHook

Hook for Airbyte API

Parameters

  • airbyte_conn_id (str) -- Required. The name of the Airflow connection to get connection information for Airbyte.

  • api_version (str) -- Optional. Airbyte API version.

conn_name_attr = airbyte_conn_id[source]
default_conn_name = airbyte_default[source]
conn_type = airbyte[source]
hook_name = Airbyte[source]
RUNNING = running[source]
SUCCEEDED = succeeded[source]
CANCELLED = cancelled[source]
PENDING = pending[source]
FAILED = failed[source]
ERROR = error[source]
INCOMPLETE = incomplete[source]
wait_for_job(self, job_id, wait_seconds=3, timeout=3600)[source]

Helper method which polls a job to check if it finishes.

Parameters

  • job_id (Union[str, int]) -- Required. Id of the Airbyte job

  • wait_seconds (float) -- Optional. Number of seconds between checks.

  • timeout (Optional[float]) -- Optional. How many seconds wait for job to be ready. Used only if asynchronous is False.

submit_sync_connection(self, connection_id)[source]

Submits a job to a Airbyte server.

Parameters

connection_id (str) -- Required. The ConnectionId of the Airbyte Connection.

get_job(self, job_id)[source]

Gets the resource representation for a job in Airbyte.

Parameters

job_id (int) -- Required. Id of the Airbyte job

test_connection(self)[source]

Tests the Airbyte connection by hitting the health API

Was this entry helpful?