airflow.providers.airbyte.operators.airbyte

Module Contents

class airflow.providers.airbyte.operators.airbyte.AirbyteTriggerSyncOperator(connection_id: str, airbyte_conn_id: str = 'airbyte_default', asynchronous: Optional[bool] = False, api_version: Optional[str] = 'v1', wait_seconds: Optional[float] = 3, timeout: Optional[float] = 3600, **kwargs)[source]

Bases: airflow.models.BaseOperator

This operator allows you to submit a job to an Airbyte server to run a integration process between your source and destination.

See also

For more information on how to use this operator, take a look at the guide: AirbyteTriggerSyncOperator

Parameters

  • airbyte_conn_id (str) -- Required. The name of the Airflow connection to get connection information for Airbyte.

  • connection_id (str) -- Required. The Airbyte ConnectionId UUID between a source and destination.

  • asynchronous (bool) -- Optional. Flag to get job_id after submitting the job to the Airbyte API. This is useful for submitting long running jobs and waiting on them asynchronously using the AirbyteJobSensor.

  • api_version (str) -- Optional. Airbyte API version.

  • wait_seconds (float) -- Optional. Number of seconds between checks. Only used when asynchronous is False.

  • timeout (float) -- Optional. The amount of time, in seconds, to wait for the request to complete. Only used when asynchronous is False.

template_fields = ['connection_id'][source]
execute(self, context)[source]

Create Airbyte Job and wait to finish

Was this entry helpful?