airflow.providers.airbyte.operators.airbyte

Module Contents

Classes

AirbyteTriggerSyncOperator

This operator allows you to submit a job to an Airbyte server to run a integration

class airflow.providers.airbyte.operators.airbyte.AirbyteTriggerSyncOperator(connection_id, airbyte_conn_id='airbyte_default', asynchronous=False, api_version='v1', wait_seconds=3, timeout=3600, **kwargs)[source]

Bases: airflow.models.BaseOperator

This operator allows you to submit a job to an Airbyte server to run a integration process between your source and destination.

See also

For more information on how to use this operator, take a look at the guide: AirbyteTriggerSyncOperator

Parameters
  • airbyte_conn_id (str) -- Required. The name of the Airflow connection to get connection information for Airbyte.

  • connection_id (str) -- Required. The Airbyte ConnectionId UUID between a source and destination.

  • asynchronous (Optional[bool]) -- Optional. Flag to get job_id after submitting the job to the Airbyte API. This is useful for submitting long running jobs and waiting on them asynchronously using the AirbyteJobSensor.

  • api_version (str) -- Optional. Airbyte API version.

  • wait_seconds (float) -- Optional. Number of seconds between checks. Only used when asynchronous is False.

  • timeout (Optional[float]) -- Optional. The amount of time, in seconds, to wait for the request to complete. Only used when asynchronous is False.

template_fields :Sequence[str] = ['connection_id'][source]
execute(self, context)[source]

Create Airbyte Job and wait to finish

Was this entry helpful?