airflow.sensors.sql

Module Contents

Classes

SqlSensor

Runs a sql statement repeatedly until a criteria is met. It will keep trying until
class airflow.sensors.sql.SqlSensor(*, conn_id, sql, parameters=None, success=None, failure=None, fail_on_empty=False, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Runs a sql statement repeatedly until a criteria is met. It will keep trying until success or failure criteria are met, or if the first cell is not in (0, ‘0’, ‘’, None). Optional success and failure callables are called with the first cell returned as the argument. If success callable is defined the sensor will keep retrying until the criteria is met. If failure callable is defined and the criteria is met the sensor will raise AirflowException. Failure criteria is evaluated before success criteria. A fail_on_empty boolean can also be passed to the sensor in which case it will fail if no rows have been returned

Parameters

  • conn_id (str) – The connection to run the sensor against

  • sql (str) – The sql to run. To pass, it needs to return at least one cell that contains a non-zero / empty string value.

  • parameters (dict or iterable) – The parameters to render the SQL query with (optional).

  • success (Optional<Callable[[Any], bool]>) – Success criteria for the sensor is a Callable that takes first_cell as the only argument, and returns a boolean (optional).

  • failure (Optional<Callable[[Any], bool]>) – Failure criteria for the sensor is a Callable that takes first_cell as the only argument and return a boolean (optional).

  • fail_on_empty (bool) – Explicitly fail on no rows returned.

template_fields :Iterable[str] = ['sql'][source]
template_ext :Iterable[str] = ['.hql', '.sql'][source]
ui_color = #7c7287[source]
poke(self, context)[source]

Function that the sensors defined while deriving this class should override.

Was this entry helpful?