airflow.providers.apache.livy.sensors.livy

This module contains the Apache Livy sensor.

Module Contents

class airflow.providers.apache.livy.sensors.livy.LivySensor(*, batch_id: Union[int, str], livy_conn_id: str = 'livy_default', extra_options: Optional[Dict[str, Any]] = None, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Monitor a Livy sessions for termination.

Parameters
  • livy_conn_id (str) -- reference to a pre-defined Livy connection

  • batch_id (Union[int, str]) -- identifier of the monitored batch

template_fields = ['batch_id'][source]
get_hook(self)[source]

Get valid hook.

Returns

hook

Return type

LivyHook

poke(self, context: Dict[Any, Any])[source]

Was this entry helpful?