airflow.providers.apache.livy.sensors.livy

This module contains the Apache Livy sensor.

Module Contents

Classes

LivySensor

Monitor a Livy sessions for termination.

class airflow.providers.apache.livy.sensors.livy.LivySensor(*, batch_id, livy_conn_id='livy_default', extra_options=None, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Monitor a Livy sessions for termination.

Parameters
  • livy_conn_id (str) -- reference to a pre-defined Livy connection

  • batch_id (Union[int, str]) -- identifier of the monitored batch depends on the option that's being modified.

template_fields :Sequence[str] = ['batch_id'][source]
get_hook(self)[source]

Get valid hook.

Returns

hook

Return type

LivyHook

poke(self, context)[source]

Function that the sensors defined while deriving this class should override.

Was this entry helpful?