airflow.providers.apache.livy.sensors.livy

This module contains the Apache Livy sensor.

Classes

LivySensor

Monitor a Livy sessions for termination.

Module Contents

class airflow.providers.apache.livy.sensors.livy.LivySensor(*, batch_id, livy_conn_id='livy_default', livy_conn_auth_type=None, extra_options=None, endpoint_prefix=None, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Monitor a Livy sessions for termination.

Parameters:
  • livy_conn_id (str) – reference to a pre-defined Livy connection

  • batch_id (int | str) – identifier of the monitored batch depends on the option that’s being modified.

template_fields: collections.abc.Sequence[str] = ('batch_id',)[source]
batch_id[source]
get_hook()[source]

Get valid hook.

Returns:

hook

Return type:

airflow.providers.apache.livy.hooks.livy.LivyHook

poke(context)[source]

Override when deriving this class.

Was this entry helpful?