Apache Livy

apache-airflow-providers-apache-livy

Apache Livy

Works with Airflow 2.11+
480K
Monthly Downloads
5
Total Modules
View Docs Source
Install:
pip install apache-airflow-providers-apache-livy==4.5.3

Airflow

2.11+

Python

>=3.10

Dependencies (5)

Show all Hide apache-airflow>=2.11.0 apache-airflow-providers-http>=5.1.0 apache-airflow-providers-common-compat>=1.12.0 aiohttp>=3.9.2 asgiref>=2.3.0

Connections (1)

Modules

O

LivyOperator

Wraps the Apache Livy batch REST API, allowing to submit a Spark application to the underlying cluster.

airflow.providers.apache.livy.operators.livy.LivyOperator
View Docs Source
H

LivyAsyncHook

Hook for Apache Livy through the REST API asynchronously.

airflow.providers.apache.livy.hooks.livy.LivyAsyncHook
View Docs Source
H

LivyHook

Hook for Apache Livy through the REST API.

airflow.providers.apache.livy.hooks.livy.LivyHook
View Docs Source
S

LivySensor

Monitor a Livy sessions for termination.

airflow.providers.apache.livy.sensors.livy.LivySensor
View Docs Source
T

LivyTrigger

Check for the state of a previously submitted job with batch_id.

airflow.providers.apache.livy.triggers.livy.LivyTrigger
View Docs Source