apache-airflow-providers-apache-spark

Package apache-airflow-providers-apache-spark

Apache Spark

Release: 4.1.1

Provider package

This is a provider package for apache.spark provider. All classes for this provider package are in airflow.providers.apache.spark python package.

Installation

You can install this package on top of an existing Airflow 2 installation (see Requirements below) for the minimum Airflow version supported) via pip install apache-airflow-providers-apache-spark

Requirements

The minimum Apache Airflow version supported by this provider package is 2.4.0.

PIP package

Version required

apache-airflow

>=2.4.0

pyspark

Was this entry helpful?