apache-airflow-providers-apache-spark¶
Provider package¶
This package is for the apache.spark provider.
All classes for this package are included in the airflow.providers.apache.spark python package.
Installation¶
You can install this package on top of an existing Airflow 2 installation via
pip install apache-airflow-providers-apache-spark.
For the minimum Airflow version supported, see Requirements below.
Requirements¶
The minimum Apache Airflow version supported by this provider package is 2.8.0.
PIP package |
Version required |
|---|---|
|
|
|
|
|
|
Cross provider package dependencies¶
Those are dependencies that might be needed in order to use all the features of the package. You need to install the specified provider packages in order to use them.
You can install such cross-provider dependencies when installing from PyPI. For example:
pip install apache-airflow-providers-apache-spark[cncf.kubernetes]
Dependent package |
Extra |
|---|---|
|
Downloading official packages¶
You can download officially released packages and verify their checksums and signatures from the Official Apache Download site