Apache Hive

apache-airflow-providers-apache-hive

Apache Hive

Works with Airflow 2.11+

Install:

pip install apache-airflow-providers-apache-hive==9.4.0

Extras:

Version:

Airflow

2.11+

Python

>=3.10

Dependencies (8)

Show all Hide

apache-airflow>=2.11.0 apache-airflow-providers-common-compat>=1.12.0 apache-airflow-providers-common-sql>=1.32.0 hmsclient>=0.1.0 pandas>=2.1.2; python_version <"3.13" pandas>=2.2.3; python_version >="3.13" pyhive[hive_pure_sasl]>=0.7.0 jmespath>=0.7.0

Connections (3)

Modules

O

HiveOperator

Executes hql code or hive script in a specific Hive database.

airflow.providers.apache.hive.operators.hive.HiveOperator

View Docs Source

O

HiveStatsCollectionOperator

Gather partition statistics and insert them into MySQL.

airflow.providers.apache.hive.operators.hive_stats.HiveStatsCollectionOperator

View Docs Source

H

HiveCliHook

Simple wrapper around the hive CLI.

airflow.providers.apache.hive.hooks.hive.HiveCliHook

View Docs Source

H

HiveMetastoreHook

Wrapper to interact with the Hive Metastore.

airflow.providers.apache.hive.hooks.hive.HiveMetastoreHook

View Docs Source

H

HiveServer2Hook

Wrapper around the pyhive library.

airflow.providers.apache.hive.hooks.hive.HiveServer2Hook

View Docs Source

S

HivePartitionSensor

Waits for a partition to show up in Hive.

airflow.providers.apache.hive.sensors.hive_partition.HivePartitionSensor

View Docs Source

S

MetastorePartitionSensor

An alternative to the HivePartitionSensor that talk directly to the MySQL db.

airflow.providers.apache.hive.sensors.metastore_partition.MetastorePartitionSensor

View Docs Source

S

NamedHivePartitionSensor

Waits for a set of partitions to show up in Hive.

airflow.providers.apache.hive.sensors.named_hive_partition.NamedHivePartitionSensor

View Docs Source

T

VerticaToHiveOperator

Moves data from Vertica to Hive.

airflow.providers.apache.hive.transfers.vertica_to_hive.VerticaToHiveOperator

View Docs Source

T

HiveToMySqlOperator

Moves data from Hive to MySQL.

airflow.providers.apache.hive.transfers.hive_to_mysql.HiveToMySqlOperator

View Docs Source

T

HiveToSambaOperator

Execute hql code in a specific Hive database and load the results as a csv to a Samba location.

airflow.providers.apache.hive.transfers.hive_to_samba.HiveToSambaOperator

View Docs Source

T

S3ToHiveOperator

Moves data from S3 to Hive.

airflow.providers.apache.hive.transfers.s3_to_hive.S3ToHiveOperator

View Docs Source

T

MySqlToHiveOperator

Moves data from MySql to Hive.

airflow.providers.apache.hive.transfers.mysql_to_hive.MySqlToHiveOperator

View Docs Source

T

MsSqlToHiveOperator

Moves data from Microsoft SQL Server to Hive.

airflow.providers.apache.hive.transfers.mssql_to_hive.MsSqlToHiveOperator

View Docs Source