Bases: airflow.hooks.dbapi_hook.DbApiHook
Connect to pinot db(https://github.com/linkedin/pinot) to issue pql
-
conn_name_attr
= pinot_broker_conn_id[source]
-
default_conn_name
= pinot_broker_default[source]
-
supports_autocommit
= False[source]
-
get_conn
(self)[source]
Establish a connection to pinot broker through pinot dbqpi.
-
get_uri
(self)[source]
Get the connection uri for pinot broker.
e.g: http://localhost:9000/pql
-
get_records
(self, sql)[source]
Executes the sql and returns a set of records.
- Parameters
sql (str) – the sql statement to be executed (str) or a list of
sql statements to execute
-
get_first
(self, sql)[source]
Executes the sql and returns the first resulting row.
- Parameters
sql (str or list) – the sql statement to be executed (str) or a list of
sql statements to execute
-
set_autocommit
(self, conn, autocommit)[source]
-
get_pandas_df
(self, sql, parameters=None)[source]
-
insert_rows
(self, table, rows, target_fields=None, commit_every=1000)[source]