airflow.providers.trino.hooks.trino
¶
Module Contents¶
Functions¶
Return json string with dag_id, task_id, execution_date and try_number |
Attributes¶
- airflow.providers.trino.hooks.trino.generate_trino_client_info()[source]¶
Return json string with dag_id, task_id, execution_date and try_number
- exception airflow.providers.trino.hooks.trino.TrinoException[source]¶
Bases:
Exception
Trino exception
- class airflow.providers.trino.hooks.trino.TrinoHook(*args, schema=None, log_sql=True, **kwargs)[source]¶
Bases:
airflow.providers.common.sql.hooks.sql.DbApiHook
Interact with Trino through trino package.
>>> ph = TrinoHook() >>> sql = "SELECT count(1) AS num FROM airflow.static_babynames" >>> ph.get_records(sql) [[340698]]
- get_pandas_df(sql='', parameters=None, **kwargs)[source]¶
Executes the sql and returns a pandas dataframe
- Parameters
sql (str) – the sql statement to be executed (str) or a list of sql statements to execute
parameters (Iterable | Mapping | None) – The parameters to render the SQL query with.
kwargs – (optional) passed into pandas.io.sql.read_sql method
- run(sql, autocommit=False, parameters=None, handler=None, split_statements=False, return_last=True)[source]¶
Runs a command or a list of commands. Pass a list of sql statements to the sql parameter to get them to execute sequentially
- Parameters
sql (str | Iterable[str]) – the sql statement to be executed (str) or a list of sql statements to execute
autocommit (bool) – What to set the connection’s autocommit setting to before executing the query.
parameters (Iterable | Mapping | None) – The parameters to render the SQL query with.
handler (Callable | None) – The result handler which is called with the result of each statement.
split_statements (bool) – Whether to split a single SQL string into statements and run separately
return_last (bool) – Whether to return result for only last statement or for all after split
- Returns
return only result of the ALL SQL expressions if handler was provided.
- Return type
Any | list[Any] | None
- insert_rows(table, rows, target_fields=None, commit_every=0, replace=False, **kwargs)[source]¶
A generic way to insert a set of tuples into a table.
- Parameters
table (str) – Name of the target table
rows (Iterable[tuple]) – The rows to insert into the table
target_fields (Iterable[str] | None) – The names of the columns to fill in the table
commit_every (int) – The maximum number of rows to insert in one transaction. Set to 0 to insert all rows in one transaction.
replace (bool) – Whether to replace instead of insert