airflow.providers.google.cloud.transfers.presto_to_gcs

Module Contents

Classes

PrestoToGCSOperator

Copy data from PrestoDB to Google Cloud Storage in JSON, CSV or Parquet format.
class airflow.providers.google.cloud.transfers.presto_to_gcs.PrestoToGCSOperator(*, presto_conn_id='presto_default', **kwargs)[source]

Bases: airflow.providers.google.cloud.transfers.sql_to_gcs.BaseSQLToGCSOperator

Copy data from PrestoDB to Google Cloud Storage in JSON, CSV or Parquet format.

Parameters

presto_conn_id (str) – Reference to a specific Presto hook.

ui_color = '#a0e08c'[source]
type_map[source]
query()[source]

Queries presto and returns a cursor to the results.

field_to_bigquery(field)[source]

Convert presto field type to BigQuery field type.

convert_type(value, schema_type, **kwargs)[source]

Do nothing. Presto uses JSON on the transport layer, so types are simple.

Parameters

  • value – Presto column value

  • schema_type – BigQuery data type

Was this entry helpful?