airflow.providers.google.cloud.transfers.oracle_to_gcs

Module Contents

Classes

OracleToGCSOperator

Copy data from Oracle to Google Cloud Storage in JSON, CSV or Parquet format.
class airflow.providers.google.cloud.transfers.oracle_to_gcs.OracleToGCSOperator(*, oracle_conn_id='oracle_default', ensure_utc=False, **kwargs)[source]

Bases: airflow.providers.google.cloud.transfers.sql_to_gcs.BaseSQLToGCSOperator

Copy data from Oracle to Google Cloud Storage in JSON, CSV or Parquet format.

See also

For more information on how to use this operator, take a look at the guide: OracleToGCSOperator

Parameters

  • oracle_conn_id – Reference to a specific Oracle hook.

  • ensure_utc – Ensure TIMESTAMP columns exported as UTC. If set to False, TIMESTAMP columns will be exported using the Oracle server’s default timezone.

ui_color = '#a0e08c'[source]
type_map[source]
query()[source]

Query Oracle and returns a cursor to the results.

field_to_bigquery(field)[source]

Convert a DBAPI field to BigQuery schema format.

convert_type(value, schema_type, **kwargs)[source]

Take a value from Oracle db and convert it to a value safe for JSON/Google Cloud Storage/BigQuery.

  • Datetimes are converted to UTC seconds.

  • Decimals are converted to floats.

  • Dates are converted to ISO formatted string if given schema_type is DATE, or UTC seconds otherwise.

  • Binary type fields are converted to integer if given schema_type is INTEGER, or encoded with base64 otherwise. Imported BYTES data must be base64-encoded according to BigQuery documentation: https://cloud.google.com/bigquery/data-types

Parameters

  • value – Oracle db column value

  • schema_type – BigQuery data type

Was this entry helpful?