airflow.contrib.operators.mssql_to_gcs

MsSQL to GCS operator.

Module Contents

class airflow.contrib.operators.mssql_to_gcs.MsSqlToGoogleCloudStorageOperator(mssql_conn_id='mssql_default', *args, **kwargs)[source]

Bases: airflow.contrib.operators.sql_to_gcs.BaseSQLToGoogleCloudStorageOperator

Copy data from Microsoft SQL Server to Google Cloud Storage in JSON or CSV format.

Parameters

mssql_conn_id (str) – Reference to a specific MSSQL hook.

Example:

The following operator will export data from the Customers table within the given MSSQL Database and then upload it to the ‘mssql-export’ GCS bucket (along with a schema file).

export_customers = MsSqlToGoogleCloudStorageOperator(
    task_id='export_customers',
    sql='SELECT * FROM dbo.Customers;',
    bucket='mssql-export',
    filename='data/customers/export.json',
    schema_filename='schemas/export.json',
    mssql_conn_id='mssql_default',
    google_cloud_storage_conn_id='google_cloud_default',
    dag=dag
)
ui_color = #e0a98c[source]
type_map[source]
query(self)[source]

Queries MSSQL and returns a cursor of results.

Returns

mssql cursor

field_to_bigquery(self, field)[source]
classmethod convert_type(cls, value, schema_type)[source]

Takes a value from MSSQL, and converts it to a value that’s safe for JSON/Google Cloud Storage/BigQuery.

Was this entry helpful?