`airflow.contrib.operators.mssql_to_gcs`¶

MsSQL to GCS operator.

Module Contents¶

class airflow.contrib.operators.mssql_to_gcs.MsSqlToGoogleCloudStorageOperator(mssql_conn_id='mssql_default', *args, **kwargs)[source]¶

Bases: airflow.contrib.operators.sql_to_gcs.BaseSQLToGoogleCloudStorageOperator

Copy data from Microsoft SQL Server to Google Cloud Storage in JSON or CSV format.

Parameters: mssql_conn_id (str) – Reference to a specific MSSQL hook.

Example:

The following operator will export data from the Customers table within the given MSSQL Database and then upload it to the ‘mssql-export’ GCS bucket (along with a schema file).

export_customers = MsSqlToGoogleCloudStorageOperator(
    task_id='export_customers',
    sql='SELECT * FROM dbo.Customers;',
    bucket='mssql-export',
    filename='data/customers/export.json',
    schema_filename='schemas/export.json',
    mssql_conn_id='mssql_default',
    google_cloud_storage_conn_id='google_cloud_default',
    dag=dag
)

ui_color = #e0a98c[source]¶

type_map[source]¶

query(self)[source]¶

Queries MSSQL and returns a cursor of results.

Returns: mssql cursor

field_to_bigquery(self, field)[source]¶

classmethod convert_type(cls, value, schema_type)[source]¶: Takes a value from MSSQL, and converts it to a value that’s safe for JSON/Google Cloud Storage/BigQuery.

airflow.contrib.operators.mssql_to_gcs¶

Module Contents¶

`airflow.contrib.operators.mssql_to_gcs`¶