Microsoft SQL Server To Google Cloud Storage Operator¶

The Google Cloud Storage (GCS) service is used to store large data from various applications. This page shows how to copy data from Microsoft SQL Server to GCS.

Prerequisite Tasks¶

To use these operators, you must do a few things:

Select or create a Cloud Platform project using the Cloud Console.

Enable billing for your project, as described in the Google Cloud documentation.

Enable the API, as described in the Cloud Console documentation.
Install API libraries via pip.
pip install 'apache-airflow[google]'
Detailed information is available for Installation.
Setup a Google Cloud Connection.

MSSQLToGCSOperator¶

MSSQLToGCSOperator allows you to upload data from Microsoft SQL Server database to GCS.

Below is an example of using this operator to upload data to GCS.

tests/system/google/cloud/gcs/example_mssql_to_gcs.py[source]

    upload_mssql_to_gcs = MSSQLToGCSOperator(
        task_id="mssql_to_gcs",
        mssql_conn_id="airflow_mssql",
        sql=SQL_QUERY,
        bucket=BUCKET_NAME,
        filename=FILENAME,
        export_format="csv",
    )

Reference¶

For further information, look at: * Microsoft SQL Server Documentation * Google Cloud Storage Documentation