airflow.providers.google.cloud.transfers.mssql_to_gcs¶

MsSQL to GCS operator.

Classes¶

MSSQLToGCSOperator

Copy data from Microsoft SQL Server to Google Cloud Storage in JSON, CSV or Parquet format.

Module Contents¶

class airflow.providers.google.cloud.transfers.mssql_to_gcs.MSSQLToGCSOperator(*, bit_fields=None, mssql_conn_id='mssql_default', **kwargs)[source]¶

Bases: airflow.providers.google.cloud.transfers.sql_to_gcs.BaseSQLToGCSOperator

Copy data from Microsoft SQL Server to Google Cloud Storage in JSON, CSV or Parquet format.

Parameters:

bit_fields (collections.abc.Sequence[str] | None) – Sequence of fields names of MSSQL “BIT” data type, to be interpreted in the schema as “BOOLEAN”. “BIT” fields that won’t be included in this sequence, will be interpreted as “INTEGER” by default.
mssql_conn_id – Reference to a specific MSSQL hook.

Example:

The following operator will export data from the Customers table within the given MSSQL Database and then upload it to the ‘mssql-export’ GCS bucket (along with a schema file).

export_customers = MSSQLToGCSOperator(
    task_id="export_customers",
    sql="SELECT * FROM dbo.Customers;",
    bit_fields=["some_bit_field", "another_bit_field"],
    bucket="mssql-export",
    filename="data/customers/export.json",
    schema_filename="schemas/export.json",
    mssql_conn_id="mssql_default",
    gcp_conn_id="google_cloud_default",
    dag=dag,
)