Salesforce To GCS Operators¶

Prerequisite Tasks
Reference

Prerequisite Tasks ¶

To use these operators, you must do a few things:

Select or create a Cloud Platform project using the Cloud Console.

Enable billing for your project, as described in the Google Cloud documentation.

Enable the API, as described in the Cloud Console documentation.
Install API libraries via pip.
pip install 'apache-airflow[google]'
Detailed information is available for Installation.
Setup a Google Cloud Connection.

SalesforceToGcsOperator¶

Use the SalesforceToGcsOperator to execute a Salesforce query to fetch data and load it to GCS.

airflow/providers/google/cloud/example_dags/example_salesforce_to_gcs.pyView Source

    gcs_upload_task = SalesforceToGcsOperator(
        query=QUERY,
        include_deleted=True,
        bucket_name=GCS_BUCKET,
        object_name=GCS_OBJ_PATH,
        salesforce_conn_id=SALESFORCE_CONN_ID,
        export_format='csv',
        coerce_to_timestamp=False,
        record_time_added=False,
        gcp_conn_id=GCS_CONN_ID,
        task_id="upload_to_gcs",
        dag=dag,
    )

Reference ¶

For further information, look at:

Simple Salesforce Documentation

Was this entry helpful?