tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres

Example Airflow DAG for Google BigQuery service.

This DAG relies on the following OS environment variables

  • AIRFLOW__API__GOOGLE_KEY_PATH - Path to service account key file. Note, you can skip this variable if you run this DAG in a Composer environment.

Module Contents

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.ENV_ID[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.PROJECT_ID[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DAG_ID = 'bigquery_to_postgres'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.REGION = 'us-west2'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.ZONE[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.NETWORK = 'default'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.CONNECTION_ID[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.CONNECTION_TYPE = 'postgres'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.BIGQUERY_DATASET_NAME[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.BIGQUERY_TABLE = 'test_table'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SOURCE_OBJECT_NAME = 'gs://airflow-system-tests-resources/bigquery/salaries_1k.csv'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.BATCH_SIZE = 500[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.UPLOAD_DATA_TO_BIGQUERY[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_NAME = 'testdb'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_PORT = 5432[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_USER_NAME = 'root'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_USER_PASSWORD = 'demo_password'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SETUP_POSTGRES_COMMAND[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SQL_TABLE = 'test_table'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SQL_CREATE_TABLE[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.GCE_MACHINE_TYPE = 'n1-standard-1'[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.GCE_INSTANCE_NAME[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.GCE_INSTANCE_BODY[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.FIREWALL_RULE_NAME[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.CREATE_FIREWALL_RULE_COMMAND[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DELETE_FIREWALL_RULE_COMMAND[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DELETE_PERSISTENT_DISK_COMMAND[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.log[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.create_bigquery_dataset[source]
tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.test_run[source]

Was this entry helpful?