`tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres`¶

Example Airflow DAG for Google BigQuery service.

This DAG relies on the following OS environment variables

AIRFLOW__API__GOOGLE_KEY_PATH - Path to service account key file. Note, you can skip this variable if you run this DAG in a Composer environment.

Module Contents¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.ENV_ID[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.PROJECT_ID[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DAG_ID = 'bigquery_to_postgres'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.REGION = 'us-west2'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.ZONE[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.NETWORK = 'default'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.CONNECTION_ID[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.CONNECTION_TYPE = 'postgres'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.BIGQUERY_DATASET_NAME[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.BIGQUERY_TABLE = 'test_table'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SOURCE_OBJECT_NAME = 'gs://airflow-system-tests-resources/bigquery/salaries_1k.csv'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.BATCH_SIZE = 500[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.UPLOAD_DATA_TO_BIGQUERY[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_NAME = 'testdb'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_PORT = 5432[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_USER_NAME = 'root'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DB_USER_PASSWORD = 'demo_password'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SETUP_POSTGRES_COMMAND[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SQL_TABLE = 'test_table'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.SQL_CREATE_TABLE[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.GCE_MACHINE_TYPE = 'n1-standard-1'[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.GCE_INSTANCE_NAME[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.GCE_INSTANCE_BODY[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.FIREWALL_RULE_NAME[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.CREATE_FIREWALL_RULE_COMMAND[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DELETE_FIREWALL_RULE_COMMAND[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.DELETE_PERSISTENT_DISK_COMMAND[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.log[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.create_bigquery_dataset[source]¶

tests.system.providers.google.cloud.bigquery.example_bigquery_to_postgres.test_run[source]¶

Was this entry helpful?