tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor¶

Example Airflow DAG exercising BigQueryStreamingBufferEmptySensor.

BigQuery’s streaming buffer can take up to ~90 minutes to flush, so this test can run for a long time end-to-end and is therefore opt-in: set RUN_MANUAL_GOOGLE_SYSTEM_TESTS=1 to run it.

Attributes¶

`pytestmark`
`ENV_ID`
`PROJECT_ID`
`DAG_ID`
`DATASET_NAME`
`TABLE_NAME`
`STREAMING_UPDATE_QUERY`
`STREAMING_DELETE_QUERY`
`SCHEMA`
`create_dataset`
`test_run`

Module Contents¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.pytestmark[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.ENV_ID[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.PROJECT_ID[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.DAG_ID = 'bigquery_streaming_buffer_sensor'[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.DATASET_NAME[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.TABLE_NAME[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.STREAMING_UPDATE_QUERY[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.STREAMING_DELETE_QUERY[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.SCHEMA[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.create_dataset[source]¶

tests.system.google.cloud.bigquery.example_bigquery_streaming_buffer_sensor.test_run[source]¶