Amazon QuickSight Operators¶

Prerequisite Tasks¶

To use these operators, you must do a few things:

Create necessary resources using AWS Console or AWS CLI.
Install API libraries via pip.
pip install 'apache-airflow[amazon]'
Detailed information is available Installation
Setup Connection.

Overview¶

Airflow to Amazon QuickSight integration allows users to create and start the SPICE ingestion for dataset.

QuickSightCreateIngestionOperator

QuickSightSensor

Amazon QuickSight CreateIngestion Operator¶

The QuickSightCreateIngestionOperator Creates and starts a new SPICE ingestion for a dataset. The operator also refreshes existing SPICE datasets

airflow/providers/amazon/aws/example_dags/example_quicksight.py[source]

quicksight_create_ingestion_no_waiting = QuickSightCreateIngestionOperator(
    data_set_id=DATA_SET_ID,
    ingestion_id=INGESTION_NO_WAITING_ID,
    wait_for_completion=False,
    task_id="sample_quicksight_no_waiting_dag",
)

Amazon QuickSight Sensor¶

The QuickSightSensor wait for Amazon QuickSight CreateIngestion until it reaches a terminal state

airflow/providers/amazon/aws/example_dags/example_quicksight.py[source]

quicksight_job_status = QuickSightSensor(
    data_set_id=DATA_SET_ID,
    ingestion_id=INGESTION_NO_WAITING_ID,
    task_id="check_quicksight_job_status",
)

Reference¶

For further information, look at:

Boto3 Library Documentation for QuickSight