Amazon DynamoDB¶

Amazon DynamoDB Amazon DynamoDB is a fully managed, serverless, key-value NoSQL database designed to run high-performance applications at any scale. DynamoDB offers built-in security, continuous backups, automated multi-Region replication, in-memory caching, and data import and export tools.

Prerequisite Tasks¶

To use these operators, you must do a few things:

Create necessary resources using AWS Console or AWS CLI.
Install API libraries via pip.
pip install 'apache-airflow[amazon]'
Detailed information is available Installation
Setup Connection.

Sensors¶

Wait on Amazon DynamoDB item attribute value match¶

Use the DynamoDBValueSensor to wait for the presence of a matching DynamoDB item’s attribute/value pair.

tests/system/providers/amazon/aws/example_dynamodb.py[source]

dynamodb_sensor = DynamoDBValueSensor(
    task_id="waiting_for_dynamodb_item_value",
    poke_interval=30,
    timeout=120,
    soft_fail=False,
    retries=10,
    table_name="AirflowSensorTest",
    partition_key_name="PK",
    partition_key_value="Test",
    sort_key_name="SK",
    sort_key_value="2022-07-12T11:11:25-0400",
    attribute_name="Value",
    attribute_value="Testing",
)

Reference¶

AWS boto3 library documentation for DynamoDB