Amazon Messaging Queues¶

Amazon SQS Queue Provider¶

Implemented by SqsMessageQueueProvider

The Amazon SQS Queue Provider is a BaseMessageQueueProvider that uses Amazon Simple Queue Service (SQS) as the underlying message queue system. It allows you to send and receive messages using SQS queues in your Airflow workflows with MessageQueueTrigger common message queue interface.

It uses sqs as scheme for identifying SQS queues.
For parameter definitions take a look at SqsSensorTrigger.

from airflow.providers.common.messaging.triggers.msg_queue import MessageQueueTrigger
from airflow.sdk import Asset, AssetWatcher

trigger = MessageQueueTrigger(
    scheme="sqs",
    # Additional AWS SqsSensorTrigger parameters as needed
    sqs_queue="https://sqs.us-east-1.amazonaws.com/123456789012/my-queue",
    aws_conn_id="aws_default",
)

asset = Asset("sqs_queue_asset", watchers=[AssetWatcher(name="sqs_watcher", trigger=trigger)])

For a complete example, see: tests.system.amazon.aws.example_dag_sqs_message_queue_trigger