airflow.providers.redis.queues.redis¶

Attributes¶

QUEUE_REGEXP

Classes¶

RedisPubSubMessageQueueProvider

Configuration for Redis integration with common-messaging.

Module Contents¶

airflow.providers.redis.queues.redis.QUEUE_REGEXP = '^redis\\+pubsub://'[source]¶

class airflow.providers.redis.queues.redis.RedisPubSubMessageQueueProvider[source]¶

Bases: airflow.providers.common.messaging.providers.base_provider.BaseMessageQueueProvider

Configuration for Redis integration with common-messaging.

[START redis_message_queue_provider_description]

It uses redis+pubsub as scheme for identifying Redis queues.
For parameter definitions take a look at AwaitMessageTrigger.

from airflow.providers.common.messaging.triggers.msg_queue import MessageQueueTrigger
from airflow.sdk import Asset, AssetWatcher

trigger = MessageQueueTrigger(
    scheme="redis+pubsub",
    # Additional Redis AwaitMessageTrigger parameters as needed
    channels=["my_channel"],
    redis_conn_id="redis_default",
)

asset = Asset("redis_queue_asset", watchers=[AssetWatcher(name="redis_watcher", trigger=trigger)])

[END redis_message_queue_provider_description]

scheme = 'redis+pubsub'[source]¶

trigger_class()[source]¶

Trigger class to use when queue_matches returns True.