airflow.providers.apache.cassandra.sensors.record

This module contains sensor that check the existence of a record in a Cassandra cluster.

Module Contents

Classes

CassandraRecordSensor

Checks for the existence of a record in a Cassandra cluster.

class airflow.providers.apache.cassandra.sensors.record.CassandraRecordSensor(*, keys, table, cassandra_conn_id=CassandraHook.default_conn_name, **kwargs)[source]

Bases: airflow.sensors.base.BaseSensorOperator

Checks for the existence of a record in a Cassandra cluster.

See also

For more information on how to use this operator, take a look at the guide: Waiting for a Record to be created

For example, if you want to wait for a record that has values 'v1' and 'v2' for each primary keys 'p1' and 'p2' to be populated in keyspace 'k' and table 't', instantiate it as follows:

>>> cassandra_sensor = CassandraRecordSensor(table="k.t",
...                                          keys={"p1": "v1", "p2": "v2"},
...                                          cassandra_conn_id="cassandra_default",
...                                          task_id="cassandra_sensor")
Parameters
  • table (str) -- Target Cassandra table. Use dot notation to target a specific keyspace.

  • keys (Dict[str, str]) -- The keys and their values to be monitored

  • cassandra_conn_id (str) -- The connection ID to use when connecting to Cassandra cluster

template_fields :Sequence[str] = ['table', 'keys'][source]
poke(self, context)[source]

Function that the sensors defined while deriving this class should override.

Was this entry helpful?