Apache Kafka Hooks

KafkaHook

A base hook for interacting with Apache Kafka. Use this hook as a base class when creating your own Kafka hooks. For parameter definitions take a look at KafkaBaseHook.

KafkaAdminClientHook

A hook for interacting with an Apache Kafka cluster. For parameter definitions take a look at KafkaAdminClientHook.

Reference

For further information, look at Apache Kafka Admin config documentation.

KafkaConsumerHook

A hook for creating a Kafka Consumer. This hook is used by the ConsumeFromTopicOperator and the AwaitMessageTrigger. For parameter definitions take a look at KafkaConsumerHook.

Reference

For further information, look at Apache Kafka Consumer documentation.

KafkaProducerHook

A hook for creating a Kafka Producer. This hook is used by the ProduceToTopicOperator. For parameter definitions take a look at KafkaProducerHook.

Reference

For further information, look at Apache Kafka Producer documentation.

Was this entry helpful?