Namespace com.ibm.streamsx.kafka

Kafka Toolkit > com.ibm.streamsx.kafka 1.5.0 > com.ibm.streamsx.kafka

This SPL namespace contains all functions and operators that are required to integrate with Kafka message brokers.

Compatibility

This toolkit is compatible with Kafka brokers version 0.10.2 and later. This toolkit contains the Kafka client library version 1.0. Note, that Kafka transactions cannot be used when you connect to a Kafka broker that is below version 0.11.

Configuration

Operators

• KafkaConsumer: The KafkaConsumer operator is used to consume messages from Kafka topics.
• KafkaProducer: The KafkaProducer operator is used to produce messages on Kafka topics.

Functions

• createMessageAddTopicPartition(list<tuple<rstring topic, int32 partition, int64 offset>>): Creates the JSON message to add multiple topic-partitions to the operator.
• createMessageAddTopicPartition(rstring, int32, int64): Creates the JSON message to add a single topic-partition to the operator and to begin consuming at the specified offset.
• createMessageRemoveTopicPartition(list<tuple<rstring topic, int32 partition>>): Creates the JSON message to remove multiple topic-partitions from the operator.
• createMessageRemoveTopicPartition(rstring, int32): Creates the JSON message to remove a single topic-partition from the operator.