Toolkit technical background overview

Edit me

Purpose of this toolkit

The streamsx.messagehub toolkit provides those operators that help you integrate IBM Streams with the IBM Event Streams service. This toolkit lets you read messages from Event Streams topics and write messages into topics.

Introduction into Apache Kafka

Since the IBM Event Streams service is based on the open-source project Apache Kafka, you should have a certain degree of knowledge about Apache Kafka. A first place to get introduced with Kafka is the Apache Kafka home page.

Introduction into this toolkit

This toolkit is based on the Kafka toolkit from GitHub, so that its usage patterns, features, and limitations also apply to this toolkit.

This Streamsdev article gives a good introduction to the Message Hub toolkit.

Improving consumer performance

Article on Streamsdev on how to improve performance when consuming from Kafka.