Using streamsx.kafka with IBM Event Streams on-premises
Abstract
This document describes how to use the SPL operators of the streamsx.kafka toolkit to connect with Eventstreams installed on-premises.
For a connection with Event Streams as IBM Cloud service, this article does not apply. Please use the streamsx.messagehub toolkit for this purpose.
What is IBM Event Streams
IBM Event Streams is a Kafka distribution for IBM cloud private. Please note, that it has been deprecated in IBM Cloud Pak for Integration. IBM recommends to use the Confluent Platform instead.
How to connect
In the on-prem Event Streams admin console, there is an option to create all the TLS related security credentials. It then automatically generates the Kafka client properties file contents.
These auto-generated Kafka client properties content can be used to configure the KafkaConsumer and KafkaProducer operator. Of course,
you can add more consumer or producer related configs, like a Kafka group identifier (group.id) for consumers.
The properties can be specified
- in a text file (use the propertiesFile parameter to denote the filename), or
- in an application configuration (use the appConfigName parameter to denote the name of the application configuration)