Setting up Kafka¶
To use the Kafka connector, download and install Apache Kafka. Before you start configuring the Kafka you also need WSO2 EI and we refer to that location as
Note: The recommended version is Kafka 2.12-1.0.0. For all available versions of Kafka that you can download, see https://kafka.apache.org/downloads. The recommended Java version is 1.8.
To configure the Kafka connector, copy the following client libraries from the <KAFKA_HOME>/lib
directory to the <MI_HOME>/lib
directory.
- kafka_2.12-1.0.0.jar
- kafka-clients-1.0.0.jar
- metrics-core-2.2.0.jar
- scala-library-2.12.3.jar
- zkclient-0.10.jar
- zookeeper-3.4.10.jar
Copy the following additional client libraries to the <MI_HOME>/lib
directory (can be copied from the Confluent platform):
- avro-1.8.1.jar
- common-config-5.4.0.jar
- common-utils-5.4.0.jar
- kafka-avro-serializer-5.3.0.jar
- kafka-schema-registry-client-5.3.0.jar
Navigate to
bin/zookeeper-server-start.sh config/zookeeper.properties
From the
bin/kafka-server-start.sh config/server.properties
Now that you have connected to Kafka, you can start publishing and consuming messages using the Kafka brokers. For more information, see Publishing Messages using Kafka and Consuming Messages using Kafka.
Top