In this post let's look at the Kafka Camel Component. Apache Camel is an implementation of the enterprise integration patterns. The class we want is KafkaConsumer @Override protected void doStart() throws Exception { //... executor = endpoint.createExecutor(); //... for (int i = 0; i < endpoint.getConfiguration().getConsumersCount(); i++) { KafkaFetchRecords task = new KafkaFetchRecords(topic, pattern, i… Continue reading A look at the Camel Kafka Consumer
Category: Kafka
Kafka Consumer Rebalance
A consumer is a process that reads from a kafka topic and process a message. A topic may contain multiple partitions. A partition is owned by a broker (in a clustered environment). A consumer group may contain multiple consumers. The consumers in a group cannot consume the same message. If the same message must be… Continue reading Kafka Consumer Rebalance
