You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by SenthilKumar K <se...@gmail.com> on 2018/03/24 06:59:23 UTC

Java Kafka Consumer Group Settings

Hi Experts ,  I have a 3 node Kafka Cluster with inbound Traffic ~60Mbps.
In the same cluster we are tying to consume the data using Java Kafka
Consumer (
https://kafka.apache.org/0110/javadoc/index.html?org/apache/kafka/clients/consumer/KafkaConsumer.html)
& i could notice few problem in Java Consumer.

#1 -  CommitFailed Exception (

 Commit cannot be completed since the group has already rebalanced and
assigned the partitions to another member
)
#2 - Out of Memory ..


Kafka Version : 0.11.0

Consumer Settings:
group.id=<<XXXX>>>
enable.auto.commit = true
auto.commit.interval.ms = 5000
max.poll.interval.ms = 30000
poll.timeout = 200ms
max.poll.records = 500
session.timeout.ms=30000

4GB memory for JVM ..

Appreciate your inputs to tune Consumer ...

--Senthil