You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Hu Xi <hu...@hotmail.com> on 2017/05/11 10:34:39 UTC
答复: 0.10.1.0 version kafka replica syn slow

If you confirm it's the reason, then try to increase `num.replica.fetchers` to speed up the replication.

________________________________
发件人: 蔡高年 <83...@qq.com>
发送时间: 2017年5月11日 11:45
收件人: users
主题: 0.10.1.0 version kafka replica syn slow

hello
recently ,our prod environment have a proplem,the kafka leader Shrinking and Expanding IsR frequently,result in the  consumer can not consume the message.do you have any advice?


thank you.


here is the log related.





[serviceop@SZC-L0046001 kafka]$ ./bin/kafka-topics.sh --describe --zookeeper 30.16.36.181:2181,30.16.36.182:2181,30.16.36.183:2181/ubasKafka --topic kafkaUbasTopicProd



Topic:kafkaUbasTopicProd        PartitionCount:8        ReplicationFactor:3     Configs:

        Topic: kafkaUbasTopicProd       Partition: 0    Leader: 1       Replicas: 1,7,0 Isr: 1,7,0

        Topic: kafkaUbasTopicProd       Partition: 1    Leader: 2       Replicas: 2,0,1 Isr: 1,2,0

        Topic: kafkaUbasTopicProd       Partition: 2    Leader: 3       Replicas: 3,1,2 Isr: 1,2,3

        Topic: kafkaUbasTopicProd       Partition: 3    Leader: 4       Replicas: 4,2,3 Isr: 2,3,4

        Topic: kafkaUbasTopicProd       Partition: 4    Leader: 5       Replicas: 5,3,4 Isr: 3,4,5

        Topic: kafkaUbasTopicProd       Partition: 5    Leader: 6       Replicas: 6,4,5 Isr: 4,5,6

        Topic: kafkaUbasTopicProd       Partition: 6    Leader: 7       Replicas: 7,5,6 Isr: 5,6,7

        Topic: kafkaUbasTopicProd       Partition: 7    Leader: 0       Replicas: 0,6,7 Isr: 0










[2017-05-09 18:28:34,533] INFO Partition [kafkaUbasTopicProd,7] on broker 0: Expanding ISR for partition [kafkaUbasTopicProd,7] from 0 to 0,6 (kafka.cluster.Partition)

[2017-05-09 18:28:53,901] INFO Partition [kafkaUbasTopicProd,7] on broker 0: Shrinking ISR for partition [kafkaUbasTopicProd,7] from 0,6 to 0 (kafka.cluster.Partition)

[2017-05-09 18:33:03,901] INFO Partition [__consumer_offsets,2] on broker 0: Shrinking ISR for partition [__consumer_offsets,2] from 0,5,6 to 0,5 (kafka.cluster.Partition)





[2017-05-09 18:33:03,903] INFO Partition [__consumer_offsets,10] on broker 0: Shrinking ISR for partition [__consumer_offsets,10] from 0,6,7 to 0,7 (kafka.cluster.Partition)