You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by 房延鹏 <13...@163.com> on 2019/11/25 14:54:17 UTC
The question of kafka
Hi，
I want to ask a question. Why replicas not contain the isr. The version is kafka_2.11-0.11.00. Look forward to your reply. Thanks.
Re: Re: The question of kafka
Posted by Daniyar Kulakhmetov <dk...@liftoff.io>.
Check the max segment size (`log.segment.bytes` global config or
`segment.bytes` topic's config) and the size of the messages which were
sent to the topic. And check the logs. It may be possible that followers
are stuck unable to consume a message from the topic.
On Tue, Nov 26, 2019 at 1:35 AM Jonathan Santilli <
jonathansantilli@gmail.com> wrote:
> What the Kafka Brokers and Zookeeper logs say?
> The fact they are not in-sync could be related to diff variables.
>
>
>
>
> On Tue, Nov 26, 2019 at 2:03 AM 房延鹏 <13...@163.com> wrote:
>
> > hello,
> > like this. The replicas of partition 4 and 10 not contains their isr.
> >
> >
> > sh /u01/sqcar/kafka_2.11-0.11.0.0/bin/kafka-topics.sh --describe
> > --zookeeper 10.0.7.65:2181,10.0.7.66:2181,10.0.7.67:2181 --topic
> > sqyc_kid_bigdata
> > Topic:sqyc_kid_bigdata PartitionCount:15 ReplicationFactor:2 Configs:
> > Topic: sqyc_kid_bigdata Partition: 0 Leader: 3 Replicas: 3,1 Isr: 3
> > Topic: sqyc_kid_bigdata Partition: 1 Leader: 1 Replicas: 1,2 Isr: 1
> > Topic: sqyc_kid_bigdata Partition: 2 Leader: 3 Replicas: 2,3 Isr: 3
> > Topic: sqyc_kid_bigdata Partition: 3 Leader: 3 Replicas: 3,2 Isr: 3,2
> > Topic: sqyc_kid_bigdata Partition: 4 Leader: 2 Replicas: 1,3 Isr: 2
> > Topic: sqyc_kid_bigdata Partition: 5 Leader: 2 Replicas: 2,1 Isr: 2
> > Topic: sqyc_kid_bigdata Partition: 6 Leader: 3 Replicas: 3,1 Isr: 3,1
> > Topic: sqyc_kid_bigdata Partition: 7 Leader: 1 Replicas: 1,2 Isr: 1
> > Topic: sqyc_kid_bigdata Partition: 8 Leader: 3 Replicas: 2,3 Isr: 3
> > Topic: sqyc_kid_bigdata Partition: 9 Leader: 3 Replicas: 3,2 Isr: 3,2
> > Topic: sqyc_kid_bigdata Partition: 10 Leader: 2 Replicas: 1,3 Isr: 2
> > Topic: sqyc_kid_bigdata Partition: 11 Leader: 2 Replicas: 2,1 Isr: 2
> > Topic: sqyc_kid_bigdata Partition: 12 Leader: 3 Replicas: 3,1 Isr: 3
> > Topic: sqyc_kid_bigdata Partition: 13 Leader: 1 Replicas: 1,2 Isr: 1
> > Topic: sqyc_kid_bigdata Partition: 14 Leader: 3 Replicas: 2,3 Isr: 3
> >
> >
> >
> >
> >
> >
> >
> >
> > At 2019-11-25 23:22:22, "Jonathan Santilli" <jo...@gmail.com>
> > wrote:
> > >Hello,
> > >
> > >do you mean why replicas are not in sync?
> > >
> > >I think you need to be more specific, please.
> > >
> > >
> > >Cheers!
> > >--
> > >Jonathan
> > >
> > >
> > >On Mon, Nov 25, 2019 at 2:54 PM 房延鹏 <13...@163.com> wrote:
> > >
> > >> Hi，
> > >>
> > >> I want to ask a question. Why replicas not contain the isr. The
> > version
> > >> is kafka_2.11-0.11.00. Look forward to your reply. Thanks.
> > >
> > >
> > >
> > >--
> > >Santilli Jonathan
> >
>
>
> --
> Santilli Jonathan
>
Re: Re: The question of kafka
Posted by Jonathan Santilli <jo...@gmail.com>.
What the Kafka Brokers and Zookeeper logs say?
The fact they are not in-sync could be related to diff variables.
On Tue, Nov 26, 2019 at 2:03 AM 房延鹏 <13...@163.com> wrote:
> hello,
> like this. The replicas of partition 4 and 10 not contains their isr.
>
>
> sh /u01/sqcar/kafka_2.11-0.11.0.0/bin/kafka-topics.sh --describe
> --zookeeper 10.0.7.65:2181,10.0.7.66:2181,10.0.7.67:2181 --topic
> sqyc_kid_bigdata
> Topic:sqyc_kid_bigdata PartitionCount:15 ReplicationFactor:2 Configs:
> Topic: sqyc_kid_bigdata Partition: 0 Leader: 3 Replicas: 3,1 Isr: 3
> Topic: sqyc_kid_bigdata Partition: 1 Leader: 1 Replicas: 1,2 Isr: 1
> Topic: sqyc_kid_bigdata Partition: 2 Leader: 3 Replicas: 2,3 Isr: 3
> Topic: sqyc_kid_bigdata Partition: 3 Leader: 3 Replicas: 3,2 Isr: 3,2
> Topic: sqyc_kid_bigdata Partition: 4 Leader: 2 Replicas: 1,3 Isr: 2
> Topic: sqyc_kid_bigdata Partition: 5 Leader: 2 Replicas: 2,1 Isr: 2
> Topic: sqyc_kid_bigdata Partition: 6 Leader: 3 Replicas: 3,1 Isr: 3,1
> Topic: sqyc_kid_bigdata Partition: 7 Leader: 1 Replicas: 1,2 Isr: 1
> Topic: sqyc_kid_bigdata Partition: 8 Leader: 3 Replicas: 2,3 Isr: 3
> Topic: sqyc_kid_bigdata Partition: 9 Leader: 3 Replicas: 3,2 Isr: 3,2
> Topic: sqyc_kid_bigdata Partition: 10 Leader: 2 Replicas: 1,3 Isr: 2
> Topic: sqyc_kid_bigdata Partition: 11 Leader: 2 Replicas: 2,1 Isr: 2
> Topic: sqyc_kid_bigdata Partition: 12 Leader: 3 Replicas: 3,1 Isr: 3
> Topic: sqyc_kid_bigdata Partition: 13 Leader: 1 Replicas: 1,2 Isr: 1
> Topic: sqyc_kid_bigdata Partition: 14 Leader: 3 Replicas: 2,3 Isr: 3
>
>
>
>
>
>
>
>
> At 2019-11-25 23:22:22, "Jonathan Santilli" <jo...@gmail.com>
> wrote:
> >Hello,
> >
> >do you mean why replicas are not in sync?
> >
> >I think you need to be more specific, please.
> >
> >
> >Cheers!
> >--
> >Jonathan
> >
> >
> >On Mon, Nov 25, 2019 at 2:54 PM 房延鹏 <13...@163.com> wrote:
> >
> >> Hi，
> >>
> >> I want to ask a question. Why replicas not contain the isr. The
> version
> >> is kafka_2.11-0.11.00. Look forward to your reply. Thanks.
> >
> >
> >
> >--
> >Santilli Jonathan
>
--
Santilli Jonathan
Re:Re: The question of kafka
Posted by 房延鹏 <13...@163.com>.
hello,
like this. The replicas of partition 4 and 10 not contains their isr.
sh /u01/sqcar/kafka_2.11-0.11.0.0/bin/kafka-topics.sh --describe --zookeeper 10.0.7.65:2181,10.0.7.66:2181,10.0.7.67:2181 --topic sqyc_kid_bigdata
Topic:sqyc_kid_bigdata PartitionCount:15 ReplicationFactor:2 Configs:
Topic: sqyc_kid_bigdata Partition: 0 Leader: 3 Replicas: 3,1 Isr: 3
Topic: sqyc_kid_bigdata Partition: 1 Leader: 1 Replicas: 1,2 Isr: 1
Topic: sqyc_kid_bigdata Partition: 2 Leader: 3 Replicas: 2,3 Isr: 3
Topic: sqyc_kid_bigdata Partition: 3 Leader: 3 Replicas: 3,2 Isr: 3,2
Topic: sqyc_kid_bigdata Partition: 4 Leader: 2 Replicas: 1,3 Isr: 2
Topic: sqyc_kid_bigdata Partition: 5 Leader: 2 Replicas: 2,1 Isr: 2
Topic: sqyc_kid_bigdata Partition: 6 Leader: 3 Replicas: 3,1 Isr: 3,1
Topic: sqyc_kid_bigdata Partition: 7 Leader: 1 Replicas: 1,2 Isr: 1
Topic: sqyc_kid_bigdata Partition: 8 Leader: 3 Replicas: 2,3 Isr: 3
Topic: sqyc_kid_bigdata Partition: 9 Leader: 3 Replicas: 3,2 Isr: 3,2
Topic: sqyc_kid_bigdata Partition: 10 Leader: 2 Replicas: 1,3 Isr: 2
Topic: sqyc_kid_bigdata Partition: 11 Leader: 2 Replicas: 2,1 Isr: 2
Topic: sqyc_kid_bigdata Partition: 12 Leader: 3 Replicas: 3,1 Isr: 3
Topic: sqyc_kid_bigdata Partition: 13 Leader: 1 Replicas: 1,2 Isr: 1
Topic: sqyc_kid_bigdata Partition: 14 Leader: 3 Replicas: 2,3 Isr: 3
At 2019-11-25 23:22:22, "Jonathan Santilli" <jo...@gmail.com> wrote:
>Hello,
>
>do you mean why replicas are not in sync?
>
>I think you need to be more specific, please.
>
>
>Cheers!
>--
>Jonathan
>
>
>On Mon, Nov 25, 2019 at 2:54 PM 房延鹏 <13...@163.com> wrote:
>
>> Hi，
>>
>> I want to ask a question. Why replicas not contain the isr. The version
>> is kafka_2.11-0.11.00. Look forward to your reply. Thanks.
>
>
>
>--
>Santilli Jonathan
Re: The question of kafka
Posted by Jonathan Santilli <jo...@gmail.com>.
Hello,
do you mean why replicas are not in sync?
I think you need to be more specific, please.
Cheers!
--
Jonathan
On Mon, Nov 25, 2019 at 2:54 PM 房延鹏 <13...@163.com> wrote:
> Hi，
>
> I want to ask a question. Why replicas not contain the isr. The version
> is kafka_2.11-0.11.00. Look forward to your reply. Thanks.
--
Santilli Jonathan