You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Marco Di Falco <ma...@dedalus.eu> on 2020/01/16 15:59:37 UTC
Kafka Broker leader change without effect
Hello guys!
i have a problem i wrote about stackoverflow here: https://stackoverflow.com/questions/59772124/kafka-broker-leader-change-without-effect
Can you help me?
thank you
Marco
R: Kafka Broker leader change without effect
Posted by Marco Di Falco <ma...@dedalus.eu>.
thank you very much everyone for the answers!
-----Messaggio originale-----
Da: Ryanne Dolan <ry...@gmail.com>
Inviato: giovedì 16 gennaio 2020 18:20
A: Kafka Users <us...@kafka.apache.org>
Oggetto: Re: Kafka Broker leader change without effect
That's right, thanks for the correction. I don't suppose the producer is configured with acks=all in this case.
Ryanne
On Thu, Jan 16, 2020, 11:05 AM JOHN, BIBIN <bj...@att.com> wrote:
> Producer request will not fail. Producer will fail based on acks and
> min.insync.replicas config parameters.
>
>
> -----Original Message-----
> From: Ryanne Dolan <ry...@gmail.com>
> Sent: Thursday, January 16, 2020 10:52 AM
> To: Kafka Users <us...@kafka.apache.org>
> Subject: Re: Kafka Broker leader change without effect
>
> Marco, the replication factor of 3 is not possible when you only have
> two brokers, thus the producer will fail to send records until the
> third broker is restored. You would need to change the topic
> replication factor to 2 for your experiment to work as you expect.
>
> Ryanne
>
> On Thu, Jan 16, 2020, 9:59 AM Marco Di Falco
> <ma...@dedalus.eu>
> wrote:
>
> > Hello guys!
> > i have a problem i wrote about stackoverflow here:
> > https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fur
> > ldefense.proofpoint.com%2Fv2%2Furl%3Fu%3Dhttps-3A__stackoverflow.com
> > &data=01%7C01%7Cmarco.difalco%40dedalus.eu%7Cddaab9a3f9264650584
> > 808d79aa84bec%7C9ffff5c3bdfa4a9db595ff68329945ef%7C1&sdata=t3LO7
> > LCaNRCwLwIcUpY5SYqcgff6mWscfa2ot09X7tI%3D&reserved=0
> > _questions_59772124_kafka-2Dbroker-2Dleader-2Dchange-2Dwithout-2Deff
> > ec
> > t&d=DwIBaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=eFshZuDXOwvmW_UjVcAH8Q&m=BhZVZ
> > Xe
> > seQEOD2SYRzwo_lU6ibRcmwDoMXL643BQB44&s=tPA4Mq0KgEzVUn9Dihe5Z-0G7Hc4v
> > oz
> > O8ox3nAmoLh0&e=
> >
> > Can you help me?
> > thank you
> > Marco
> >
>
Re: Kafka Broker leader change without effect
Posted by Ryanne Dolan <ry...@gmail.com>.
That's right, thanks for the correction. I don't suppose the producer is
configured with acks=all in this case.
Ryanne
On Thu, Jan 16, 2020, 11:05 AM JOHN, BIBIN <bj...@att.com> wrote:
> Producer request will not fail. Producer will fail based on acks and
> min.insync.replicas config parameters.
>
>
> -----Original Message-----
> From: Ryanne Dolan <ry...@gmail.com>
> Sent: Thursday, January 16, 2020 10:52 AM
> To: Kafka Users <us...@kafka.apache.org>
> Subject: Re: Kafka Broker leader change without effect
>
> Marco, the replication factor of 3 is not possible when you only have two
> brokers, thus the producer will fail to send records until the third broker
> is restored. You would need to change the topic replication factor to 2 for
> your experiment to work as you expect.
>
> Ryanne
>
> On Thu, Jan 16, 2020, 9:59 AM Marco Di Falco <ma...@dedalus.eu>
> wrote:
>
> > Hello guys!
> > i have a problem i wrote about stackoverflow here:
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__stackoverflow.com
> > _questions_59772124_kafka-2Dbroker-2Dleader-2Dchange-2Dwithout-2Deffec
> > t&d=DwIBaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=eFshZuDXOwvmW_UjVcAH8Q&m=BhZVZXe
> > seQEOD2SYRzwo_lU6ibRcmwDoMXL643BQB44&s=tPA4Mq0KgEzVUn9Dihe5Z-0G7Hc4voz
> > O8ox3nAmoLh0&e=
> >
> > Can you help me?
> > thank you
> > Marco
> >
>
Re: Kafka Broker leader change without effect
Posted by Eric Azama <ea...@gmail.com>.
offsets.topic.replication.factor is set to 1, so the consumer is likely
failing because some of the __consumer_offsets topic partitions are offline.
On Thu, Jan 16, 2020 at 9:05 AM JOHN, BIBIN <bj...@att.com> wrote:
> Producer request will not fail. Producer will fail based on acks and
> min.insync.replicas config parameters.
>
>
> -----Original Message-----
> From: Ryanne Dolan <ry...@gmail.com>
> Sent: Thursday, January 16, 2020 10:52 AM
> To: Kafka Users <us...@kafka.apache.org>
> Subject: Re: Kafka Broker leader change without effect
>
> Marco, the replication factor of 3 is not possible when you only have two
> brokers, thus the producer will fail to send records until the third broker
> is restored. You would need to change the topic replication factor to 2 for
> your experiment to work as you expect.
>
> Ryanne
>
> On Thu, Jan 16, 2020, 9:59 AM Marco Di Falco <ma...@dedalus.eu>
> wrote:
>
> > Hello guys!
> > i have a problem i wrote about stackoverflow here:
> > https://urldefense.proofpoint.com/v2/url?u=https-3A__stackoverflow.com
> > _questions_59772124_kafka-2Dbroker-2Dleader-2Dchange-2Dwithout-2Deffec
> > t&d=DwIBaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=eFshZuDXOwvmW_UjVcAH8Q&m=BhZVZXe
> > seQEOD2SYRzwo_lU6ibRcmwDoMXL643BQB44&s=tPA4Mq0KgEzVUn9Dihe5Z-0G7Hc4voz
> > O8ox3nAmoLh0&e=
> >
> > Can you help me?
> > thank you
> > Marco
> >
>
RE: Kafka Broker leader change without effect
Posted by "JOHN, BIBIN" <bj...@att.com>.
Producer request will not fail. Producer will fail based on acks and min.insync.replicas config parameters.
-----Original Message-----
From: Ryanne Dolan <ry...@gmail.com>
Sent: Thursday, January 16, 2020 10:52 AM
To: Kafka Users <us...@kafka.apache.org>
Subject: Re: Kafka Broker leader change without effect
Marco, the replication factor of 3 is not possible when you only have two brokers, thus the producer will fail to send records until the third broker is restored. You would need to change the topic replication factor to 2 for your experiment to work as you expect.
Ryanne
On Thu, Jan 16, 2020, 9:59 AM Marco Di Falco <ma...@dedalus.eu>
wrote:
> Hello guys!
> i have a problem i wrote about stackoverflow here:
> https://urldefense.proofpoint.com/v2/url?u=https-3A__stackoverflow.com
> _questions_59772124_kafka-2Dbroker-2Dleader-2Dchange-2Dwithout-2Deffec
> t&d=DwIBaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=eFshZuDXOwvmW_UjVcAH8Q&m=BhZVZXe
> seQEOD2SYRzwo_lU6ibRcmwDoMXL643BQB44&s=tPA4Mq0KgEzVUn9Dihe5Z-0G7Hc4voz
> O8ox3nAmoLh0&e=
>
> Can you help me?
> thank you
> Marco
>
Re: Kafka Broker leader change without effect
Posted by Ryanne Dolan <ry...@gmail.com>.
Marco, the replication factor of 3 is not possible when you only have two
brokers, thus the producer will fail to send records until the third broker
is restored. You would need to change the topic replication factor to 2 for
your experiment to work as you expect.
Ryanne
On Thu, Jan 16, 2020, 9:59 AM Marco Di Falco <ma...@dedalus.eu>
wrote:
> Hello guys!
> i have a problem i wrote about stackoverflow here:
> https://stackoverflow.com/questions/59772124/kafka-broker-leader-change-without-effect
>
> Can you help me?
> thank you
> Marco
>