Kafka Replication Factor

[Sameer Kumar <sa...@gmail.com>]

Hi,

I have a cluster of 3 Kafka brokers, and replication factor is 2. This
means I can tolerate failure of 1 node without data loss.

Recently, one of my node crashed and some of my partitions went offline.
I am not sure if this should be the case. Am I missing something.

-Sameer.

Re: Kafka Replication Factor

[Brett Rann <br...@zendesk.com.INVALID>]

if RF=2 and min.insync.replicas=1 (the default) then you shouldn't have
offline partitions if 1 of 3 brokers is down.

I'd first double check your topic config (and broker defaults) for the one
that went offline to verify RF/Min. Be sure to check each partition they
can be different! ( kafka-topics.sh --zookeeper <zk_string> --describe
--topic <topic_name> ). IF they are good, maybe one of the remaining two
brokers had an issue at the same time? Check out the broker logs?

On Thu, Jan 18, 2018 at 12:50 AM, Svante Karlsson <sv...@csi.se>
wrote:

> whats your config for min.insync.replicas?
>
> 2018-01-17 13:37 GMT+01:00 Sameer Kumar <sa...@gmail.com>:
>
> > Hi,
> >
> > I have a cluster of 3 Kafka brokers, and replication factor is 2. This
> > means I can tolerate failure of 1 node without data loss.
> >
> > Recently, one of my node crashed and some of my partitions went offline.
> > I am not sure if this should be the case. Am I missing something.
> >
> > -Sameer.
> >
>

Re: Kafka Replication Factor

[Svante Karlsson <sv...@csi.se>]

whats your config for min.insync.replicas?

2018-01-17 13:37 GMT+01:00 Sameer Kumar <sa...@gmail.com>:

> Hi,
>
> I have a cluster of 3 Kafka brokers, and replication factor is 2. This
> means I can tolerate failure of 1 node without data loss.
>
> Recently, one of my node crashed and some of my partitions went offline.
> I am not sure if this should be the case. Am I missing something.
>
> -Sameer.
>