You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Srikanth Chandika <li...@gmail.com> on 2016/03/29 06:49:55 UTC
Best Recommended replication-factor
Hi,
What is the best recommended replication-factor for a 5 broker kafka?
Can anybody suggest me the good replication factor
Regards,
Srikanth
Re: Best Recommended replication-factor
Posted by John Holland <jo...@objectpartners.com>.
As was said it depends on what tradeoffs you want between availability and
data loss risk.
If you're most concerned about the data then I recommend having it
replicated to at least 3 brokers, set minimum ISR to 2 and produce to the
topic with acks = -1.
Also set "unclean.leader.election.enable" to false on the broker config.
I've been using that setup without data loss for a while now.
On Thu, Mar 31, 2016 at 6:28 AM Srikanth Chandika <li...@gmail.com>
wrote:
> Hi Cees De Groot,
>
> I don't want to loose my data.
>
> In-case of 5 brokers there is a chance of 2 brokers down.
>
>
> On Tue, Mar 29, 2016 at 11:55 PM, Cees de Groot <ce...@pagerduty.com>
> wrote:
>
> > How much do you like your data?
> >
> > It really depends. There are situations that a replication factor of 1 is
> > sufficient, we work with 3 (with replicas in each of our three DCs,
> because
> > that's our model-of-things-were-afraid-of). The question really is - how
> > many brokers do you want to be able to afford to lose, and do you want to
> > pay the insurance premium (extra storage, lower performance)?
> >
> > On Tue, Mar 29, 2016 at 12:49 AM, Srikanth Chandika <
> > linosrikanth@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > What is the best recommended replication-factor for a 5 broker kafka?
> > > Can anybody suggest me the good replication factor
> > >
> > > Regards,
> > > Srikanth
> > >
> >
>
Re: Best Recommended replication-factor
Posted by Srikanth Chandika <li...@gmail.com>.
Hi Cees De Groot,
I don't want to loose my data.
In-case of 5 brokers there is a chance of 2 brokers down.
On Tue, Mar 29, 2016 at 11:55 PM, Cees de Groot <ce...@pagerduty.com> wrote:
> How much do you like your data?
>
> It really depends. There are situations that a replication factor of 1 is
> sufficient, we work with 3 (with replicas in each of our three DCs, because
> that's our model-of-things-were-afraid-of). The question really is - how
> many brokers do you want to be able to afford to lose, and do you want to
> pay the insurance premium (extra storage, lower performance)?
>
> On Tue, Mar 29, 2016 at 12:49 AM, Srikanth Chandika <
> linosrikanth@gmail.com>
> wrote:
>
> > Hi,
> >
> > What is the best recommended replication-factor for a 5 broker kafka?
> > Can anybody suggest me the good replication factor
> >
> > Regards,
> > Srikanth
> >
>
Re: Best Recommended replication-factor
Posted by Cees de Groot <ce...@pagerduty.com>.
How much do you like your data?
It really depends. There are situations that a replication factor of 1 is
sufficient, we work with 3 (with replicas in each of our three DCs, because
that's our model-of-things-were-afraid-of). The question really is - how
many brokers do you want to be able to afford to lose, and do you want to
pay the insurance premium (extra storage, lower performance)?
On Tue, Mar 29, 2016 at 12:49 AM, Srikanth Chandika <li...@gmail.com>
wrote:
> Hi,
>
> What is the best recommended replication-factor for a 5 broker kafka?
> Can anybody suggest me the good replication factor
>
> Regards,
> Srikanth
>