You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Reshef Mann <re...@gmail.com> on 2014/03/20 13:44:34 UTC

Replacing a broker in a cluster

Hi,

I hope someone can point me to the right place.

I'm running a Kafka (0.8) cluster of 3 machines and would like to upgrade
to bigger machines with bigger disks by replacing the servers one by one.
What are steps for performing it without compromising the stability of the
system?

Thanks,
Reshef

Re: Replacing a broker in a cluster

Posted by Reshef Mann <re...@gmail.com>.

Thanks Guozhang and Neha for your answers.

I will try Neha's approach as I want to replace the brokers.


On Thu, Mar 20, 2014 at 6:27 PM, Neha Narkhede <ne...@gmail.com>wrote:

> Reshef,
>
> If you would like to just replace one broker at a time, then you can
> shutdown the broker and start up the broker on the new box with the *same*
> broker.id. By doing this, the broker will automatically sync data for all
> the partitions it hosts. You can wait for the under replicated partition
> count to drop to 0 and repeat the process.
>
> As Guozhang pointed out, you can use the cluster expansion tool if you want
> to add brokers. But it looks like you want to replace so the above process
> would work better.
>
> Thanks,
> Neha
>
>
> On Thu, Mar 20, 2014 at 8:59 AM, Guozhang Wang <wa...@gmail.com> wrote:
>
> > Hello Reshef,
> >
> > Have you checked this page?
> >
> > http://kafka.apache.org/documentation.html#basic_ops_cluster_expansion
> >
> > Guozhang
> >
> >
> > On Thu, Mar 20, 2014 at 5:44 AM, Reshef Mann <re...@gmail.com>
> > wrote:
> >
> > > Hi,
> > >
> > > I hope someone can point me to the right place.
> > >
> > > I'm running a Kafka (0.8) cluster of 3 machines and would like to
> upgrade
> > > to bigger machines with bigger disks by replacing the servers one by
> one.
> > > What are steps for performing it without compromising the stability of
> > the
> > > system?
> > >
> > > Thanks,
> > > Reshef
> > >
> >
> >
> >
> > --
> > -- Guozhang
> >
>



-- 
Reshef
http://reshefmann.com/

Re: Replacing a broker in a cluster

Posted by Neha Narkhede <ne...@gmail.com>.

Reshef,

If you would like to just replace one broker at a time, then you can
shutdown the broker and start up the broker on the new box with the *same*
broker.id. By doing this, the broker will automatically sync data for all
the partitions it hosts. You can wait for the under replicated partition
count to drop to 0 and repeat the process.

As Guozhang pointed out, you can use the cluster expansion tool if you want
to add brokers. But it looks like you want to replace so the above process
would work better.

Thanks,
Neha

On Thu, Mar 20, 2014 at 8:59 AM, Guozhang Wang <wa...@gmail.com> wrote:

> Hello Reshef,
>
> Have you checked this page?
>
> http://kafka.apache.org/documentation.html#basic_ops_cluster_expansion
>
> Guozhang
>
>
> On Thu, Mar 20, 2014 at 5:44 AM, Reshef Mann <re...@gmail.com>
> wrote:
>
> > Hi,
> >
> > I hope someone can point me to the right place.
> >
> > I'm running a Kafka (0.8) cluster of 3 machines and would like to upgrade
> > to bigger machines with bigger disks by replacing the servers one by one.
> > What are steps for performing it without compromising the stability of
> the
> > system?
> >
> > Thanks,
> > Reshef
> >
>
>
>
> --
> -- Guozhang
>

Re: Replacing a broker in a cluster

Posted by Guozhang Wang <wa...@gmail.com>.

Hello Reshef,

Have you checked this page?

http://kafka.apache.org/documentation.html#basic_ops_cluster_expansion

Guozhang


On Thu, Mar 20, 2014 at 5:44 AM, Reshef Mann <re...@gmail.com> wrote:

> Hi,
>
> I hope someone can point me to the right place.
>
> I'm running a Kafka (0.8) cluster of 3 machines and would like to upgrade
> to bigger machines with bigger disks by replacing the servers one by one.
> What are steps for performing it without compromising the stability of the
> system?
>
> Thanks,
> Reshef
>



-- 
-- Guozhang