You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Jason Rosenberg <jb...@squareup.com> on 2013/05/09 07:27:47 UTC
can the replication factor for a topic be changed after it's created?
It looks like by default, the first time a new message arrives for a given
topic, it will receive the default replication factor in place on the
broker at the time it is first received.
Is it possible to change this later (e.g. say if we add more hardware to
the cluster at a later date, etc.)?
Thanks,
Jason
Re: can the replication factor for a topic be changed after it's created?
Posted by Jun Rao <ju...@gmail.com>.
Yes, your are right.
Thanks,
Jun
On Thu, May 9, 2013 at 9:07 AM, Neha Narkhede <ne...@gmail.com>wrote:
> Jun, the question is whether or not you can increase the replication factor
> of a partition through the partition reassignment tool or not. I think you
> can but I'm not sure until I test this.
>
> Thanks,
> Neha
>
>
> On Thu, May 9, 2013 at 7:58 AM, Jun Rao <ju...@gmail.com> wrote:
>
> > Currently, we don't allow the replication factor of an existing
> > topic/partition to be changed. We plan to add a tool to do that in the
> > future.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Wed, May 8, 2013 at 11:52 PM, Jason Rosenberg <jb...@squareup.com>
> wrote:
> >
> > > so does that, thereby, allow you to increase the replication for a
> > > partition?
> > >
> > >
> > > On Wed, May 8, 2013 at 10:48 PM, Neha Narkhede <
> neha.narkhede@gmail.com
> > > >wrote:
> > >
> > > > If you add more brokers to an existing cluster, you can use the
> > partition
> > > > reassignment admin tool to move a replica of selected partitions over
> > to
> > > > the new broker.
> > > >
> > > > Thanks,
> > > > Neha
> > > >
> > > >
> > > > On Wed, May 8, 2013 at 10:27 PM, Jason Rosenberg <jb...@squareup.com>
> > > wrote:
> > > >
> > > > > It looks like by default, the first time a new message arrives for
> a
> > > > given
> > > > > topic, it will receive the default replication factor in place on
> the
> > > > > broker at the time it is first received.
> > > > >
> > > > > Is it possible to change this later (e.g. say if we add more
> hardware
> > > to
> > > > > the cluster at a later date, etc.)?
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Jason
> > > > >
> > > >
> > >
> >
>
Re: can the replication factor for a topic be changed after it's created?
Posted by Neha Narkhede <ne...@gmail.com>.
Jun, the question is whether or not you can increase the replication factor
of a partition through the partition reassignment tool or not. I think you
can but I'm not sure until I test this.
Thanks,
Neha
On Thu, May 9, 2013 at 7:58 AM, Jun Rao <ju...@gmail.com> wrote:
> Currently, we don't allow the replication factor of an existing
> topic/partition to be changed. We plan to add a tool to do that in the
> future.
>
> Thanks,
>
> Jun
>
>
> On Wed, May 8, 2013 at 11:52 PM, Jason Rosenberg <jb...@squareup.com> wrote:
>
> > so does that, thereby, allow you to increase the replication for a
> > partition?
> >
> >
> > On Wed, May 8, 2013 at 10:48 PM, Neha Narkhede <neha.narkhede@gmail.com
> > >wrote:
> >
> > > If you add more brokers to an existing cluster, you can use the
> partition
> > > reassignment admin tool to move a replica of selected partitions over
> to
> > > the new broker.
> > >
> > > Thanks,
> > > Neha
> > >
> > >
> > > On Wed, May 8, 2013 at 10:27 PM, Jason Rosenberg <jb...@squareup.com>
> > wrote:
> > >
> > > > It looks like by default, the first time a new message arrives for a
> > > given
> > > > topic, it will receive the default replication factor in place on the
> > > > broker at the time it is first received.
> > > >
> > > > Is it possible to change this later (e.g. say if we add more hardware
> > to
> > > > the cluster at a later date, etc.)?
> > > >
> > > > Thanks,
> > > >
> > > > Jason
> > > >
> > >
> >
>
Re: can the replication factor for a topic be changed after it's created?
Posted by Jun Rao <ju...@gmail.com>.
Currently, we don't allow the replication factor of an existing
topic/partition to be changed. We plan to add a tool to do that in the
future.
Thanks,
Jun
On Wed, May 8, 2013 at 11:52 PM, Jason Rosenberg <jb...@squareup.com> wrote:
> so does that, thereby, allow you to increase the replication for a
> partition?
>
>
> On Wed, May 8, 2013 at 10:48 PM, Neha Narkhede <neha.narkhede@gmail.com
> >wrote:
>
> > If you add more brokers to an existing cluster, you can use the partition
> > reassignment admin tool to move a replica of selected partitions over to
> > the new broker.
> >
> > Thanks,
> > Neha
> >
> >
> > On Wed, May 8, 2013 at 10:27 PM, Jason Rosenberg <jb...@squareup.com>
> wrote:
> >
> > > It looks like by default, the first time a new message arrives for a
> > given
> > > topic, it will receive the default replication factor in place on the
> > > broker at the time it is first received.
> > >
> > > Is it possible to change this later (e.g. say if we add more hardware
> to
> > > the cluster at a later date, etc.)?
> > >
> > > Thanks,
> > >
> > > Jason
> > >
> >
>
Re: can the replication factor for a topic be changed after it's created?
Posted by Neha Narkhede <ne...@gmail.com>.
I think so but this hasnt been tested.
Thanks,
Neha
On May 8, 2013 11:52 PM, "Jason Rosenberg" <jb...@squareup.com> wrote:
> so does that, thereby, allow you to increase the replication for a
> partition?
>
>
> On Wed, May 8, 2013 at 10:48 PM, Neha Narkhede <neha.narkhede@gmail.com
> >wrote:
>
> > If you add more brokers to an existing cluster, you can use the partition
> > reassignment admin tool to move a replica of selected partitions over to
> > the new broker.
> >
> > Thanks,
> > Neha
> >
> >
> > On Wed, May 8, 2013 at 10:27 PM, Jason Rosenberg <jb...@squareup.com>
> wrote:
> >
> > > It looks like by default, the first time a new message arrives for a
> > given
> > > topic, it will receive the default replication factor in place on the
> > > broker at the time it is first received.
> > >
> > > Is it possible to change this later (e.g. say if we add more hardware
> to
> > > the cluster at a later date, etc.)?
> > >
> > > Thanks,
> > >
> > > Jason
> > >
> >
>
Re: can the replication factor for a topic be changed after it's created?
Posted by Jason Rosenberg <jb...@squareup.com>.
so does that, thereby, allow you to increase the replication for a
partition?
On Wed, May 8, 2013 at 10:48 PM, Neha Narkhede <ne...@gmail.com>wrote:
> If you add more brokers to an existing cluster, you can use the partition
> reassignment admin tool to move a replica of selected partitions over to
> the new broker.
>
> Thanks,
> Neha
>
>
> On Wed, May 8, 2013 at 10:27 PM, Jason Rosenberg <jb...@squareup.com> wrote:
>
> > It looks like by default, the first time a new message arrives for a
> given
> > topic, it will receive the default replication factor in place on the
> > broker at the time it is first received.
> >
> > Is it possible to change this later (e.g. say if we add more hardware to
> > the cluster at a later date, etc.)?
> >
> > Thanks,
> >
> > Jason
> >
>
Re: can the replication factor for a topic be changed after it's created?
Posted by Neha Narkhede <ne...@gmail.com>.
If you add more brokers to an existing cluster, you can use the partition
reassignment admin tool to move a replica of selected partitions over to
the new broker.
Thanks,
Neha
On Wed, May 8, 2013 at 10:27 PM, Jason Rosenberg <jb...@squareup.com> wrote:
> It looks like by default, the first time a new message arrives for a given
> topic, it will receive the default replication factor in place on the
> broker at the time it is first received.
>
> Is it possible to change this later (e.g. say if we add more hardware to
> the cluster at a later date, etc.)?
>
> Thanks,
>
> Jason
>