You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Debraj Manna <su...@gmail.com> on 2017/11/24 10:27:44 UTC
Recommended settings for Internal Topics
Hi
I am migrating from Kafka 0.10 to the latest 1.0 . I did not set any value
for these fields in Kafka 0.10. Can some one let me know what is the
recommended settings for a 3 node broker cluster & for a single node broker
cluster for the below internal topic settings -
- offsets.topic.replication.factor
- transaction.state.log.replication.factor
- transaction.state.log.min.isr
Thanks,
Re: Recommended settings for Internal Topics
Posted by Debraj Manna <su...@gmail.com>.
Thanks Jakub.
On Sun, Nov 26, 2017 at 4:20 AM, Jakub Scholz <ja...@scholz.cz> wrote:
> When you use the default replication factor of 3 with single node broker
> the offset and transaction topics will be never created. As a result
> applications using them will not work (for example a consumer using the
> offsets topic will not work). Kafka broker it self will keep running. Given
> how the clustering works it actually doesn't distinguish between running as
> a single node and running as the "first" node of the cluster - so it will
> not shutdown with error.
>
> Jakub
>
> On Sat, Nov 25, 2017 at 6:44 AM, Debraj Manna <su...@gmail.com>
> wrote:
>
> > Anyone any thoughts?
> >
> > If I am not changing this value after upgrade to 1.0 in a single node
> kafka
> > broker. It will take the default value of 3 . So what will be the
> behavior
> > in this case?
> >
> > On Fri, Nov 24, 2017 at 3:57 PM, Debraj Manna <su...@gmail.com>
> > wrote:
> >
> > > Hi
> > >
> > > I am migrating from Kafka 0.10 to the latest 1.0 . I did not set any
> > value
> > > for these fields in Kafka 0.10. Can some one let me know what is the
> > > recommended settings for a 3 node broker cluster & for a single node
> > broker
> > > cluster for the below internal topic settings -
> > >
> > >
> > > - offsets.topic.replication.factor
> > > - transaction.state.log.replication.factor
> > > - transaction.state.log.min.isr
> > >
> > >
> > > Thanks,
> > >
> >
>
Re: Recommended settings for Internal Topics
Posted by Jakub Scholz <ja...@scholz.cz>.
When you use the default replication factor of 3 with single node broker
the offset and transaction topics will be never created. As a result
applications using them will not work (for example a consumer using the
offsets topic will not work). Kafka broker it self will keep running. Given
how the clustering works it actually doesn't distinguish between running as
a single node and running as the "first" node of the cluster - so it will
not shutdown with error.
Jakub
On Sat, Nov 25, 2017 at 6:44 AM, Debraj Manna <su...@gmail.com>
wrote:
> Anyone any thoughts?
>
> If I am not changing this value after upgrade to 1.0 in a single node kafka
> broker. It will take the default value of 3 . So what will be the behavior
> in this case?
>
> On Fri, Nov 24, 2017 at 3:57 PM, Debraj Manna <su...@gmail.com>
> wrote:
>
> > Hi
> >
> > I am migrating from Kafka 0.10 to the latest 1.0 . I did not set any
> value
> > for these fields in Kafka 0.10. Can some one let me know what is the
> > recommended settings for a 3 node broker cluster & for a single node
> broker
> > cluster for the below internal topic settings -
> >
> >
> > - offsets.topic.replication.factor
> > - transaction.state.log.replication.factor
> > - transaction.state.log.min.isr
> >
> >
> > Thanks,
> >
>
Re: Recommended settings for Internal Topics
Posted by Debraj Manna <su...@gmail.com>.
Anyone any thoughts?
If I am not changing this value after upgrade to 1.0 in a single node kafka
broker. It will take the default value of 3 . So what will be the behavior
in this case?
On Fri, Nov 24, 2017 at 3:57 PM, Debraj Manna <su...@gmail.com>
wrote:
> Hi
>
> I am migrating from Kafka 0.10 to the latest 1.0 . I did not set any value
> for these fields in Kafka 0.10. Can some one let me know what is the
> recommended settings for a 3 node broker cluster & for a single node broker
> cluster for the below internal topic settings -
>
>
> - offsets.topic.replication.factor
> - transaction.state.log.replication.factor
> - transaction.state.log.min.isr
>
>
> Thanks,
>