You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by Cong Zhao <zh...@apache.org> on 2022/07/25 02:22:00 UTC
[DISCUSS] PIP-195: New bucket based delayed message tracker
Hello Pulsar Community,
I would like to open a discussion here about PIP-195 : New bucket based
delayed message tracker. I look forward to your feedback.
PIP: https://github.com/apache/pulsar/issues/16763
Thanks,
Cong Zhao
Re: [DISCUSS] PIP-195: New bucket based delayed message tracker
Posted by Gavin Gao <zh...@apache.org>.
+1
On 2022/07/25 02:22:00 Cong Zhao wrote:
> Hello Pulsar Community,
>
>
> I would like to open a discussion here about PIP-195 : New bucket based
> delayed message tracker. I look forward to your feedback.
>
>
> PIP: https://github.com/apache/pulsar/issues/16763
>
>
> Thanks,
>
> Cong Zhao
>
Re: [DISCUSS] PIP-195: New bucket based delayed message tracker
Posted by PengHui Li <pe...@apache.org>.
+1
Penghui
On Mon, Aug 1, 2022 at 11:16 PM Cong Zhao <zh...@apache.org> wrote:
> Hi Penghui,
> Thanks for your feed.
>
> I have added them, please see the proposal again.
>
> Thanks,
> Cong Zhao
>
> On 2022/07/29 05:08:10 PengHui Li wrote:
> > We should also add a part for observability. Add some metrics to the
> delayed index buckets and snapshots will help users to tune the
> > configurations.
> >
> > And please add a section to describe the upgrade and downgrade.
> >
> > +1 for the proposal
> >
> > Penghui
> > On Jul 27, 2022, 23:50 +0800, Cong Zhao <zh...@apache.org>, wrote:
> > > Hi Enrico,
> > > Thanks for your feedback.
> > >
> > > > How do you enable this feature? A flag in broker.conf?
> > > Yes, we add a flag in broker.conf to enable this feature, I will
> update it
> > >
> > > > Is it possible to enable the feature by doing a rolling upgrade of
> the
> > > > brokers? What happens if you have brokers that are still running the
> old
> > > > tracker?
> > > I think it is possible to enable the feature by doing a rolling
> upgrade of the brokers, because the delayed message index in the old
> tracker only exists in the memory.
> > >
> > > > Is it possible to rollback seamlessly?
> > > It is possible to rollback seamlessly, the old memory tracker will
> rebuild the delayed message index.
> > >
> > > On 2022/07/27 06:19:28 Enrico Olivelli wrote:
> > > > Good proposal.
> > > >
> > > > How do you enable this feature? A flag in broker.conf?
> > > >
> > > > Is it possible to enable the feature by doing a rolling upgrade of
> the
> > > > brokers? What happens if you have brokers that are still running the
> old
> > > > tracker?
> > > >
> > > > Is it possible to rollback seamlessly?
> > > >
> > > > Enrico
> > > >
> > > > Il Mer 27 Lug 2022, 05:39 Dezhi Liu <de...@apache.org> ha
> scritto:
> > > >
> > > > > +1, good job.
> > > > >
> > > > > Thanks,
> > > > > Dezhi
> > > > >
> > > > > On 2022/07/25 02:22:00 Cong Zhao wrote:
> > > > > > Hello Pulsar Community,
> > > > > >
> > > > > >
> > > > > > I would like to open a discussion here about PIP-195 : New
> bucket based
> > > > > > delayed message tracker. I look forward to your feedback.
> > > > > >
> > > > > >
> > > > > > PIP: https://github.com/apache/pulsar/issues/16763
> > > > > >
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Cong Zhao
> > > > > >
> > > > >
> > > >
> > >
> > > Thanks,
> > > Cong Zhao
> >
>
Re: [DISCUSS] PIP-195: New bucket based delayed message tracker
Posted by Cong Zhao <zh...@apache.org>.
Hi Penghui,
Thanks for your feed.
I have added them, please see the proposal again.
Thanks,
Cong Zhao
On 2022/07/29 05:08:10 PengHui Li wrote:
> We should also add a part for observability. Add some metrics to the delayed index buckets and snapshots will help users to tune the
> configurations.
>
> And please add a section to describe the upgrade and downgrade.
>
> +1 for the proposal
>
> Penghui
> On Jul 27, 2022, 23:50 +0800, Cong Zhao <zh...@apache.org>, wrote:
> > Hi Enrico,
> > Thanks for your feedback.
> >
> > > How do you enable this feature? A flag in broker.conf?
> > Yes, we add a flag in broker.conf to enable this feature, I will update it
> >
> > > Is it possible to enable the feature by doing a rolling upgrade of the
> > > brokers? What happens if you have brokers that are still running the old
> > > tracker?
> > I think it is possible to enable the feature by doing a rolling upgrade of the brokers, because the delayed message index in the old tracker only exists in the memory.
> >
> > > Is it possible to rollback seamlessly?
> > It is possible to rollback seamlessly, the old memory tracker will rebuild the delayed message index.
> >
> > On 2022/07/27 06:19:28 Enrico Olivelli wrote:
> > > Good proposal.
> > >
> > > How do you enable this feature? A flag in broker.conf?
> > >
> > > Is it possible to enable the feature by doing a rolling upgrade of the
> > > brokers? What happens if you have brokers that are still running the old
> > > tracker?
> > >
> > > Is it possible to rollback seamlessly?
> > >
> > > Enrico
> > >
> > > Il Mer 27 Lug 2022, 05:39 Dezhi Liu <de...@apache.org> ha scritto:
> > >
> > > > +1, good job.
> > > >
> > > > Thanks,
> > > > Dezhi
> > > >
> > > > On 2022/07/25 02:22:00 Cong Zhao wrote:
> > > > > Hello Pulsar Community,
> > > > >
> > > > >
> > > > > I would like to open a discussion here about PIP-195 : New bucket based
> > > > > delayed message tracker. I look forward to your feedback.
> > > > >
> > > > >
> > > > > PIP: https://github.com/apache/pulsar/issues/16763
> > > > >
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Cong Zhao
> > > > >
> > > >
> > >
> >
> > Thanks,
> > Cong Zhao
>
Re: [DISCUSS] PIP-195: New bucket based delayed message tracker
Posted by PengHui Li <co...@gmail.com>.
We should also add a part for observability. Add some metrics to the delayed index buckets and snapshots will help users to tune the
configurations.
And please add a section to describe the upgrade and downgrade.
+1 for the proposal
Penghui
On Jul 27, 2022, 23:50 +0800, Cong Zhao <zh...@apache.org>, wrote:
> Hi Enrico,
> Thanks for your feedback.
>
> > How do you enable this feature? A flag in broker.conf?
> Yes, we add a flag in broker.conf to enable this feature, I will update it
>
> > Is it possible to enable the feature by doing a rolling upgrade of the
> > brokers? What happens if you have brokers that are still running the old
> > tracker?
> I think it is possible to enable the feature by doing a rolling upgrade of the brokers, because the delayed message index in the old tracker only exists in the memory.
>
> > Is it possible to rollback seamlessly?
> It is possible to rollback seamlessly, the old memory tracker will rebuild the delayed message index.
>
> On 2022/07/27 06:19:28 Enrico Olivelli wrote:
> > Good proposal.
> >
> > How do you enable this feature? A flag in broker.conf?
> >
> > Is it possible to enable the feature by doing a rolling upgrade of the
> > brokers? What happens if you have brokers that are still running the old
> > tracker?
> >
> > Is it possible to rollback seamlessly?
> >
> > Enrico
> >
> > Il Mer 27 Lug 2022, 05:39 Dezhi Liu <de...@apache.org> ha scritto:
> >
> > > +1, good job.
> > >
> > > Thanks,
> > > Dezhi
> > >
> > > On 2022/07/25 02:22:00 Cong Zhao wrote:
> > > > Hello Pulsar Community,
> > > >
> > > >
> > > > I would like to open a discussion here about PIP-195 : New bucket based
> > > > delayed message tracker. I look forward to your feedback.
> > > >
> > > >
> > > > PIP: https://github.com/apache/pulsar/issues/16763
> > > >
> > > >
> > > > Thanks,
> > > >
> > > > Cong Zhao
> > > >
> > >
> >
>
> Thanks,
> Cong Zhao
Re: [DISCUSS] PIP-195: New bucket based delayed message tracker
Posted by Cong Zhao <zh...@apache.org>.
Hi Enrico,
Thanks for your feedback.
> How do you enable this feature? A flag in broker.conf?
Yes, we add a flag in broker.conf to enable this feature, I will update it
> Is it possible to enable the feature by doing a rolling upgrade of the
> brokers? What happens if you have brokers that are still running the old
> tracker?
I think it is possible to enable the feature by doing a rolling upgrade of the brokers, because the delayed message index in the old tracker only exists in the memory.
> Is it possible to rollback seamlessly?
It is possible to rollback seamlessly, the old memory tracker will rebuild the delayed message index.
On 2022/07/27 06:19:28 Enrico Olivelli wrote:
> Good proposal.
>
> How do you enable this feature? A flag in broker.conf?
>
> Is it possible to enable the feature by doing a rolling upgrade of the
> brokers? What happens if you have brokers that are still running the old
> tracker?
>
> Is it possible to rollback seamlessly?
>
> Enrico
>
> Il Mer 27 Lug 2022, 05:39 Dezhi Liu <de...@apache.org> ha scritto:
>
> > +1, good job.
> >
> > Thanks,
> > Dezhi
> >
> > On 2022/07/25 02:22:00 Cong Zhao wrote:
> > > Hello Pulsar Community,
> > >
> > >
> > > I would like to open a discussion here about PIP-195 : New bucket based
> > > delayed message tracker. I look forward to your feedback.
> > >
> > >
> > > PIP: https://github.com/apache/pulsar/issues/16763
> > >
> > >
> > > Thanks,
> > >
> > > Cong Zhao
> > >
> >
>
Thanks,
Cong Zhao
Re: [DISCUSS] PIP-195: New bucket based delayed message tracker
Posted by Enrico Olivelli <eo...@gmail.com>.
Good proposal.
How do you enable this feature? A flag in broker.conf?
Is it possible to enable the feature by doing a rolling upgrade of the
brokers? What happens if you have brokers that are still running the old
tracker?
Is it possible to rollback seamlessly?
Enrico
Il Mer 27 Lug 2022, 05:39 Dezhi Liu <de...@apache.org> ha scritto:
> +1, good job.
>
> Thanks,
> Dezhi
>
> On 2022/07/25 02:22:00 Cong Zhao wrote:
> > Hello Pulsar Community,
> >
> >
> > I would like to open a discussion here about PIP-195 : New bucket based
> > delayed message tracker. I look forward to your feedback.
> >
> >
> > PIP: https://github.com/apache/pulsar/issues/16763
> >
> >
> > Thanks,
> >
> > Cong Zhao
> >
>
Re: [DISCUSS] PIP-195: New bucket based delayed message tracker
Posted by Dezhi Liu <de...@apache.org>.
+1, good job.
Thanks,
Dezhi
On 2022/07/25 02:22:00 Cong Zhao wrote:
> Hello Pulsar Community,
>
>
> I would like to open a discussion here about PIP-195 : New bucket based
> delayed message tracker. I look forward to your feedback.
>
>
> PIP: https://github.com/apache/pulsar/issues/16763
>
>
> Thanks,
>
> Cong Zhao
>