You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pulsar.apache.org by Yuri Mizushima <yu...@yahoo-corp.jp> on 2023/07/11 04:54:53 UTC

[DISCUSS] PIP-282: Change definition of the recently joined consumers position

Hi, Pulsar Community

I opened a new PIP design PR.
I am looking forward to your feedback.

https://github.com/apache/pulsar/pull/20776


Motivation

Key_Shared has a mechanism called the "recently joined consumers" to keep message ordering.
However, currently, it doesn't care about some corner cases.

1. [issue-1] The race condition in the "recently joined consumers", where consumers can be added before finishing reading and dispatching messages from ledgers.
2. [issue-2] Messages could be added to messagesToRedeliver without consumer-side operations such as unacknowledgement.

We should care about these cases in Key_Shared subscription.

Thanks,

--
Yuri Mizushima
yumizush@yahoo-corp.jp

Re: [DISCUSS] PIP-282: Change definition of the recently joined consumers position

Posted by Yubiao Feng <yu...@streamnative.io.INVALID>.

+1

Thanks
Yubiao Feng

On Tue, Jul 11, 2023 at 12:55 PM Yuri Mizushima <yu...@yahoo-corp.jp>
wrote:

> Hi, Pulsar Community
>
> I opened a new PIP design PR.
> I am looking forward to your feedback.
>
> https://github.com/apache/pulsar/pull/20776
>
>
> Motivation
>
> Key_Shared has a mechanism called the "recently joined consumers" to keep
> message ordering.
> However, currently, it doesn't care about some corner cases.
>
> 1. [issue-1] The race condition in the "recently joined consumers", where
> consumers can be added before finishing reading and dispatching messages
> from ledgers.
> 2. [issue-2] Messages could be added to messagesToRedeliver without
> consumer-side operations such as unacknowledgement.
>
> We should care about these cases in Key_Shared subscription.
>
> Thanks,
>
> --
> Yuri Mizushima
> yumizush@yahoo-corp.jp
>
>