You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/12/27 03:27:48 UTC

[GitHub] [pulsar] startjava created a discussion: doc:key shared

GitHub user startjava created a discussion: doc:key shared

 the broker will allow it to receive messages knowing some messages of that key may be still be processing in other consumers at the time, thus order may be affected for that short period of adding a new consumer.

" the broker will allow it to receive messages"  allow new consumer receive read position after message ??
" the broker will allow it to receive messages"  allow new consumer receive same key's message ??

@asafm 
i have top 2 question , thank you !

GitHub link: https://github.com/apache/pulsar/discussions/19070

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] asafm added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user asafm added a comment to the discussion: doc:key shared

Yes. You can try that pretty easily :)

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4503273

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] startjava edited a discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user startjava edited a discussion: doc:key shared

 the broker will allow it to receive messages knowing some messages of that key may be still be processing in other consumers at the time, thus order may be affected for that short period of adding a new consumer.

" the broker will allow it to receive messages"  allow new consumer receive read position after message ??
" the broker will allow it to receive messages"  allow new consumer receive same key or no same key message ??

@asafm 
i have top 2 question , thank you !

GitHub link: https://github.com/apache/pulsar/discussions/19070

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] asafm added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user asafm added a comment to the discussion: doc:key shared

>no time-out was defined (acknowledging for you)

Yes, there is no timeout. That's the trade-off. 

>"acknowledging for you" mean "consumer ack"?

Yes, consumer ack.

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4503271

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] asafm added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user asafm added a comment to the discussion: doc:key shared

For clarity for other people as well, I'll attach the full quote taken from the [documentation](https://pulsar.apache.org/docs/next/concepts-messaging/#preserving-order-of-processing) site regarding Key Shared Subscription

> That requirement can be relaxed by enabling `allowOutOfOrderDelivery` via the Consumer API. If set on the new consumer, then when it is connected, the broker will allow it to receive messages knowing some messages of that key may be still be processing in other consumers at the time, thus order may be affected for that short period of adding a new consumer.

Answering your first question: 
> " the broker will allow it to receive messages" allow new consumer receive read position after message ??

I'm assuming you mean to ask if the new consumer will be allowed to receive messages after the read position when that flag is enabled; then, from my understanding, yes.

Regarding your second question:
> " the broker will allow it to receive messages" allow new consumer receive same key or no same key message ??

The new consumer will be in charge of certain keys, right? Those keys are always taken from existing consumers. So it might be possible that certain messages of key K1 were delivered to C2, and when C_New joined, messages of K1 from now on will be delivered to C_New. The thing is that when that flag is enabled, the broker won't wait for C2 to finish processing messages with key K1 (acknowledge) but will simply start delivering messages from read position to C_New with key K1. 
 
I hope I managed to answer, if not please help me by clarifying your questions @startjava .

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4501261

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] KarenBrown7792 added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user KarenBrown7792 added a comment to the discussion: doc:key shared

Come and lets have fun https://vk.sv/m9HAtJ
@WelysonSR @backcost @Pedroarthur1999 @viniciussalvarenga @edurib17 @gothmate @maiarasteffen @arminZolfaghari @tamirysnogueira @russiann @ManfredHerrmann @ssashita @Hantsouski @zenfulwoman @karandotg @jbeasley123 @disturber @subhajit007 @mpnkhan @eshad @jaison-github @nicknow @navinmishra1717 @14Payalgupta @mebwel @Amarashujaa @IvayloFilipov @scm-nayhlaingwin @GuiLima2304 @quynt8313 @SelahattinApti @marta-sampaio @veena-02 @Qter @son0nline @hashsaksham @soft24technologies @Merisa-M @wangaofang @fraser125 @aang7 @alexstrive @dnyakola @goldreb @vmedar @fahimafsercse @Dimon4uk @vikzo @MunirRizwan @durk1234
Meet me here https://link.sv/XXEZlQ

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4529829

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] startjava deleted a comment on the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user startjava deleted a comment on the discussion: doc:key shared

thank you asafm 。
if broker queue have:
```
message1(keyA)
message2(keyA)
message3(keyA)
message4(keyA)
message5(keyA)
message6(keyB)
message7(keyB)
message8(keyA)
message9(keyA)
```
C2 now read position:
```
message1(keyA)
message2(keyA)
message3(keyA)
message4(keyA)
message5(keyA)
C2 now read position
message6(keyB)
message7(keyB)
message8(keyA)
message9(keyA)
```
next step C_New Connected,“Those keys are always taken from existing consumers.”,so C_New receive message8?



GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4501437

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] MichelleRodriguez7271 added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user MichelleRodriguez7271 added a comment to the discussion: doc:key shared

Who want to see my nudes https://to.sv/kJtGSX
@RHodzelmans @jdnlab @badarahmed @wodeamd @dalalsurender @hex108 @cknowles @jagadeeshops @bes @YuPengZTE @tsaxon13 @yarntime @sohale @davgordo @qsfang @ramkrsna @th3ee-pop @dpudev @YuBenhao @poonmusk @kodemonki @gauravmuk @nicktt90 @kutsokon @olefirenko @def-liuxu @ahmed563 @Olian04 @franciscorafart @xuxihai123 @yesitsfebreeze @NataliaGaravito @shelb-doc @renatovanquish @NatasaMilentijevic @ricardgo403 @sfemikey @e-gunn @nickarocho @lluthus @asif-kamal @Reprak11 @medelman17 @Rayna83 @asifbd @rabiaelkabir @FrenzyExists @matheushsouza @haider2017 @Anjireddy4246
More photo goo https://go.sv/ntAaaa

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4543638

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] startjava added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user startjava added a comment to the discussion: doc:key shared

message6 and message7 which consumer process?

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4501441

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] startjava deleted a comment on the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user startjava deleted a comment on the discussion: doc:key shared

message6 and message7 which consumer process?

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4501441

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] startjava added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user startjava added a comment to the discussion: doc:key shared

i understand:
(1)disable allowOutOfOrderDelivery:all message ack , next step ,new consumer receive message
(2)enable allowOutOfOrderDelivery:no all message ack, next step ,new consumer receive message
Am I getting this right?thank you !

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4501696

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] startjava added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user startjava added a comment to the discussion: doc:key shared

no time-out was defined (acknowledging for you)

"acknowledging for you" mean "consumer ack"?

GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4501595

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org


[GitHub] [pulsar] startjava added a comment to the discussion: doc:key shared

Posted by GitBox <gi...@apache.org>.
GitHub user startjava added a comment to the discussion: doc:key shared

thank you asafm 。
if broker queue have:
```
message1(keyA)
message2(keyA)
message3(keyA)
message4(keyA)
message5(keyA)
message6(keyB)
message7(keyB)
message8(keyA)
message9(keyA)
```
C2 now read position:
```
message1(keyA)
message2(keyA)
message3(keyA)
message4(keyA)
message5(keyA)
C2 now read position
message6(keyB)
message7(keyB)
message8(keyA)
message9(keyA)
```
next step C_New Connected,“Those keys are always taken from existing consumers.”,so C_New receive message8?



GitHub link: https://github.com/apache/pulsar/discussions/19070#discussioncomment-4501437

----
This is an automatically sent email for commits@pulsar.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@pulsar.apache.org