You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/07/22 08:27:33 UTC
[GitHub] [pulsar] pg2404 opened a new issue #7626: Acknowledging list of messages in Pulsar consumer java client
pg2404 opened a new issue #7626:
URL: https://github.com/apache/pulsar/issues/7626
My project uses Apache pulsar for distributed messaging. While using the java consumer client I am facing an issue with acknowledgement of multiple messages in a single shot. The java consumer client as of now does not define any method for acknowledging a list of message ids.
I cannot use the cumulative acknowledge in this scenario – as the batch of messages that my consumer client receives requires an ordering based on few pre-defined message metadata – therefore the natural ordering of messages as received from broker is lost at the point where I am in a position to acknowledge the messages. Also looping through list of messages and sending acks per message is too much of a traffic overhead as in my use case I can expect 5000 messages per batch.
For scenarios like this, it would probably help to have a single non-blocking method call for a list of message ids – something similar to : CompletableFuture<Void> acknowledgeAsync(List<Message<?>> message);
My project uses Apache pulsar for distributed messaging. While using the java consumer client I am facing an issue with acknowledgement of multiple messages in a single shot. The java consumer client as of now does not define any method for acknowledging a list of message ids.
I cannot use the cumulative acknowledge in this scenario – as the batch of messages that my consumer client receives requires an ordering based on few pre-defined message metadata – therefore the natural ordering of messages as received from broker is lost at the point where I am in a position to acknowledge the messages. Also looping through list of messages and sending acks per message is too much of a traffic overhead as in my use case I can expect 5000 messages per batch.
For scenarios like this, it would probably help to have a single non-blocking method call for a list of message ids – something similar to : CompletableFuture<Void> acknowledgeAsync(List<Message<?>> message);
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] pg2404 commented on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
pg2404 commented on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-671900059
Hi @315157973 @codelipenghui -are the changes available in 2.6.0 ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] jiazhai commented on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
jiazhai commented on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-662781504
Thanks, @pg2404 There was already a simlar interface : "CompletableFuture<Void> acknowledgeAsync(Messages<?> messages)".
If this is not enough for your use case, It should be not hard to turn it into the interface that you want.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] pg2404 commented on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
pg2404 commented on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-664141511
@jiazhai - Thanks for the prompt reply. I am looking at http://pulsar.apache.org/api/client/2.2.0/org/apache/pulsar/client/impl/ConsumerBase.html for documentation of the interface you mentioned - but unfortunately I could not find any further information on the usage of the API - for instance how to build the Messages object / if it is similar to java Collection. Can you please point me to any documentation on this interface?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-671952028
@pg2404 2.6.0 has released before creating this issue, so we can't onboard it in 2.6.0.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-666080026
@pg2404 Could you please take a look matteo's comment https://github.com/apache/pulsar/pull/7688#issuecomment-665843163?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] pg2404 edited a comment on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
pg2404 edited a comment on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-666381918
Thanks @codelipenghui - just did and replied on that thread.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui closed issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
codelipenghui closed issue #7626:
URL: https://github.com/apache/pulsar/issues/7626
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] 315157973 commented on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
315157973 commented on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-664104346
Please assign it to me
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] pg2404 commented on issue #7626: Acknowledging list of messages in Pulsar consumer java client
Posted by GitBox <gi...@apache.org>.
pg2404 commented on issue #7626:
URL: https://github.com/apache/pulsar/issues/7626#issuecomment-666381918
Thanks @codelipenghui - just did and replied to on that thread.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org