You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/06/15 16:18:08 UTC
[GitHub] [pulsar] codelipenghui opened a new issue #7280: Support zero queue consumer for partitioned topic.
codelipenghui opened a new issue #7280:
URL: https://github.com/apache/pulsar/issues/7280
**Is your feature request related to a problem? Please describe.**
Currently, the zero queue consumer just can subscribe to a non-partitioned topic. In some case, we need to use zero queue consumer to subscribe to a partitioned topic.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] sundar-10 commented on issue #7280: Support zero queue consumer for partitioned topic.
Posted by GitBox <gi...@apache.org>.
sundar-10 commented on issue #7280:
URL: https://github.com/apache/pulsar/issues/7280#issuecomment-645386836
Hello, I am planning to work on this issue. I am planning to read how zero queue consumer is subscribed to a nonpartitioned topic and proceed from there by getting some kind of input for which partition this consumer should be subscribed to and so on. Can you tell me where to find the code related to this?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #7280: Support zero queue consumer for partitioned topic.
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #7280:
URL: https://github.com/apache/pulsar/issues/7280#issuecomment-791400497
@merlimat How about syncing the backlog between the broker and client periodically. Treat topics with more backlogs as a high priority. Since we don't know if a topic will there be any messages written, to avoid a consumer block to one topic(no more data are written), we can reset the permits in a sync cycle if there are topics that have more backlog, looks like
1. reset permits to 0
2. re-order the consumers
3. trigger read data from the high priority consumer
Users can achieve the desired purpose by setting the frequency of synchronization.
We can optimize the sync mechanism, e.g. carry the backlog when dispatching messages. Only if the message is not dispatched for a period of time, perform a separate sync command.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] merlimat commented on issue #7280: Support zero queue consumer for partitioned topic.
Posted by GitBox <gi...@apache.org>.
merlimat commented on issue #7280:
URL: https://github.com/apache/pulsar/issues/7280#issuecomment-644238363
It’s not enabled because we cannot know which partition the next message will be coming from. Any suggestion on how to achieve that?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] codelipenghui commented on issue #7280: Support zero queue consumer for partitioned topic.
Posted by GitBox <gi...@apache.org>.
codelipenghui commented on issue #7280:
URL: https://github.com/apache/pulsar/issues/7280#issuecomment-791393963
@sundar-10 You can check the `ZeroQueueConsumerImpl`.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org