[GitHub] [pulsar] rdhabalia opened a new pull request #5797: PIP-52: [pulsar-sever] Add support of dispatch throttling relative to publish-rate

[GitBox <gi...@apache.org>]

rdhabalia opened a new pull request #5797: PIP-52: [pulsar-sever] Add support of dispatch throttling relative to publish-rate
URL: https://github.com/apache/pulsar/pull/5797
 
 
   ### Motivation
   With [PIP-3](https://github.com/apache/pulsar/wiki/PIP-3:-Message-dispatch-throttling) , Pulsar broker already supports to configure dispatch rate-limiting for a given topic. Dispatch-throttling feature allows user to configure absolute dispatch rate based on current publish-rate for a given topic or subscriber, and broker will make sure to dispatch only configured number of messages to the consumers regardless current publish-rate or backlog on that topic.
   
   Current dispatch-rate limiting doesn't consider change in publish-rate so, increasing publish-rate on the topic might be larger than configured dispatch-rate which will cause backlog on the topic and consumers will never be able to catch up the backlog unless user again reconfigured the dispatch-rate based on current publish-rate. Reconfiguring dispatch-rate based on publish-rate requires human interaction and monitoring. Therefore, we need a mechanism to configure dispatch rate relative to the current publish-rate on the topic.
   
   ### Modification
   `set-dispatch-rate` cli have a flag `--relative-to-publish-rate` to enable relative dispatch throttling.
   
   ```
   pulsar-admin namespaces <property/cluster/namespace> set-dispatch-rate --msg-dispatch-rate 1000 --relative-to-publish-rate
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services