[GitHub] [pulsar] heesung-sn commented on issue #18215: PIP-220: TransferShedder

[GitBox <gi...@apache.org>]

heesung-sn commented on issue #18215:
URL: https://github.com/apache/pulsar/issues/18215#issuecomment-1297415377

   Hi,
   
   Regarding ` More aggressive load balance strategy `, I think the idea here
   is similar from #17456 <https://github.com/apache/pulsar/pull/17456>.
   Even if no global shedding condition is met (here the shedding condition is
   std-based instead of avg threshold), and if the min resource usage broker
   is having no traffic, this pip is still trying to transfer load from max to
   min broker.
   
   Yes. This pip proposes standard deviation to model the load balance
   optimization problem. There will be metrics(e.g. bundle_transfer_epoch,
   bundle_transfer_count, broker_load_std, broker_load_avg) to show how many
   bundle_transfer_count(epochs) are taken to reach the target(target_std).
   (bundle_transfer_epoch is reset to zero once the running std reaches
   target_std). In this way, we can clearly monitor the time(epochs) and
   bundle_transfer_count to reach the target load distribution. Accordingly,
   one could tune the load balance configs like max_transfer_cnt you mentioned.
   
   Regards,
   Heesung
   
   
   
   
   
   
   
   On Sun, Oct 30, 2022 at 7:02 PM Penghui Li ***@***.***> wrote:
   
   > I think the part of More aggressive load balance strategy mentioned in
   > this proposal is resolved by #17456
   > <https://github.com/apache/pulsar/pull/17456>
   >
   > For the load balance epochs. I'm not if I understand it correctly. Is it
   > will expose metrics or something to help to tune the max_transfer_cnt?
   >
   > —
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/pulsar/issues/18215#issuecomment-1296442299>,
   > or unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AYVJ675NMQQHDTTAVPLRUXTWF4SDBANCNFSM6AAAAAARPSHN6Q>
   > .
   > You are receiving this because you authored the thread.Message ID:
   > ***@***.***>
   >
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org