You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by GitBox <gi...@apache.org> on 2022/03/18 21:29:00 UTC
[GitHub] [pinot] jackjlli opened a new issue #8371: Retain instance sequence for table rebalance
jackjlli opened a new issue #8371:
URL: https://github.com/apache/pinot/issues/8371
Currently when the table rebalance request is made, the list of instances will be sorted by the instance ids before the instance partition is formed. While when an instance with a smaller instance id got swapped out, its original segments will be assigned to the next available instance with a slightly larger instance id. In this case, all the segments will be moved around.
If we can retain the existing sequence of the instances and only replace the missing one, we can minimize the segment movement. This will be helpful for those large Pinot clusters to minimize the segment movement and avoid suddenly heavy write access to the deep storage.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[GitHub] [pinot] Jackie-Jiang commented on issue #8371: Retain instance sequence for table rebalance
Posted by GitBox <gi...@apache.org>.
Jackie-Jiang commented on issue #8371:
URL: https://github.com/apache/pinot/issues/8371#issuecomment-1072897100
We may add some strategy for instance assignment to allow minimum movement using some greedy algorithm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org