You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "cristian-ilies-vasile (via GitHub)" <gi...@apache.org> on 2023/04/20 20:21:47 UTC

[GitHub] [arrow-datafusion] cristian-ilies-vasile commented on issue #6043: Improve RoundRobin `RepartitionExec`

cristian-ilies-vasile commented on issue #6043:
URL: https://github.com/apache/arrow-datafusion/issues/6043#issuecomment-1516898738

   _Batches should be distributed more evenly over output channels._
   
   Seems to be a load balancing issue. If you could count the number of batches already distributed to each channel and not completed then the classical The Power of Two Choices in Randomized Load Balancing algorithm could be evaluated.
    


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org