You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/08/01 08:53:25 UTC

[GitHub] [arrow-datafusion] Dandandan commented on issue #700: Improve performance polling / task sharing mechanism in Ballista

Dandandan commented on issue #700:
URL: https://github.com/apache/arrow-datafusion/issues/700#issuecomment-890478988


   I tried to to a part of this by moving the polling loop to the scheduler, but an important prerequisite to this is moving the number of free task slots information to the scheduler.
   
   Currently this information is kept in each executor and sent with the info during a polling call (`can_accept_task`).
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org