You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/03/26 04:04:18 UTC

[GitHub] [arrow-datafusion] Ted-Jiang edited a comment on pull request #2060: Change log level for noisy logs

Ted-Jiang edited a comment on pull request #2060:
URL: https://github.com/apache/arrow-datafusion/pull/2060#issuecomment-1079594124


   > Hi, @Ted-Jiang @yahoNanJing
   > 
   > I think in the pull based task assignment model, if the system is idle, maybe we should let the executor slow down the polling interval. Otherwise there will be too many RPCs between Scheduler and Executor if there are many Executor nodes in the system even when the system is idle.
   
   Thanks @mingmwang  its a good idea. Now we hard code it in 1 mins:
   https://github.com/apache/arrow-datafusion/blob/8de2a7610df33adf75ba515c4ee2fe935f7aa114/ballista/rust/executor/src/executor_server.rs#L263
   How to test the best interval is a problem. @mingmwang  ans suggestions 😊?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org