You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/03/09 15:05:31 UTC

[GitHub] [arrow-datafusion] yahoNanJing commented on pull request #1935: Introduce query stage scheduler

yahoNanJing commented on pull request #1935:
URL: https://github.com/apache/arrow-datafusion/pull/1935#issuecomment-1063015346


   Hi @thinkharderdev, you are right. For #1908, #1909, #1910 and #1934, these 4 issues are mainly focusing on the refactoring and changing the scheduler server state changing to be event-based. 
   
   While for #1936, I'll introduce stage and the state machine for it. With the state machine of the job stage, it will be much easier and more efficient to do error handling, speculative execution. In general, event-based processing is very suitable for handling the state machine.
   
   However, the PR for #1936 is really complicated. I'm still working on it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org