You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/03/10 19:21:48 UTC

[GitHub] [arrow-datafusion] yahoNanJing edited a comment on pull request #1935: Introduce query stage scheduler

yahoNanJing edited a comment on pull request #1935:
URL: https://github.com/apache/arrow-datafusion/pull/1935#issuecomment-1064404042


   Thanks @alamb and @thinkharderdev. Actually, I prefer step by step. Otherwise, like arrow2, it may hard to be merged.
   
   For the distributed task scheduling, there's still two PR left, #1935 and #1983. Actually, the most important PR is #1983. All of other PRs in this chain are for finally achieving #1983.
   
   I just finished it today. And I will do some load testing with my team tomorrow to see how the performance is improved.
   
   In the future, another important feature is to add task error recovering. I think it will be much easier to work it on this new task scheduling framework.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org