[GitHub] [arrow-ballista] Dandandan opened a new issue, #387: Implement Adaptive query execution

[GitBox <gi...@apache.org>]

Dandandan opened a new issue, #387:
URL: https://github.com/apache/arrow-ballista/issues/387

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   Adaptive query execution is the re-optimization of the query pipeline.
   This allows for faster complex queries, as joins and other.
   
   The pull/stage based model of Ballista allows for implementing a similar strategy as Spark.
   
   **Describe the solution you'd like**
   
   * When a stage has been finished: provide/update the statistics (row count / byte size) for the remaining stages
   * Re-optimize the different stages based on (exact) stats. We can start with running only the physical optimization passes (join order, aggregate statistics, others) as we already converted the logical plan to the physical plan.
   
   **Describe alternatives you've considered**
   
   **Additional context**
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org