[GitHub] [spark] maryannxue opened a new pull request #25471: [SPARK-28753][SQL] Dynamically reuse subqueries in AQE

[GitBox <gi...@apache.org>]

maryannxue opened a new pull request #25471: [SPARK-28753][SQL] Dynamically reuse subqueries in AQE
URL: https://github.com/apache/spark/pull/25471
 
 
   ### What changes were proposed in this pull request?
   This PR changes subquery reuse in Adaptive Query Execution from compile-time static reuse to execution-time dynamic reuse. This PR adds a `ReuseAdaptiveSubquery` rule that applies to a query stage after it is created and before it is executed. The new dynamic reuse enables subqueries to be reused across all different subquery levels.
   
   ### Why are the changes needed?
   This is an improvement to the current subquery reuse in Adaptive Query Execution, which allows subquery reuse to happen in a lazy fashion as well as at different subquery levels.
   
   ### Does this PR introduce any user-facing change?
   No.
   
   ### How was this patch tested?
   Passed existing tests.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org