[GitHub] [spark] viirya edited a comment on pull request #28846: [SPARK-32012][SQL] Incrementally create and materialize query stage to avoid unnecessary local shuffle

[GitBox <gi...@apache.org>]

viirya edited a comment on pull request #28846:
URL: https://github.com/apache/spark/pull/28846#issuecomment-646089689


   This change does not create and materialize all query stages of the join in a batch. It creates and materialize one stage first and then re-optimize the join. So once it makes the join as broadcast join, it won't create the unnecessary exchange.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org