Re: [PR] [SPARK-28346][SQL] clone the query plan between analyzer, optimizer and planner [spark]

["MasterDDT (via GitHub)" <gi...@apache.org>]

MasterDDT commented on PR #25111:
URL: https://github.com/apache/spark/pull/25111#issuecomment-1926322030

   @cloud-fan I'm seeing some memory issues because of all these clone calls. I have a big query tree, maybe 20-30 nodes, but all the clone calls are recursive and keep everything in the stack alive: https://gist.github.com/MasterDDT/af98ad20ab0ed301476b9e8c58d8f5bb
   
   In my fork, could I disable all the clone calls if AQE is off? Will that cause any issues?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org