[GitHub] [iceberg] RussellSpitzer commented on pull request #5392: Spark: Fix a separate table cache being created for each rewriteFiles

[GitBox <gi...@apache.org>]

RussellSpitzer commented on PR #5392:
URL: https://github.com/apache/iceberg/pull/5392#issuecomment-1302378216

   > @manuzhang, it seems reasonable to create a session for the entire rewrite, not just each Spark submission. Is that what was happening before?
   
   Yes basically the old behavior would be to clone the Spark Session for each file group rewrite, rather than once for the entire action.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org