You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2023/01/16 10:08:51 UTC

[GitHub] [spark] czxm commented on pull request #39595: [SPARK-38230][SQL] InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

czxm commented on PR #39595:
URL: https://github.com/apache/spark/pull/39595#issuecomment-1383797904

   The initial commit caused some insertion cases failed, and they were due to dynamic partition which has custom locations.  So a new flag "spark.sql.hasCustomPartitionLocations" is added to let users decide if listPartitionNames can be used here.
   
   Sorry for missing this case. I also updated the PR description as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org