You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2023/12/06 08:23:28 UTC

Re: [PR] [SPARK-46279][SQL] Support write partition values to data files in FileFormatWritter [spark]

HyukjinKwon commented on code in PR #44195:
URL: https://github.com/apache/spark/pull/44195#discussion_r1416906431


##########
sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceUtils.scala:
##########
@@ -52,6 +52,11 @@ object DataSourceUtils extends PredicateHelper {
    */
   val PARTITION_OVERWRITE_MODE = "partitionOverwriteMode"
 
+  /**
+   * The key control if it should write partition columns to data files
+   */
+  val WRITE_PARTITION_COLUMNS = "writePartitionColumns"

Review Comment:
   We should probably document this in the user-facing documentation



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org