You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/12/06 17:30:43 UTC

[GitHub] [arrow] lidavidm commented on a change in pull request #11858: ARROW-14737: [C++][Dataset] Support URI-decoding partition keys

lidavidm commented on a change in pull request #11858:
URL: https://github.com/apache/arrow/pull/11858#discussion_r763220893



##########
File path: cpp/src/arrow/dataset/partition.h
##########
@@ -106,6 +106,8 @@ struct ARROW_DS_EXPORT KeyValuePartitioningOptions {
   /// After splitting a path into components, decode the path components
   /// before parsing according to this scheme.
   SegmentEncoding segment_encoding = SegmentEncoding::Uri;
+  // Should the key be decoded according to the scheme above too
+  bool decode_key = false;

Review comment:
       For reference, I tried to get PySpark to create a partition key with %-encoded paths but it doesn't seem to do the encoding on local file system.
   
   However, I think we can just apply the decoding unilaterally here.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org