[jira] [Commented] (ARROW-13269) [C++] [Dataset] pyarrow.parquet.write_metadata does not allow common_metadata and _metadata schemas to differ

["Joris Van den Bossche (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-13269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377946#comment-17377946 ] 

Joris Van den Bossche commented on ARROW-13269:
-----------------------------------------------

[~westonpace] I don't fully understand your updated title. In the doc example, the {{_common_metadata}} and {{_metadata}} files are written with two separate {{pq.write_metadata}} calls, and so you can pass a different schema to each (eg {{table.schema}} for {{_common_metadata}} and {{table.select([.. all column except partitioning columns ..]).schema}} for {{_metadata}}).

> [C++] [Dataset] pyarrow.parquet.write_metadata does not allow common_metadata and _metadata schemas to differ
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-13269
>                 URL: https://issues.apache.org/jira/browse/ARROW-13269
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: C++
>    Affects Versions: 4.0.0
>            Reporter: Weston Pace
>            Priority: Major
>
> If there are partition columns specified then the writers will only write the non-partition columns and thus they will not contain the fields used for the partition.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)