You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "Wes McKinney (Jira)" <ji...@apache.org> on 2019/11/07 00:52:00 UTC

[jira] [Commented] (ARROW-7080) [Python][Parquet] Expose parquet field_id in Schema objects

    [ https://issues.apache.org/jira/browse/ARROW-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16968829#comment-16968829 ] 

Wes McKinney commented on ARROW-7080:
-------------------------------------

Please feel free. You can propagate it to the Arrow schema as field-level metadata if you like, too. 

> [Python][Parquet] Expose parquet field_id in Schema objects
> -----------------------------------------------------------
>
>                 Key: ARROW-7080
>                 URL: https://issues.apache.org/jira/browse/ARROW-7080
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Python
>            Reporter: Ted Gooch
>            Priority: Major
>             Fix For: 1.0.0
>
>
> I'm in the process of adding parquet read support to Iceberg([https://iceberg.apache.org/]), and we use the parquet field_ids as a consistent id when reading a parquet file to create a map between the current schema and the schema of the file being read.  Unless I've missed something, it appears that field_id is not exposed in the python APIs in pyarrow._parquet.ParquetSchema nor is it available in pyarrow.lib.Schema.
> Would it be possible to add this to either of those two objects?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)