[jira] [Updated] (ARROW-10435) [C++][Dataset][Python] Improve ParquetFileFragment serialization

["Ben Kietzman (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-10435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ben Kietzman updated ARROW-10435:
---------------------------------
    Fix Version/s:     (was: 3.0.0)
                   4.0.0

> [C++][Dataset][Python] Improve ParquetFileFragment serialization
> ----------------------------------------------------------------
>
>                 Key: ARROW-10435
>                 URL: https://issues.apache.org/jira/browse/ARROW-10435
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>    Affects Versions: 2.0.0
>            Reporter: Ben Kietzman
>            Assignee: Ben Kietzman
>            Priority: Major
>              Labels: dataset
>             Fix For: 4.0.0
>
>
> After ARROW-10131 {{ParquetFileFragment}} wraps a FileMetaData, from which all its properties are queried. FileMetaData is emminently serializable, so when pickling a fragment with pre-loaded metadata it would save redundant IO to just serialize the metadata. (An unpickled fragment would then also have pre-loaded metadata.)
> https://github.com/apache/arrow/pull/8507#discussion_r512698380



--
This message was sent by Atlassian Jira
(v8.3.4#803005)