You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "ogego (Jira)" <ji...@apache.org> on 2022/07/06 15:39:00 UTC

[jira] [Created] (ARROW-16991) [C++][Parquet][Python] Add Parquet ColumnIndex and OffsetIndex support

ogego created ARROW-16991:
-----------------------------

             Summary: [C++][Parquet][Python] Add Parquet ColumnIndex and OffsetIndex support
                 Key: ARROW-16991
                 URL: https://issues.apache.org/jira/browse/ARROW-16991
             Project: Apache Arrow
          Issue Type: New Feature
          Components: C++, Parquet, Python
            Reporter: ogego


As documented here: [https://github.com/apache/parquet-format/blob/master/PageIndex.md]

The parquet format supports indexing of pages within a column chunk. Beyond what is accomplished by rowgroup statistics, this can further accelerate scanning.

As far as I am able to tell, Arrow does not currently support these indices (I see no references to `offset_index_offset`, `column_index_offset`, etc). Are there plans to add support, either in C++ or pyarrow?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)