You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/03/01 11:50:00 UTC
[jira] [Commented] (PARQUET-2252) Make some methods public to allow external projects to implement page skipping
[ https://issues.apache.org/jira/browse/PARQUET-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17695022#comment-17695022 ]
ASF GitHub Bot commented on PARQUET-2252:
-----------------------------------------
zhongyujiang opened a new pull request, #1038:
URL: https://github.com/apache/parquet-mr/pull/1038
…implement page skipping.
Issue: [PARQUET-2252](https://issues.apache.org/jira/browse/PARQUET-2252)
This PR makes some methods required to implement column index filter public to allow Iceberg build its own column index filtering. Since Iceberg is going to calculate `RowRanges` itself, this also adds a public method in `ParquetFileReader` that allows users to pass in `RowRanges` to read filtered row group. Use of these changes can refer to this [PR](https://github.com/apache/iceberg/pull/6967), currently it uses reflection as a workaround.
> Make some methods public to allow external projects to implement page skipping
> ------------------------------------------------------------------------------
>
> Key: PARQUET-2252
> URL: https://issues.apache.org/jira/browse/PARQUET-2252
> Project: Parquet
> Issue Type: New Feature
> Reporter: Yujiang Zhong
> Priority: Major
>
> Iceberg hopes to implement the column index filter based on Iceberg's own expressions, we would like to be able to use some of the methods in Parquet repo, for example: methods in `RowRanges` and `IndexIterator`, however these are currently not public. Currently we can only rely on reflection to use them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)