You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "XiaoHongbo-Hope (via GitHub)" <gi...@apache.org> on 2026/09/19 02:26:27 UTC
[PR] [rust] Honor parquet.filter.columnindex.enabled for page pruning [paimon-rust]
XiaoHongbo-Hope opened a new pull request, #875:
URL: https://github.com/apache/paimon-rust/pull/875
## Summary
- honor `parquet.filter.columnindex.enabled` with a Java-compatible default of `true`
- skip ColumnIndex/OffsetIndex loading and predicate page pruning when disabled while preserving row selection and row-group pruning semantics
- propagate the option through raw, primary-key, data-evolution, format-table, audit, and search read paths
- document the request-count versus bytes-read tradeoff
This option affects reads only; it does not change Page Index generation.
## Tests
- `cargo fmt --all -- --check`
- `cargo clippy -p paimon --lib -- -D warnings`
- `cargo test -p paimon arrow::format::parquet::tests` (55 passed)
- `cargo test -p paimon spec::core_options::tests` (77 passed)
- `cargo test -p paimon a_dynamic_copy_can_disable_parquet_page_indexes`
The local `TrackingFileRead` tests verify that disabling Page Index keeps predicate and explicit row-selection results unchanged while falling back to coarser reads.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [rust] Add parquet.filter.columnindex.enabled option to control Page Index pruning [paimon-rust]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #875:
URL: https://github.com/apache/paimon-rust/pull/875#issuecomment-5747009874
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [rust] Add parquet.filter.columnindex.enabled option to control Page Index pruning [paimon-rust]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #875:
URL: https://github.com/apache/paimon-rust/pull/875
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org