[PR] feat(file_index): integrate pruning into raw data-file reads [paimon-rust]

["QuakeWang (via GitHub)" <gi...@apache.org>]

QuakeWang opened a new pull request, #783:
URL: https://github.com/apache/paimon-rust/pull/783

   ### Purpose
   
   Closes #780
   
   FileIndex outer-format support, Bitmap/Bloom readers, and predicate composition already existed, but production raw scans did not consume embedded indexes or `.index` sidecars. Therefore, Rust table reads could not use FileIndexes written by Java Paimon.
   
   ### Brief change log
   
   - Add `file-index.read.enabled`, defaulting to `true`, and enable it for ordinary, incremental, and audit raw reads.
   - Read embedded or aligned sidecar FileIndexes with Java-compatible precedence.
   - Evaluate indexes against conservatively remapped file-schema predicates while ignoring unsupported index identifiers.
   - Apply `Skip` and `Selection` before opening data files, intersecting selections with split row ranges and deletion vectors.
   - Preserve residual predicates and conservatively fall back for unsafe schema evolution or overly fragmented selections.
   - Add coverage for embedded and sidecar indexes, schema evolution, Bitmap/Bloom pruning, deletion vectors, row ranges, unsupported indexes, and enabled/disabled result equivalence.
   
   ### Tests
   
   - `cargo fmt --all -- --check`
   - `cargo clippy --locked --all-targets --workspace --features fulltext,vortex -- -D warnings`
   - `cargo test --locked -p paimon --all-targets --features fulltext,vortex`
   - `cargo test --locked -p paimon-rest-server --all-targets`
   
   ### API and Format
   
   No public API or storage-format changes. This reads existing Java-compatible FileIndex containers and Bitmap/Bloom payloads.
   
   ### Documentation
   
   No documentation changes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] feat(file_index): integrate pruning into raw data-file reads [paimon-rust]

["JingsongLi (via GitHub)" <gi...@apache.org>]

JingsongLi merged PR #783:
URL: https://github.com/apache/paimon-rust/pull/783


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org