You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "chenghuichen (via GitHub)" <gi...@apache.org> on 2026/04/17 09:12:10 UTC
[PR] [python] Push down SlicedSplit row range to Lance native [paimon]
chenghuichen opened a new pull request, #7666:
URL: https://github.com/apache/paimon/pull/7666
### Purpose
Previously, SlicedSplit row ranges on Lance files were applied in-memory via ShardBatchReader — the full file was read before discarding out-of-range rows. This change pushes the row range directly to `lance.file.LanceFileReader.read_range()`, so only the requested rows are read from disk, leveraging Lance's native random access capability.
### Tests
pypaimon/tests/reader_append_only_test.py
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [python] Push down SlicedSplit row range to Lance native [paimon]
Posted by "XiaoHongbo-Hope (via GitHub)" <gi...@apache.org>.
XiaoHongbo-Hope commented on PR #7666:
URL: https://github.com/apache/paimon/pull/7666#issuecomment-4275648584
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [python] Push down IndexedSplit row ranges to Lance reader [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #7666:
URL: https://github.com/apache/paimon/pull/7666
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [python] Push down IndexedSplit row ranges to Lance reader [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #7666:
URL: https://github.com/apache/paimon/pull/7666#issuecomment-4344476263
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org