You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@fluss.apache.org by "fhan688 (via GitHub)" <gi...@apache.org> on 2026/04/07 06:39:33 UTC

[PR] [lance] Implement Lance LakeSource read path with pushdown and enhanced split semantics [fluss]

fhan688 opened a new pull request, #3013:
URL: https://github.com/apache/fluss/pull/3013

   ### Purpose
   
   This PR implements the Lance read-path foundation for Fluss LakeSource by completing LakeSource -> Planner -> RecordReader, integrating pushdown parameters, and enriching split semantics for snapshot/fragment-aware planning and reading.
   
   Linked issue: https://github.com/apache/fluss/issues/2715
   
   ### Brief change log
   
   Implemented and wired Lance read-path core classes:
   
   - LanceLakeSource
   - LanceSplitPlanner
   - LanceRecordReader
   - LanceSplit
   - LanceSplitSerializer
   
   Completed storage-layer integration:
   
   - LanceLakeStorage#createLakeSource now returns the Lance source implementation
   
   Added pushdown integration:
   
   - projection / filter / limit
   
   - introduced LancePredicatePushDown for common predicate conversion
   
   Enhanced split semantics:
   
   - added fragmentId / snapshotId / fragmentRows / scanLimit / bucket / partition
   
   
   ### Tests
   
   - LanceSplitSerializerTest
   - LanceSplitPlannerTest
   - LanceRecordReaderTest
   - LanceSourceTestBase
   
   Fixed Java 8 test compatibility for lambda capture (effectively-final variables)
   Added JNI availability guard in test base to skip JNI-dependent tests in unsupported environments
   
   ### API and Format
   
   - No external API breaking changes
   - LanceSplit serialization now includes snapshot/fragment/limit/bucket/partition-related fields with versioned serializer handling
   - No incompatible external data format change introduced
   
   ### Documentation
   
   None
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [lake/lance] Implement Lance LakeSource read path with pushdown and enhanced split semantics [fluss]

Posted by "fhan688 (via GitHub)" <gi...@apache.org>.

fhan688 closed pull request #3013: [lake/lance] Implement Lance LakeSource read path with pushdown and enhanced split semantics
URL: https://github.com/apache/fluss/pull/3013


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org