You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "linliu-code (via GitHub)" <gi...@apache.org> on 2026/08/02 15:48:44 UTC

[PR] feat(core): port the record buffer and merge iterator [hudi-rs]

linliu-code opened a new pull request, #650:
URL: https://github.com/apache/hudi-rs/pull/650

   **Stacked on #639–#649** — their commits appear here until they merge. **Review only the last commit.**
   
   - `buffer` — defines what a record buffer is: takes log blocks, merges each record against what it already holds, hands back the result.
   - `buffer::record_buffer` — the shared machinery every implementation builds on: merge map, merger, delete context, update counting, wired together.
   - `merge_iterator` — drives the buffer, emitting the merged result **one batch at a time** rather than materializing the whole slice. This is what makes streaming MOR reads possible.
   
   ## One visibility change outside reader_v2
   
   `log_file::log_block` goes from private to `pub`. The buffer reads block metadata directly, and the module was already public in all but declaration — its types are reachable through `log_file::reader`. No behavior change.
   
   The re-exports in `buffer/mod.rs` for the concrete buffer implementations (`key_based`, `position_based`, `loader`) carry an `unused_imports` allow until those land.
   
   Build warning-free; 941 lib tests green.
   
   🤖 Generated with [Claude Code](https://claude.com/claude-code)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] feat(core): port the record buffer and merge iterator [hudi-rs]

Posted by "linliu-code (via GitHub)" <gi...@apache.org>.
linliu-code commented on PR #650:
URL: https://github.com/apache/hudi-rs/pull/650#issuecomment-5232821964

   Closing: this line is superseded.
   
   The merge-on-read work now lives on a single line (#663-#673, plus #675), which
   starts from the port as one squashed commit rather than this decomposition of
   it. That squashed commit contains everything this chain built, so nothing here
   is lost -- it is the same tree, reached by a different route.
   
   #660 carries the full squash for review, and is now up to date with the tip.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] feat(core): port the record buffer and merge iterator [hudi-rs]

Posted by "linliu-code (via GitHub)" <gi...@apache.org>.
linliu-code closed pull request #650: feat(core): port the record buffer and merge iterator
URL: https://github.com/apache/hudi-rs/pull/650


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org