You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "linliu-code (via GitHub)" <gi...@apache.org> on 2026/08/02 14:38:43 UTC
[PR] feat(core): port schema evolution for merged batches [hudi-rs]
linliu-code opened a new pull request, #643:
URL: https://github.com/apache/hudi-rs/pull/643
**Stacked on #639–#642** — their commits appear here until they merge. **Review only the last commit.**
Two modules that let a read span a schema change — the capability `hudi-rs` has no equivalent of today:
- `schema::extended_promotion` — which type changes a read can absorb (int→long, decimal scale widening, …), rejecting the rest rather than producing a silently wrong value.
- `schema::batch_evolution` — applies a target schema to a batch read under an older one: back-fill added columns as null, drop removed ones, cast promoted ones through the rules above.
Together they are what makes a MOR slice readable when its base file and log blocks were written under different schemas.
Nothing calls them yet. Build warning-free; 795 lib tests green.
🤖 Generated with [Claude Code](https://claude.com/claude-code)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(core): port schema evolution for merged batches [hudi-rs]
Posted by "linliu-code (via GitHub)" <gi...@apache.org>.
linliu-code commented on PR #643:
URL: https://github.com/apache/hudi-rs/pull/643#issuecomment-5232820936
Closing: this line is superseded.
The merge-on-read work now lives on a single line (#663-#673, plus #675), which
starts from the port as one squashed commit rather than this decomposition of
it. That squashed commit contains everything this chain built, so nothing here
is lost -- it is the same tree, reached by a different route.
#660 carries the full squash for review, and is now up to date with the tip.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat(core): port schema evolution for merged batches [hudi-rs]
Posted by "linliu-code (via GitHub)" <gi...@apache.org>.
linliu-code closed pull request #643: feat(core): port schema evolution for merged batches
URL: https://github.com/apache/hudi-rs/pull/643
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org