You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "linliu-code (via GitHub)" <gi...@apache.org> on 2026/08/02 14:37:48 UTC

[PR] feat(core): port Avro schema comparison and Parquet list normalization [hudi-rs]

linliu-code opened a new pull request, #642:
URL: https://github.com/apache/hudi-rs/pull/642

   **Stacked on #639, #640, #641** — their commits appear here until they merge. **Review only the last commit.**
   
   Two schema helpers the merge-on-read reader depends on:
   
   - `schema::avro_schema_utils` — decides whether two Avro schemas are projection-equivalent, so the reader can tell a genuine schema change from a reordering or a narrowing that needs no work.
   - `schema::parquet_list_norm` — normalizes the legacy two-level repeated-group and modern three-level Parquet list encodings, so batches from files written by different engines line up.
   
   Also brings the two parquet fixtures `parquet_list_norm`'s tests read. They are force-added past the `**/data` ignore, the same way the existing fixtures under `crates/test/data` are tracked.
   
   Unlike the `reader_v2` modules these are `pub` under `schema`, matching their upstream placement — nothing calls them yet. Full workspace suite green.
   
   🤖 Generated with [Claude Code](https://claude.com/claude-code)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] feat(core): port Avro schema comparison and Parquet list normalization [hudi-rs]

Posted by "linliu-code (via GitHub)" <gi...@apache.org>.
linliu-code commented on PR #642:
URL: https://github.com/apache/hudi-rs/pull/642#issuecomment-5232820794

   Closing: this line is superseded.
   
   The merge-on-read work now lives on a single line (#663-#673, plus #675), which
   starts from the port as one squashed commit rather than this decomposition of
   it. That squashed commit contains everything this chain built, so nothing here
   is lost -- it is the same tree, reached by a different route.
   
   #660 carries the full squash for review, and is now up to date with the tip.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] feat(core): port Avro schema comparison and Parquet list normalization [hudi-rs]

Posted by "linliu-code (via GitHub)" <gi...@apache.org>.
linliu-code closed pull request #642: feat(core): port Avro schema comparison and Parquet list normalization
URL: https://github.com/apache/hudi-rs/pull/642


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org