You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "QuakeWang (via GitHub)" <gi...@apache.org> on 2026/07/17 01:27:39 UTC

[PR] [python][daft] Fix native reads after schema evolution [paimon]

QuakeWang opened a new pull request, #8704:
URL: https://github.com/apache/paimon/pull/8704

   ### Purpose
   
   Daft native Parquet routing used current column names and Daft-side casts without checking the schema that wrote each file. For old-schema files, renamed fields could be lost, dropped-and-readded fields could expose stale values, and cast results could differ from PyPaimon.
   
   Validate candidate native files by field ID, physical name, nullability, and verified type promotions. Keep compatible reads native and fall back to PyPaimon schema normalization otherwise. This also covers BLOB-table native projections and normalizes TIME batches for Daft.
   
   ### Tests
   
     - Daft test suite: 226 passed
     - CI flake8 4.0.1
     - License header and diff checks


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [python][daft] Fix native reads after schema evolution [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #8704:
URL: https://github.com/apache/paimon/pull/8704


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] [python][daft] Fix native reads after schema evolution [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #8704:
URL: https://github.com/apache/paimon/pull/8704#issuecomment-5009832383

   +1


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org