You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "spancer (via GitHub)" <gi...@apache.org> on 2026/10/02 05:58:48 UTC

[PR] [core] Skip surrogate code points in truncated string max [paimon]

spancer opened a new pull request, #10335:
URL: https://github.com/apache/paimon/pull/10335

   ### Purpose
   
   Fixes #10333.
   
   `TruncateSimpleColStatsCollector#truncateMax` could increment U+D7FF to U+D800, which is a surrogate code point. Encoding the lone surrogate produced `?`, so the stored maximum could be lower than the real value and matching files could be skipped during predicate pruning.
   
   Skip the surrogate range and use U+E000, the smallest valid code point greater than U+D7FF. The regression test covers both normal collection and the `convert` path.
   
   ### Tests
   
   - `mvn -pl paimon-common -DwildcardSuites=none -Dtest=SimpleColStatsCollectorTest verify`
   - 13 tests passed; Checkstyle and Spotless passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [core] Skip surrogate code points in truncated string max [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #10335:
URL: https://github.com/apache/paimon/pull/10335


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [core] Skip surrogate code points in truncated string max [paimon]

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #10335:
URL: https://github.com/apache/paimon/pull/10335#issuecomment-5967486753

   +1


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org