You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "andygrove (via GitHub)" <gi...@apache.org> on 2024/08/02 18:51:06 UTC

Re: [I] bug: upper and lower not compatible with Spark for international character sets [datafusion-comet]

andygrove commented on issue #483:
URL: https://github.com/apache/datafusion-comet/issues/483#issuecomment-2265957745

   Here is another example:
   
   ```
   First difference at row 95:
   Spark: `Ჹ퓎墡勝䴿㿣䧛㰏,Ჹ퓎墡勝䴿㿣䧛㰏`
   Comet: `Ჹ퓎墡勝䴿㿣䧛㰏,ჹ퓎墡勝䴿㿣䧛㰏`
   ```
   
   Java has locale-specific behavior for converting to upper and lower case, and Rust does not. We cannot expect them to produce the same results in all cases.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org