[GitHub] [beam] chamikaramj commented on issue #26918: [Bug]: StrUtf8Coder in Python can't deserialize what's encoded with Java StringUtf8Coder

["chamikaramj (via GitHub)" <gi...@apache.org>]

chamikaramj commented on issue #26918:
URL: https://github.com/apache/beam/issues/26918#issuecomment-1641132886

   Hi, thanks for reporting this.
   
   According to reference encodings length should not be included for UTF-8 coders: https://github.com/apache/beam/blob/6152a70d64b08809940ec07c8df2d4f0168d49ec/model/fn-execution/src/main/resources/org/apache/beam/model/fnexecution/v1/standard_coders.yaml#L85
   
   Also, looking at the Java implementation, length should only be included if the coder is operating in a nested context: https://github.com/apache/beam/blob/6152a70d64b08809940ec07c8df2d4f0168d49ec/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/StringUtf8Coder.java#L83C3-L83C3
   
   Do you have a test where you ran into an issues due to this ?
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org