You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Steve Niemitz (JIRA)" <ji...@apache.org> on 2019/06/07 13:59:00 UTC

[jira] [Created] (BEAM-7507) StreamingDataflowWorker attempts to decode non-utf8 binary data as utf8

Steve Niemitz created BEAM-7507:
-----------------------------------

             Summary: StreamingDataflowWorker attempts to decode non-utf8 binary data as utf8
                 Key: BEAM-7507
                 URL: https://issues.apache.org/jira/browse/BEAM-7507
             Project: Beam
          Issue Type: Improvement
          Components: runner-dataflow
            Reporter: Steve Niemitz
            Assignee: Steve Niemitz


In StreamingDataflowWorker, when setting the workId for the logging MDC, currently the code attempts to decode a binary blob as utf8.  This will (generally) cause a decoding error, and the java UTF8 decoder uses a globally synchronized cache to handle generating these error results.

A simple solution would be to use the protobuf TextFormat escaping to convert the ByteString key into a string.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)