You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Luke Cwik (Jira)" <ji...@apache.org> on 2022/05/31 21:29:00 UTC

[jira] [Created] (BEAM-14539) JulHandlerPrintStream failing to buffer carry over bytes

Luke Cwik created BEAM-14539:
--------------------------------

             Summary: JulHandlerPrintStream failing to buffer carry over bytes
                 Key: BEAM-14539
                 URL: https://issues.apache.org/jira/browse/BEAM-14539
             Project: Beam
          Issue Type: Bug
          Components: runner-dataflow
    Affects Versions: 2.39.0, 2.38.0, 2.37.0, 2.36.0, 2.35.0, 2.34.0, 2.33.0
            Reporter: Luke Cwik
            Assignee: Luke Cwik
             Fix For: 2.40.0


JulHandlerPrintStream was not flushing in a loop for large byte arrays which meant that the carry over could be much larger then the assumed 6 bytes.

Saw these logs for a job:
{noformat}
2022-05-26 07:40:30.284 PDT
at org.apache.beam.runners.dataflow.worker.logging.JulHandlerPrintStreamAdapterFactory$JulHandlerPrintStream.write(JulHandlerPrintStreamAdapterFactory.java:142)
2022-05-26 07:40:30.284 PDT
at java.base/java.io.PrintStream.write(PrintStream.java:559)

2022-05-26 07:40:30.284 PDT
at java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:233)
2022-05-26 07:40:30.285 PDT
at java.base/sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:312)
2022-05-26 07:40:30.286 PDT
at java.base/sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:104)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:184)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.PrintStream.write(PrintStream.java:606)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.PrintStream.print(PrintStream.java:745)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.PrintStream.append(PrintStream.java:1147)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.PrintStream.append(PrintStream.java:1188)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.PrintStream.append(PrintStream.java:63)
2022-05-26 07:40:30.286 PDT
at java.base/java.util.Formatter$FixedString.print(Formatter.java:2754)
2022-05-26 07:40:30.286 PDT
at java.base/java.util.Formatter.format(Formatter.java:2661)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.PrintStream.format(PrintStream.java:1053)
2022-05-26 07:40:30.286 PDT
at java.base/java.io.PrintStream.printf(PrintStream.java:949)
{noformat}




--
This message was sent by Atlassian Jira
(v8.20.7#820007)