You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Beam JIRA Bot (Jira)" <ji...@apache.org> on 2022/05/31 21:29:00 UTC
[jira] [Updated] (BEAM-14539) JulHandlerPrintStream failing to buffer carry over bytes
[ https://issues.apache.org/jira/browse/BEAM-14539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Beam JIRA Bot updated BEAM-14539:
---------------------------------
Status: Open (was: Triage Needed)
> JulHandlerPrintStream failing to buffer carry over bytes
> --------------------------------------------------------
>
> Key: BEAM-14539
> URL: https://issues.apache.org/jira/browse/BEAM-14539
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Affects Versions: 2.33.0, 2.34.0, 2.35.0, 2.36.0, 2.37.0, 2.38.0, 2.39.0
> Reporter: Luke Cwik
> Assignee: Luke Cwik
> Priority: P2
> Fix For: 2.40.0
>
>
> JulHandlerPrintStream was not flushing in a loop for large byte arrays which meant that the carry over could be much larger then the assumed 6 bytes.
> Saw these logs for a job:
> {noformat}
> 2022-05-26 07:40:30.284 PDT
> at org.apache.beam.runners.dataflow.worker.logging.JulHandlerPrintStreamAdapterFactory$JulHandlerPrintStream.write(JulHandlerPrintStreamAdapterFactory.java:142)
> 2022-05-26 07:40:30.284 PDT
> at java.base/java.io.PrintStream.write(PrintStream.java:559)
> 2022-05-26 07:40:30.284 PDT
> at java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:233)
> 2022-05-26 07:40:30.285 PDT
> at java.base/sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:312)
> 2022-05-26 07:40:30.286 PDT
> at java.base/sun.nio.cs.StreamEncoder.flushBuffer(StreamEncoder.java:104)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.OutputStreamWriter.flushBuffer(OutputStreamWriter.java:184)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.PrintStream.write(PrintStream.java:606)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.PrintStream.print(PrintStream.java:745)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.PrintStream.append(PrintStream.java:1147)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.PrintStream.append(PrintStream.java:1188)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.PrintStream.append(PrintStream.java:63)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.util.Formatter$FixedString.print(Formatter.java:2754)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.util.Formatter.format(Formatter.java:2661)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.PrintStream.format(PrintStream.java:1053)
> 2022-05-26 07:40:30.286 PDT
> at java.base/java.io.PrintStream.printf(PrintStream.java:949)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)