You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Yichi Zhang (Jira)" <ji...@apache.org> on 2021/01/30 05:21:00 UTC
[jira] [Updated] (BEAM-11066) DataflowRunner crashes during graph
rewrites of Java wordcount example with beam_fn_api experiment
[ https://issues.apache.org/jira/browse/BEAM-11066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yichi Zhang updated BEAM-11066:
-------------------------------
Resolution: Fixed
Status: Resolved (was: Resolved)
> DataflowRunner crashes during graph rewrites of Java wordcount example with beam_fn_api experiment
> --------------------------------------------------------------------------------------------------
>
> Key: BEAM-11066
> URL: https://issues.apache.org/jira/browse/BEAM-11066
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Yichi Zhang
> Assignee: Yichi Zhang
> Priority: P2
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Looks like the TextIO.write() is not properly writing windowed output in streaming mode.
>
> {{Exception in thread "main" java.lang.IllegalStateException: Found nodes that matched overrides. Matches: \{Node{fullName=WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values}=[PTransformOverride\{matcher=EqualClassPTransformMatcher{class=class org.apache.beam.sdk.transforms.Create$Values}, overrideFactory=org.apache.beam.runners.dataflow.DataflowRunner$StreamingFnApiCreateOverrideFactory@62923ee6}]}
> at org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Preconditions.checkState(Preconditions.java:588)
> at org.apache.beam.sdk.Pipeline$1.leaveCompositeTransform(Pipeline.java:237)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:661)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:317)
> at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:251)
> at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:463)
> at org.apache.beam.sdk.Pipeline.checkNoMoreMatches(Pipeline.java:218)
> at org.apache.beam.sdk.Pipeline.replaceAll(Pipeline.java:214)
> at org.apache.beam.runners.dataflow.DataflowRunner.replaceTransforms(DataflowRunner.java:1180)
> at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:871)
> at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:192)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:317)
> at org.apache.beam.sdk.Pipeline.run(Pipeline.java:303)
> at org.apache.beam.examples.WordCount.runWordCount(WordCount.java:185)
> at org.apache.beam.examples.WordCount.main(WordCount.java:192)}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)