You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Laura Llewellyn (JIRA)" <ji...@apache.org> on 2018/11/06 17:13:00 UTC

[jira] [Commented] (BEAM-5997) EVENT_TIME timer throws exception when side input used

    [ https://issues.apache.org/jira/browse/BEAM-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677028#comment-16677028 ] 

Laura Llewellyn commented on BEAM-5997:
---------------------------------------

Pipeline code to run the attached transform and produce the exception:
{code:java}
Pipeline p = Pipeline.create(options);
p.apply(Create.of(KV.<String, String>of("test", "value"))).apply(new com.test.TestExpiry());
p.run();{code}

> EVENT_TIME timer throws exception when side input used
> ------------------------------------------------------
>
>                 Key: BEAM-5997
>                 URL: https://issues.apache.org/jira/browse/BEAM-5997
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-direct
>    Affects Versions: 2.7.0
>            Reporter: Laura Llewellyn
>            Assignee: Daniel Oliveira
>            Priority: Critical
>         Attachments: TestExpiry.java
>
>
> Receive this exception when using a DoFn containing an EVENT_TIME timer and passing a side input. Pipeline processing aborts. It works as expected when the side input is absent.
> {code:java}
> 2018-11-06-12:03:32 ERROR o.a.b.r.direct.QuiescenceDriver - Internal Error while delivering timers
> java.lang.IllegalArgumentException: expected one element but was: <TestExpiry/TestingExpiry/ParMultiDo(TestExpiry)/To KeyedWorkItem/ParMultiDo(ToKeyedWorkItem).output [PCollection], TestExpiry/View.AsList/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)/ParMultiDo(VoidKeyToMultimapMaterialization).output [PCollection]>
>  at org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.collect.Iterators.getOnlyElement(Iterators.java:322)
>  at org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.collect.Iterables.getOnlyElement(Iterables.java:294)
>  at org.apache.beam.runners.direct.QuiescenceDriver.fireTimers(QuiescenceDriver.java:167)
>  at org.apache.beam.runners.direct.QuiescenceDriver.drive(QuiescenceDriver.java:110)
>  at org.apache.beam.runners.direct.ExecutorServiceParallelExecutor$2.run(ExecutorServiceParallelExecutor.java:170)
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)