You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Steve Niemitz (Jira)" <ji...@apache.org> on 2021/07/16 20:16:00 UTC
[jira] [Commented] (BEAM-6855) Side inputs are not supported when
using the state API
[ https://issues.apache.org/jira/browse/BEAM-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382315#comment-17382315 ]
Steve Niemitz commented on BEAM-6855:
-------------------------------------
Just ran into this again today trying to use a side input w/ a stateful DoFn. Its funny because I was just looking at the StreamingSideInputDoFnRunner and wondering how it worked with timers...I guess the answer is it doesn't.
The full stack:
{code:java}
java.lang.UnsupportedOperationException: Attempt to deliver a timer to a DoFn, but timers are not supported in Dataflow.
at org.apache.beam.runners.dataflow.worker.StreamingSideInputDoFnRunner.onTimer(StreamingSideInputDoFnRunner.java:87)
at org.apache.beam.runners.dataflow.worker.SimpleParDoFn.processUserTimer(SimpleParDoFn.java:380)
at org.apache.beam.runners.dataflow.worker.SimpleParDoFn.access$600(SimpleParDoFn.java:79)
at org.apache.beam.runners.dataflow.worker.SimpleParDoFn$TimerType$1.processTimer(SimpleParDoFn.java:470)
at org.apache.beam.runners.dataflow.worker.SimpleParDoFn.processTimers(SimpleParDoFn.java:499)
at org.apache.beam.runners.dataflow.worker.SimpleParDoFn.processTimers(SimpleParDoFn.java:372)
at org.apache.beam.runners.dataflow.worker.util.common.worker.ParDoOperation.finish(ParDoOperation.java:52)
at org.apache.beam.runners.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:103)
at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.process(StreamingDataflowWorker.java:1704)
at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker.access$1900(StreamingDataflowWorker.java:172)
at org.apache.beam.runners.dataflow.worker.StreamingDataflowWorker$9.run(StreamingDataflowWorker.java:1363)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) {code}
> Side inputs are not supported when using the state API
> ------------------------------------------------------
>
> Key: BEAM-6855
> URL: https://issues.apache.org/jira/browse/BEAM-6855
> Project: Beam
> Issue Type: Bug
> Components: runner-core, runner-dataflow, runner-direct
> Reporter: Reuven Lax
> Priority: P3
> Time Spent: 6h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)