You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Thomas Groh (JIRA)" <ji...@apache.org> on 2017/03/17 22:44:41 UTC

[jira] [Resolved] (BEAM-1653) Error when using PubsubIO with the DirectRunner

     [ https://issues.apache.org/jira/browse/BEAM-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Groh resolved BEAM-1653.
-------------------------------
       Resolution: Fixed
    Fix Version/s: First stable release

> Error when using PubsubIO with the DirectRunner 
> ------------------------------------------------
>
>                 Key: BEAM-1653
>                 URL: https://issues.apache.org/jira/browse/BEAM-1653
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-direct, sdk-java-extensions
>    Affects Versions: 0.5.0
>            Reporter: FĂ©lix Mattrat
>            Assignee: Thomas Groh
>             Fix For: First stable release
>
>
> Reading a source with a `org.apache.beam.sdk.io.PubsubIO` and running the pipeline with `DirectRunner` result in an error.
> The error occur usually after reading ~200 messages from pubsub at the moment where  `PubsubIO` try to ack the messages. 
> The error:
> ```
> Exception in thread "main" java.lang.IllegalStateException: Cannot finalize a restored checkpoint
>         at org.apache.beam.sdk.repackaged.com.google.common.base.Preconditions.checkState(Preconditions.java:174)
>         at org.apache.beam.sdk.io.PubsubUnboundedSource$PubsubCheckpoint.finalizeCheckpoint(PubsubUnboundedSource.java:293)
>         at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.finishRead(UnboundedReadEvaluatorFactory.java:205)
>         at org.apache.beam.runners.direct.UnboundedReadEvaluatorFactory$UnboundedReadEvaluator.processElement(UnboundedReadEvaluatorFactory.java:142)
>         at org.apache.beam.runners.direct.TransformExecutor.processElements(TransformExecutor.java:139)
>         at org.apache.beam.runners.direct.TransformExecutor.run(TransformExecutor.java:107)
>         at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> ```



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)