You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Kostas Kloudas (JIRA)" <ji...@apache.org> on 2017/04/27 16:48:04 UTC
[jira] [Comment Edited] (FLINK-6321) RocksDB state backend
Checkpointing is not working with KeydCEP.
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986999#comment-15986999 ]
Kostas Kloudas edited comment on FLINK-6321 at 4/27/17 4:47 PM:
----------------------------------------------------------------
Hi [~shashank734] ! Thanks a lot for reporting the issue.
I have a potential solution to this issue in branch https://github.com/kl0u/flink/tree/cep-serialization.
In order to test it, it would be really helpful if you could either
provide the program (or a minimal example) that reproduces the issue, or,
take this brach and re-run your program, take a savepoint, try to restore from that, and tell us if it runs.
This would be really helpful, especially now that we are close to the 1.3 feature freeze.
was (Author: kkl0u):
Hi [[~shashank734] ! Thanks a lot for reporting the issue.
I have a potential solution to this issue in branch https://github.com/kl0u/flink/tree/cep-serialization.
In order to test it, it would be really helpful if you could either
provide the program (or a minimal example) that reproduces the issue, or,
take this brach and re-run your program, take a savepoint, try to restore from that, and tell us if it runs.
This would be really helpful, especially now that we are close to the 1.3 feature freeze.
> RocksDB state backend Checkpointing is not working with KeydCEP.
> ----------------------------------------------------------------
>
> Key: FLINK-6321
> URL: https://issues.apache.org/jira/browse/FLINK-6321
> Project: Flink
> Issue Type: Bug
> Components: CEP, State Backends, Checkpointing
> Affects Versions: 1.2.0
> Environment: yarn-cluster, RocksDB State backend, Checkpointing every 1000 ms
> Reporter: Shashank Agarwal
> Assignee: Kostas Kloudas
>
> Checkpointing is not working with RocksDBStateBackend when using CEP. It's working fine with FsStateBackend and MemoryStateBackend. Application failing every-time.
> {code}
> 04/18/2017 21:53:20 Job execution switched to status FAILING.
> AsynchronousException{java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).}
> at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:980)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).
> ... 6 more
> Caused by: java.util.concurrent.CancellationException
> at java.util.concurrent.FutureTask.report(FutureTask.java:121)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at org.apache.flink.util.FutureUtil.runIfNotDoneAndGet(FutureUtil.java:40)
> at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:915)
> ... 5 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)