You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Kostas Kloudas (JIRA)" <ji...@apache.org> on 2017/05/17 13:06:04 UTC
[jira] [Comment Edited] (FLINK-6321) RocksDB state backend
Checkpointing is not working with KeyedCEP.
[ https://issues.apache.org/jira/browse/FLINK-6321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013986#comment-16013986 ]
Kostas Kloudas edited comment on FLINK-6321 at 5/17/17 1:05 PM:
----------------------------------------------------------------
[~shashank734] I will have another look. Thanks a lot for the serializer. And just to let you know, I just pushed to the master and the release-1.3 branch a commit that removes java serialization from the NFA serialization and replaces it with custom Flink serializers.
This may solve your problem already, so if you find some time to run your program with the master or the 1.3 version it would help a lot!
As you may have noticed we are currently actively testing the release-1.3 which contains a lot of new features and bug-fixes. So any help on testing it, is more than welcomed.
was (Author: kkl0u):
[~shashank734] I will have another look. Thanks a lot for the serializer. And just to let you know, I just pushed to the master and the release-1.3 branch a commit that removes java serialization from the NFA serialization and replaces it with custom Flink serializers.
This may solve your problem already, so if you find some time to run your program with the master or the 1.3 version it would help a lot!
As you may have noticed we are currently actively testing the release-1.3 which contains a lot of new features and bug-fixes. So any help on testing it, is more than
welcomed.
> RocksDB state backend Checkpointing is not working with KeyedCEP.
> -----------------------------------------------------------------
>
> Key: FLINK-6321
> URL: https://issues.apache.org/jira/browse/FLINK-6321
> Project: Flink
> Issue Type: Bug
> Components: CEP
> Affects Versions: 1.2.0
> Environment: yarn-cluster, RocksDB State backend, Checkpointing every 1000 ms
> Reporter: Shashank Agarwal
> Assignee: Kostas Kloudas
> Priority: Blocker
> Fix For: 1.3.0
>
>
> Checkpointing is not working with RocksDBStateBackend when using CEP. It's working fine with FsStateBackend and MemoryStateBackend. Application failing every-time.
> {code}
> 04/18/2017 21:53:20 Job execution switched to status FAILING.
> AsynchronousException{java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).}
> at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:980)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.Exception: Could not materialize checkpoint 46 for operator KeyedCEPPatternOperator -> Map (1/4).
> ... 6 more
> Caused by: java.util.concurrent.CancellationException
> at java.util.concurrent.FutureTask.report(FutureTask.java:121)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at org.apache.flink.util.FutureUtil.runIfNotDoneAndGet(FutureUtil.java:40)
> at org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:915)
> ... 5 more
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)