You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/04/02 01:33:25 UTC
[jira] [Commented] (APEXCORE-415) Input Operator Can Double
Checkpoint if Operator CheckpointWindowCount is greater than DAG
CheckpointWindowCount
[ https://issues.apache.org/jira/browse/APEXCORE-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15222529#comment-15222529 ]
ASF GitHub Bot commented on APEXCORE-415:
-----------------------------------------
GitHub user ilooner opened a pull request:
https://github.com/apache/incubator-apex-core/pull/292
APEXCORE-415 #resolve #comment Fixed double checkpointing bug in Inpu…
…tNode.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ilooner/incubator-apex-core APEXCORE-415
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-apex-core/pull/292.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #292
----
commit 5f39cf214126e92ec0d667b66bcae0172c04b259
Author: Timothy Farkas <ti...@datatorrent.com>
Date: 2016-04-01T23:18:41Z
APEXCORE-415 #resolve #comment Fixed double checkpointing bug in InputNode.
----
> Input Operator Can Double Checkpoint if Operator CheckpointWindowCount is greater than DAG CheckpointWindowCount
> ----------------------------------------------------------------------------------------------------------------
>
> Key: APEXCORE-415
> URL: https://issues.apache.org/jira/browse/APEXCORE-415
> Project: Apache Apex Core
> Issue Type: Bug
> Reporter: Timothy Farkas
> Assignee: Timothy Farkas
>
> Application that reproduces the issue is here
> https://github.com/ilooner/streamcodec-bug/tree/asyncCheckpointBug
> java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.FileNotFoundException: /disk6/ndevyarn/nm/usercache/tim/appcache/application_1456485348783_3429/container_1456485348783_3429_01_000019/tmp/chkp3241218411712328004/1/6268662011559673861 (No such file or directory)
> at com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:59)
> at com.datatorrent.stram.engine.Node.reportStats(Node.java:465)
> at com.datatorrent.stram.engine.InputNode.run(InputNode.java:156)
> at com.datatorrent.stram.engine.StreamingContainer$2.run(StreamingContainer.java:1388)
> Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.FileNotFoundException: /disk6/ndevyarn/nm/usercache/tim/appcache/application_1456485348783_3429/container_1456485348783_3429_01_000019/tmp/chkp3241218411712328004/1/6268662011559673861 (No such file or directory)
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:188)
> at com.datatorrent.stram.engine.Node.reportStats(Node.java:458)
> ... 2 more
> Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: /disk6/ndevyarn/nm/usercache/tim/appcache/application_1456485348783_3429/container_1456485348783_3429_01_000019/tmp/chkp3241218411712328004/1/6268662011559673861 (No such file or directory)
> at com.datatorrent.netlet.util.DTThrowable.wrapIfChecked(DTThrowable.java:50)
> at com.datatorrent.netlet.util.DTThrowable.rethrow(DTThrowable.java:31)
> at com.datatorrent.common.util.AsyncFSStorageAgent.copyToHDFS(AsyncFSStorageAgent.java:126)
> at com.datatorrent.stram.engine.Node$CheckpointHandler.call(Node.java:684)
> at com.datatorrent.stram.engine.Node$CheckpointHandler.call(Node.java:673)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.FileNotFoundException: /disk6/ndevyarn/nm/usercache/tim/appcache/application_1456485348783_3429/container_1456485348783_3429_01_000019/tmp/chkp3241218411712328004/1/6268662011559673861 (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.<init>(FileInputStream.java:146)
> at com.datatorrent.common.util.AsyncFSStorageAgent.copyToHDFS(AsyncFSStorageAgent.java:117)
> ... 8 more
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)