You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org> on 2011/07/29 14:35:09 UTC
[jira] [Created] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
[MR-279] Lot of local files left on NM after the app finish.
------------------------------------------------------------
Key: MAPREDUCE-2751
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: mrv2
Affects Versions: 0.23.0
Reporter: Vinod Kumar Vavilapalli
Assignee: Siddharth Seth
Fix For: 0.23.0
This ticket is about app-only files which should be cleaned after app-finish.
I see these undeleted after app-finish:
/tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
/tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
/tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-2751:
-----------------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Perfect.
I just committed this to trunk and branch-0.23. Thanks Sid!
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122897#comment-13122897 ]
Hudson commented on MAPREDUCE-2751:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1054 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1054/])
MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1180071
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/ApplicationImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/LocalResourcesTrackerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/TestApplication.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated MAPREDUCE-2751:
-------------------------------------
Priority: Blocker (was: Major)
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122855#comment-13122855 ]
Hadoop QA commented on MAPREDUCE-2751:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12498165/MR2751_v2.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 5 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/965//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/965//console
This message is automatically generated.
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122876#comment-13122876 ]
Hudson commented on MAPREDUCE-2751:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1035 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1035/])
MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1180071
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/ApplicationImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/LocalResourcesTrackerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/TestApplication.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
Posted by "Vinod Kumar Vavilapalli (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod Kumar Vavilapalli updated MAPREDUCE-2751:
-----------------------------------------------
Status: Open (was: Patch Available)
Patch mostly looks good. Minor comments:
- I see a bunch of other transitions missing in Application. Let's do all of that separately, the ignored transitions in the patch also may not really be ignored. Let's drop those changes.
- TestApplication.WrappedApplication.finishContainer() can be renamed to containerFinished()
Also verified that all files are getting deleted properly now on my single-node secure setup.
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123466#comment-13123466 ]
Hudson commented on MAPREDUCE-2751:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #33 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/33/])
MAPREDUCE-2751. svn merge -c r1180071 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1180073
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/ApplicationImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/LocalResourcesTrackerImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/TestApplication.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2751:
--------------------------------------
Status: Patch Available (was: Open)
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2751:
--------------------------------------
Status: Patch Available (was: Open)
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2751:
--------------------------------------
Attachment: MR2751.patch
Changes
- Gets rid of a bunch of left over files (either directly or by creating them under an app/container dir)
- Gets rid of the random directory component instead of the localized file only.
- Not directly related to the Jira, but some changes to the Application statemachine for ignorable transitions, and tests for Application.
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122880#comment-13122880 ]
Hudson commented on MAPREDUCE-2751:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1113 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1113/])
MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1180071
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/ApplicationImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/LocalResourcesTrackerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/TestApplication.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2751) [MR-279] Lot of local files left
on NM after the app finish.
Posted by "Siddharth Seth (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Siddharth Seth updated MAPREDUCE-2751:
--------------------------------------
Attachment: MR2751_v2.patch
Update patch with review feedback.
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123480#comment-13123480 ]
Hudson commented on MAPREDUCE-2751:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #40 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/40/])
MAPREDUCE-2751. svn merge -c r1180071 --ignore-ancestry ../../trunk/
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1180073
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/ApplicationImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/LocalResourcesTrackerImpl.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/TestApplication.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123486#comment-13123486 ]
Hudson commented on MAPREDUCE-2751:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #854 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/854/])
MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1180071
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/ApplicationImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/LocalResourcesTrackerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/TestApplication.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13123445#comment-13123445 ]
Hudson commented on MAPREDUCE-2751:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #824 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/824/])
MAPREDUCE-2751. Modified NodeManager to stop leaving around local files after application finishes. Contributed by Siddharth Seth.
vinodkv : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1180071
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DeletionService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/ContainerManagerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/ApplicationImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/launcher/ContainerLaunch.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/LocalResourcesTrackerImpl.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/ResourceLocalizationService.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/application/TestApplication.java
* /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/localizer/TestResourceLocalizationService.java
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch, MR2751_v2.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2751) [MR-279] Lot of local files
left on NM after the app finish.
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13120834#comment-13120834 ]
Hadoop QA commented on MAPREDUCE-2751:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12497778/MR2751.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 5 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/947//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/947//console
This message is automatically generated.
> [MR-279] Lot of local files left on NM after the app finish.
> ------------------------------------------------------------
>
> Key: MAPREDUCE-2751
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2751
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0
> Reporter: Vinod Kumar Vavilapalli
> Assignee: Siddharth Seth
> Priority: Blocker
> Fix For: 0.23.0
>
> Attachments: MR2751.patch
>
>
> This ticket is about app-only files which should be cleaned after app-finish.
> I see these undeleted after app-finish:
> /tmp/nm-local-dir/0/nmPrivate/application_1305091029545_0001/*
> /tmp/nm-local-dir/0/nmPrivate/container_1305019205843_0001_000002/*
> /tmp/nm-local-dir/0/usercache/nobody/appcache/application_1305091029545_0001/*
> We should check for other left-over files too, if any.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira