You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ramgopal N (Created) (JIRA)" <ji...@apache.org> on 2011/10/18 12:50:10 UTC

[jira] [Created] (MAPREDUCE-3200) Job got failed with FileNotFoundException during ResourceLocalization

Job got failed with FileNotFoundException during ResourceLocalization
---------------------------------------------------------------------

                 Key: MAPREDUCE-3200
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3200
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2
    Affects Versions: 0.23.0
            Reporter: Ramgopal N


The exception trace is as follows
{code:xml}
2011-10-18 15:37:11,315 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root	OPERATION=Application Finished - Failed	TARGET=RMAppManager	RESULT=FAILURE	DESCRIPTION=App failed with state: FAILED	PERMISSIONS=Application application_1318930754911_0002 failed 1 times due to AM Container for appattempt_1318930754911_0002_000001 exited with  exitCode: -1000 due to: java.io.FileNotFoundException: file:/tmp/nm-local-dir/usercache/root/appcache/application_1318930754911_0003/container_1318930754911_0002_01_000001.tokens
	at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:189)
	at org.apache.hadoop.fs.DelegateToFileSystem.open(DelegateToFileSystem.java:150)
	at org.apache.hadoop.fs.AbstractFileSystem.open(AbstractFileSystem.java:595)
	at org.apache.hadoop.fs.FilterFs.open(FilterFs.java:197)
	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:759)
	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:756)
	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2321)
	at org.apache.hadoop.fs.FileContext.open(FileContext.java:756)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:133)
	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:86)
	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:855)

{code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3200) Job got failed with FileNotFoundException during ResourceLocalization

Posted by "Vinod Kumar Vavilapalli (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129687#comment-13129687 ] 

Vinod Kumar Vavilapalli commented on MAPREDUCE-3200:
----------------------------------------------------

This may be same as MAPREDUCE-3159. How often are you hitting this?
                
> Job got failed with FileNotFoundException during ResourceLocalization
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3200
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3200
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramgopal N
>
> The exception trace is as follows
> {code:xml}
> 2011-10-18 15:37:11,315 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root	OPERATION=Application Finished - Failed	TARGET=RMAppManager	RESULT=FAILURE	DESCRIPTION=App failed with state: FAILED	PERMISSIONS=Application application_1318930754911_0002 failed 1 times due to AM Container for appattempt_1318930754911_0002_000001 exited with  exitCode: -1000 due to: java.io.FileNotFoundException: file:/tmp/nm-local-dir/usercache/root/appcache/application_1318930754911_0003/container_1318930754911_0002_01_000001.tokens
> 	at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:189)
> 	at org.apache.hadoop.fs.DelegateToFileSystem.open(DelegateToFileSystem.java:150)
> 	at org.apache.hadoop.fs.AbstractFileSystem.open(AbstractFileSystem.java:595)
> 	at org.apache.hadoop.fs.FilterFs.open(FilterFs.java:197)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:759)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:756)
> 	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2321)
> 	at org.apache.hadoop.fs.FileContext.open(FileContext.java:756)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:133)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:86)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:855)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (MAPREDUCE-3200) Job got failed with FileNotFoundException during ResourceLocalization

Posted by "Siddharth Seth (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Siddharth Seth reassigned MAPREDUCE-3200:
-----------------------------------------

    Assignee: Siddharth Seth
    
> Job got failed with FileNotFoundException during ResourceLocalization
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3200
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3200
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramgopal N
>            Assignee: Siddharth Seth
>            Priority: Blocker
>
> The exception trace is as follows
> {code:xml}
> 2011-10-18 15:37:11,315 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root	OPERATION=Application Finished - Failed	TARGET=RMAppManager	RESULT=FAILURE	DESCRIPTION=App failed with state: FAILED	PERMISSIONS=Application application_1318930754911_0002 failed 1 times due to AM Container for appattempt_1318930754911_0002_000001 exited with  exitCode: -1000 due to: java.io.FileNotFoundException: file:/tmp/nm-local-dir/usercache/root/appcache/application_1318930754911_0003/container_1318930754911_0002_01_000001.tokens
> 	at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:189)
> 	at org.apache.hadoop.fs.DelegateToFileSystem.open(DelegateToFileSystem.java:150)
> 	at org.apache.hadoop.fs.AbstractFileSystem.open(AbstractFileSystem.java:595)
> 	at org.apache.hadoop.fs.FilterFs.open(FilterFs.java:197)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:759)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:756)
> 	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2321)
> 	at org.apache.hadoop.fs.FileContext.open(FileContext.java:756)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:133)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:86)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:855)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3200) Job got failed with FileNotFoundException during ResourceLocalization

Posted by "Ramgopal N (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13129702#comment-13129702 ] 

Ramgopal N commented on MAPREDUCE-3200:
---------------------------------------

I am using Fairscheduler and submitted 3 jobs in sequence.The second job got failed with this exception.The other 2 jobs passed.
                
> Job got failed with FileNotFoundException during ResourceLocalization
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3200
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3200
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramgopal N
>
> The exception trace is as follows
> {code:xml}
> 2011-10-18 15:37:11,315 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root	OPERATION=Application Finished - Failed	TARGET=RMAppManager	RESULT=FAILURE	DESCRIPTION=App failed with state: FAILED	PERMISSIONS=Application application_1318930754911_0002 failed 1 times due to AM Container for appattempt_1318930754911_0002_000001 exited with  exitCode: -1000 due to: java.io.FileNotFoundException: file:/tmp/nm-local-dir/usercache/root/appcache/application_1318930754911_0003/container_1318930754911_0002_01_000001.tokens
> 	at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:189)
> 	at org.apache.hadoop.fs.DelegateToFileSystem.open(DelegateToFileSystem.java:150)
> 	at org.apache.hadoop.fs.AbstractFileSystem.open(AbstractFileSystem.java:595)
> 	at org.apache.hadoop.fs.FilterFs.open(FilterFs.java:197)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:759)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:756)
> 	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2321)
> 	at org.apache.hadoop.fs.FileContext.open(FileContext.java:756)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:133)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:86)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:855)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-3200) Job got failed with FileNotFoundException during ResourceLocalization

Posted by "Siddharth Seth (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13159827#comment-13159827 ] 

Siddharth Seth commented on MAPREDUCE-3200:
-------------------------------------------

Ramgopal, are you still seing this issue ? If so, could you please provide additional details about your environment and steps to reproduce. Thanks
                
> Job got failed with FileNotFoundException during ResourceLocalization
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3200
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3200
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramgopal N
>            Priority: Blocker
>
> The exception trace is as follows
> {code:xml}
> 2011-10-18 15:37:11,315 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root	OPERATION=Application Finished - Failed	TARGET=RMAppManager	RESULT=FAILURE	DESCRIPTION=App failed with state: FAILED	PERMISSIONS=Application application_1318930754911_0002 failed 1 times due to AM Container for appattempt_1318930754911_0002_000001 exited with  exitCode: -1000 due to: java.io.FileNotFoundException: file:/tmp/nm-local-dir/usercache/root/appcache/application_1318930754911_0003/container_1318930754911_0002_01_000001.tokens
> 	at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:189)
> 	at org.apache.hadoop.fs.DelegateToFileSystem.open(DelegateToFileSystem.java:150)
> 	at org.apache.hadoop.fs.AbstractFileSystem.open(AbstractFileSystem.java:595)
> 	at org.apache.hadoop.fs.FilterFs.open(FilterFs.java:197)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:759)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:756)
> 	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2321)
> 	at org.apache.hadoop.fs.FileContext.open(FileContext.java:756)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:133)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:86)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:855)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (MAPREDUCE-3200) Job got failed with FileNotFoundException during ResourceLocalization

Posted by "Arun C Murthy (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Arun C Murthy resolved MAPREDUCE-3200.
--------------------------------------

    Resolution: Duplicate

Duplicate of MAPREDUCE-3537.
                
> Job got failed with FileNotFoundException during ResourceLocalization
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3200
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3200
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Ramgopal N
>            Assignee: Siddharth Seth
>            Priority: Blocker
>
> The exception trace is as follows
> {code:xml}
> 2011-10-18 15:37:11,315 WARN org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=root	OPERATION=Application Finished - Failed	TARGET=RMAppManager	RESULT=FAILURE	DESCRIPTION=App failed with state: FAILED	PERMISSIONS=Application application_1318930754911_0002 failed 1 times due to AM Container for appattempt_1318930754911_0002_000001 exited with  exitCode: -1000 due to: java.io.FileNotFoundException: file:/tmp/nm-local-dir/usercache/root/appcache/application_1318930754911_0003/container_1318930754911_0002_01_000001.tokens
> 	at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:189)
> 	at org.apache.hadoop.fs.DelegateToFileSystem.open(DelegateToFileSystem.java:150)
> 	at org.apache.hadoop.fs.AbstractFileSystem.open(AbstractFileSystem.java:595)
> 	at org.apache.hadoop.fs.FilterFs.open(FilterFs.java:197)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:759)
> 	at org.apache.hadoop.fs.FileContext$6.next(FileContext.java:756)
> 	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2321)
> 	at org.apache.hadoop.fs.FileContext.open(FileContext.java:756)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:133)
> 	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:86)
> 	at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:855)
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira