You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Steve Loughran (JIRA)" <ji...@apache.org> on 2018/12/11 21:21:00 UTC

[jira] [Commented] (YARN-9109) DelegationTokenRenewer not resilient to token classload problems

    [ https://issues.apache.org/jira/browse/YARN-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16718016#comment-16718016 ] 

Steve Loughran commented on YARN-9109:
--------------------------------------

Server
{code}
2018-12-11 16:32:17,429 [main] ERROR tools.DistCp (DistCp.java:run(167)) - Exception encountered 
java.io.IOException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1543889597027_0032 to YARN : Timer already cancelled.
	at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:345)
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:251)
	at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1576)
	at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1573)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1573)
	at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:206)
	at org.apache.hadoop.tools.DistCp.execute(DistCp.java:182)
	at org.apache.hadoop.tools.DistCp.run(DistCp.java:153)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.tools.DistCp.main(DistCp.java:432)
Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1543889597027_0032 to YARN : Timer already cancelled.
	at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:322)
	at org.apache.hadoop.mapred.ResourceMgrDelegate.submitApplication(ResourceMgrDelegate.java:299)
	at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:330)
{code}

> DelegationTokenRenewer not resilient to token classload problems
> ----------------------------------------------------------------
>
>                 Key: YARN-9109
>                 URL: https://issues.apache.org/jira/browse/YARN-9109
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 3.1.2
>            Reporter: Steve Loughran
>            Priority: Minor
>
> The DelegationTokenRenewer can't handle the situation of: token implementation class cannot be instantiated.
> This is because {{Token.decodeIdentifier()}} throws an RTE  on failure to instantiate, and these aren't caught.
> Appears to surfaces in the client: with an error about "Timer Already Cancelled". In the logs, you see this
> {code}
> Exception: java.lang.NoClassDefFoundError thrown from the UncaughtExceptionHandler in thread "Timer-5"
> {code}
> At least, I'm assuming this is the cause.... Relates to HADOOP-14556



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org