You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Matthew Paduano (JIRA)" <ji...@apache.org> on 2016/05/10 00:25:12 UTC

[jira] [Commented] (HADOOP-13123) Permit the default hadoop delegation token file format to be configurable

    [ https://issues.apache.org/jira/browse/HADOOP-13123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277398#comment-15277398 ] 

Matthew Paduano commented on HADOOP-13123:
------------------------------------------

{code}
2016-05-09 16:12:18,733 [ERROR] [main] |app.DAGAppMaster|: Error starting DAGAppMaster
java.io.IOException: Exception reading /tmp/hadoop-llu/nm-local-dir/usercache/llu/appcache/application_1462833671675_0001/container_e03_1462833671675_0001_01_000001/container_tokens
        at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:197)
        at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:789)
        at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
        at org.apache.tez.dag.app.DAGAppMaster.main(DAGAppMaster.java:2345)
Caused by: java.io.IOException: Unknown version 1 in token storage.
        at org.apache.hadoop.security.Credentials.readTokenStorageStream(Credentials.java:*215*)
        at org.apache.hadoop.security.Credentials.readTokenStorageFile(Credentials.java:*194*)
        ... 4 more
{code}

note that the file line numbers in the stack trace complaining of "unknown version 1" correspond to pre-dtutil code.

> Permit the default hadoop delegation token file format to be configurable
> -------------------------------------------------------------------------
>
>                 Key: HADOOP-13123
>                 URL: https://issues.apache.org/jira/browse/HADOOP-13123
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Matthew Paduano
>            Assignee: Matthew Paduano
>
> If one environment updates to using the new dtutil code and accompanying Credentials code, there is a backward compatibility issue with the default file format being JAVA.  Older clients need to be updated to ask for a file in the legacy format (FORMAT_JAVA).  
> As an aid to users in this trap, we can add a configuration property to set the default file format.  When set to FORMAT_JAVA, the new server code will serve up legacy files without being asked.  The default value for this property will remain FORMAT_PB.  But affected users can add this config option to the services using the newer code.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org