[jira] [Commented] (MAPREDUCE-6010) HistoryServerFileSystemStateStore fails to update tokens

["Jason Lowe (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076324#comment-14076324 ] 

Jason Lowe commented on MAPREDUCE-6010:
---------------------------------------

Example exception during a token update:

{noformat}
2014-07-28 15:00:00,226 [IPC Server handler 1 on 10020] ERROR hs.JHSDelegationTokenSecretManager: Unable to update token 35408
java.io.IOException: Could not rename hdfs:/xx/tokens/tb_408/tmp-token_35408 to hdfs:/xx/tokens/tb_408/token_35408
        at org.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreService.createFile(HistoryServerFileSystemStateStoreService.java:229)
        at org.apache.hadoop.mapreduce.v2.hs.HistoryServerFileSystemStateStoreService.updateToken(HistoryServerFileSystemStateStoreService.java:139)
        at org.apache.hadoop.mapreduce.v2.hs.JHSDelegationTokenSecretManager.updateStoredToken(JHSDelegationTokenSecretManager.java:131)
        at org.apache.hadoop.mapreduce.v2.hs.JHSDelegationTokenSecretManager.updateStoredToken(JHSDelegationTokenSecretManager.java:38)
        at org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager.renewToken(AbstractDelegationTokenSecretManager.java:397)
        at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.renewDelegationToken(HistoryClientService.java:377)
        at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.renewDelegationToken(MRClientProtocolPBServiceImpl.java:272)
        at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:299)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1588)
        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)
{noformat}

> HistoryServerFileSystemStateStore fails to update tokens
> --------------------------------------------------------
>
>                 Key: MAPREDUCE-6010
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6010
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: jobhistoryserver
>    Affects Versions: 2.3.0
>            Reporter: Jason Lowe
>
> When token recovery is enabled and the file system state store is being used then tokens fail to be updated due to a rename destination conflict.



--
This message was sent by Atlassian JIRA
(v6.2#6252)