You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Subroto Sanyal (JIRA)" <ji...@apache.org> on 2016/09/01 15:00:27 UTC

[jira] [Updated] (TEZ-3424) Yarn trying to renew token as user 'nobody'

     [ https://issues.apache.org/jira/browse/TEZ-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Subroto Sanyal updated TEZ-3424:
--------------------------------
    Description: 
Tez jobs are failing with the exception:
{noformat}Caused by: org.apache.tez.dag.api.TezException: Failed to submit application to YARN, applicationId=application_1471954345692_0109, diagnostics=Failed to renew token: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:subbu-dev, Ident: (HDFS_DELEGATION_TOKEN token 34599 for ssanyal)
	at org.apache.tez.client.TezYarnClient.submitApplication(TezYarnClient.java:75)
	at org.apache.tez.client.TezClient.start(TezClient.java:365){noformat}

On the namenode side there is warn log
{noformat}209387 2016-08-24 13:43:03,305 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yarn/somehost.ec2.internal@EC2.INTERNAL (auth:KERBEROS) cause:org.apache.hadoop.security.AccessControlException: yarn tries to renew a token with renewer nobody
{noformat}

This looks very similar to MAPREDUCE-6484 and upon looking into the code of {{org.apache.tez.common.security.Master}} shows the same issue.

  was:
Tez jobs are failing with the exception:
{noformat}Caused by: org.apache.tez.dag.api.TezException: Failed to submit application to YARN, applicationId=application_1471954345692_0109, diagnostics=Failed to renew token: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:datalab-dev, Ident: (HDFS_DELEGATION_TOKEN token 34599 for veshikh)
	at org.apache.tez.client.TezYarnClient.submitApplication(TezYarnClient.java:75)
	at org.apache.tez.client.TezClient.start(TezClient.java:365){noformat}

On the namenode side there is warn log
{noformat}209387 2016-08-24 13:43:03,305 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yarn/somehost.ec2.internal@EC2.INTERNAL (auth:KERBEROS) cause:org.apache.hadoop.security.AccessControlException: yarn tries to renew a token with renewer nobody
{noformat}

This looks very similar to MAPREDUCE-6484 and upon looking into the code of {{org.apache.tez.common.security.Master}} shows the same issue.


> Yarn trying to renew token as user 'nobody'
> -------------------------------------------
>
>                 Key: TEZ-3424
>                 URL: https://issues.apache.org/jira/browse/TEZ-3424
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.6.1
>            Reporter: Subroto Sanyal
>
> Tez jobs are failing with the exception:
> {noformat}Caused by: org.apache.tez.dag.api.TezException: Failed to submit application to YARN, applicationId=application_1471954345692_0109, diagnostics=Failed to renew token: Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:subbu-dev, Ident: (HDFS_DELEGATION_TOKEN token 34599 for ssanyal)
> 	at org.apache.tez.client.TezYarnClient.submitApplication(TezYarnClient.java:75)
> 	at org.apache.tez.client.TezClient.start(TezClient.java:365){noformat}
> On the namenode side there is warn log
> {noformat}209387 2016-08-24 13:43:03,305 WARN org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yarn/somehost.ec2.internal@EC2.INTERNAL (auth:KERBEROS) cause:org.apache.hadoop.security.AccessControlException: yarn tries to renew a token with renewer nobody
> {noformat}
> This looks very similar to MAPREDUCE-6484 and upon looking into the code of {{org.apache.tez.common.security.Master}} shows the same issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)