You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Jian He (JIRA)" <ji...@apache.org> on 2014/04/18 03:21:17 UTC
[jira] [Updated] (HADOOP-10519) In HDFS HA mode, Distcp/SLive with
webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN,
KERBEROS] error
[ https://issues.apache.org/jira/browse/HADOOP-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jian He updated HADOOP-10519:
-----------------------------
Description:
Opening on [~arpitgupta]'s behalf.
We observed that, in HDFS HA mode, running Distcp/SLive with webhdfs will fail on YARN. In non-HA mode, it'll pass.
The reason is in HA mode, only webhdfs delegation token is generated for the job, but YARN also requires the regular hdfs token to do localization, log-aggregation etc.
In non-HA mode, both tokens are generated for the job.
was:
Opening on [~arpitgupta]'s behalf.
We observed that, in HDFS HA mode, running Distcp/SLive with webhdfs will fail on YARN. In non-HA mode, it'll pass.
The reason is in HA mode, only webhdfs delegation token is generated for the job, but YARN also requires the regular hdfs to do localization, log-aggregation etc.
In non-HA mode, both tokens are generated for the job.
> In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error
> ------------------------------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-10519
> URL: https://issues.apache.org/jira/browse/HADOOP-10519
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Jian He
>
> Opening on [~arpitgupta]'s behalf.
> We observed that, in HDFS HA mode, running Distcp/SLive with webhdfs will fail on YARN. In non-HA mode, it'll pass.
> The reason is in HA mode, only webhdfs delegation token is generated for the job, but YARN also requires the regular hdfs token to do localization, log-aggregation etc.
> In non-HA mode, both tokens are generated for the job.
--
This message was sent by Atlassian JIRA
(v6.2#6252)