You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "He Xiaoqiao (JIRA)" <ji...@apache.org> on 2018/04/27 03:30:00 UTC
[jira] [Commented] (HADOOP-15419) Should not obtain
delegationTokens from all namenodes when using ViewFS
[ https://issues.apache.org/jira/browse/HADOOP-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16455704#comment-16455704 ]
He Xiaoqiao commented on HADOOP-15419:
--------------------------------------
[~Tao Jie]
{quote}In viewfs situation, we can just obtain delegation token from specific namenode rather than all namenodes.{quote}
It sounds a good idea, but I am confused that how to take out `specific namenode` we need to obtain delegation token from.
In fact, some request path may be found after task running (for one simple instance: hard code path in MapReduce/Spark job), if we don't obtain delegation token for that NameNode, the Job will be fail due to all tasks can not pass authentication.
In one word, It seems that we have to obtain all delegation token for all namespace under current token mechanism.
If I am wrong please correct me.
> Should not obtain delegationTokens from all namenodes when using ViewFS
> -----------------------------------------------------------------------
>
> Key: HADOOP-15419
> URL: https://issues.apache.org/jira/browse/HADOOP-15419
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 3.0.2
> Reporter: Tao Jie
> Priority: Major
>
> Today when submit a job to a viewfs cluster, the client will try to obtain delegation token from all namenodes under the viewfs while only one namespace is actually used in this job. It would create many unnecessary rpc call to the whole cluster.
> In viewfs situation, we can just obtain delegation token from specific namenode rather than all namenodes.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org