You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "John Zhuge (JIRA)" <ji...@apache.org> on 2017/04/18 15:38:41 UTC
[jira] [Commented] (HADOOP-13372) MR jobs can not access Swift
filesystem if Kerberos is enabled
[ https://issues.apache.org/jira/browse/HADOOP-13372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972930#comment-15972930 ]
John Zhuge commented on HADOOP-13372:
-------------------------------------
{{AdlFileSystem}} works without a similar patch because the authority in {{adl:}} URI is a valid hostname, so {{getCanonicalServiceName#getCanonicalServiceName}} works fine.
> MR jobs can not access Swift filesystem if Kerberos is enabled
> --------------------------------------------------------------
>
> Key: HADOOP-13372
> URL: https://issues.apache.org/jira/browse/HADOOP-13372
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs, fs/swift, security
> Affects Versions: 2.7.2
> Reporter: ramtin
> Assignee: ramtin
> Attachments: HADOOP-13372.001.patch
>
>
> {code}
> java.lang.IllegalArgumentException: java.net.UnknownHostException:
> at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:378)
> at org.apache.hadoop.security.SecurityUtil.buildDTServiceName(SecurityUtil.java:262)
> at org.apache.hadoop.fs.FileSystem.getCanonicalServiceName(FileSystem.java:303)
> at org.apache.hadoop.fs.FileSystem.collectDelegationTokens(FileSystem.java:524)
> at org.apache.hadoop.fs.FileSystem.addDelegationTokens(FileSystem.java:508)
> at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:121)
> at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
> at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
> at org.apache.hadoop.tools.mapred.CopyOutputFormat.checkOutputSpecs(CopyOutputFormat.java:121)
> at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:266)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
> at org.apache.hadoop.tools.DistCp.createAndSubmitJob(DistCp.java:183)
> at org.apache.hadoop.tools.DistCp.execute(DistCp.java:153)
> at org.apache.hadoop.tools.DistCp.run(DistCp.java:126)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.tools.DistCp.main(DistCp.java:430)
> Caused by: java.net.UnknownHostException:
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org