You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2020/10/16 13:44:00 UTC
[jira] [Updated] (GOBBLIN-1286) Support fetching multiple DFS
tokens for HDFS Federation
[ https://issues.apache.org/jira/browse/GOBBLIN-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sudarshan Vasudevan updated GOBBLIN-1286:
-----------------------------------------
Fix Version/s: 0.16.0
Affects Version/s: 0.15.0
> Support fetching multiple DFS tokens for HDFS Federation
> --------------------------------------------------------
>
> Key: GOBBLIN-1286
> URL: https://issues.apache.org/jira/browse/GOBBLIN-1286
> Project: Apache Gobblin
> Issue Type: Improvement
> Components: misc
> Affects Versions: 0.15.0
> Reporter: Sandeep Devaiah
> Priority: Major
> Fix For: 0.16.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Currently org.apache.gobblin.util.hadoop.TokenUtils#getHdfsToken adds the DistributedFileSystem's delegation token to the Credential's object. However, if the DFS is federated, then only one token for the primary name node is fetched and tokens for child namenodes are not fetched.
> Hence this method needs to be updated to use org.apache.hadoop.fs.FileSystem#addDelegationTokens instead of org.apache.hadoop.fs.FileSystem#getDelegationTokens which automatically fetches the delegation tokens for all child FS as well.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)