You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sandeep Devaiah (Jira)" <ji...@apache.org> on 2020/10/13 14:05:00 UTC

[jira] [Created] (GOBBLIN-1286) Support fetching multiple DFS tokens for HDFS Federation

Sandeep Devaiah created GOBBLIN-1286:
----------------------------------------

             Summary: Support fetching multiple DFS tokens for HDFS Federation
                 Key: GOBBLIN-1286
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1286
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: misc
            Reporter: Sandeep Devaiah


Currently org.apache.gobblin.util.hadoop.TokenUtils#getHdfsToken adds the DistributedFileSystem's delegation token to the Credential's object. However, if the DFS is federated, then only one token for the primary name node is fetched and tokens for child namenodes are not fetched.

Hence this method needs to be updated to use org.apache.hadoop.fs.FileSystem#addDelegationTokens instead of org.apache.hadoop.fs.FileSystem#getDelegationTokens which automatically fetches the delegation tokens for all child FS as well.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)