[jira] [Updated] (HADOOP-12563) Updated utility to create/modify token files

["Matthew Paduano (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HADOOP-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Matthew Paduano updated HADOOP-12563:
-------------------------------------
    Attachment: HADOOP-12563.07.patch

additions:
   - better unit test coverage
   - make fetchdt use legacy output API
   - improve print function

tested via:
   - unittests
   - test-patch
   - manual test of fetchdt token
   - manual test of aliased token file from external host, e.g.
on host A (10.0.2.28):
hadoop dtutil get hdfs://localhost:9000/ -alias 10.0.2.28:9000 manual_test_alias
ssh -L 10.0.2.28:9000:127.0.0.1:9000 10.0.2.28

on host B (e.g. 10.0.2.24):
scp 10.0.2.28:/home/mattp/manual_test_alias .
HADOOP_TOKEN_FILE_LOCATION=/Users/mattp/dev/HADOOP/hadoop/manual_test_alias hadoop fs -ls hdfs://10.0.2.28:9000/user

> Updated utility to create/modify token files
> --------------------------------------------
>
>                 Key: HADOOP-12563
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12563
>             Project: Hadoop Common
>          Issue Type: New Feature
>    Affects Versions: 3.0.0
>            Reporter: Allen Wittenauer
>            Assignee: Matthew Paduano
>         Attachments: HADOOP-12563.01.patch, HADOOP-12563.02.patch, HADOOP-12563.03.patch, HADOOP-12563.04.patch, HADOOP-12563.05.patch, HADOOP-12563.06.patch, HADOOP-12563.07.patch, example_dtutil_commands_and_output.txt, generalized_token_case.pdf
>
>
> hdfs fetchdt is missing some critical features and is geared almost exclusively towards HDFS operations.  Additionally, the token files that are created use Java serializations which are hard/impossible to deal with in other languages. It should be replaced with a better utility in common that can read/write protobuf-based token files, has enough flexibility to be used with other services, and offers key functionality such as append and rename. The old version file format should still be supported for backward compatibility, but will be effectively deprecated.
> A follow-on JIRA will deprecrate fetchdt.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)