[jira] [Updated] (KNOX-2240) KnoxShell Custom Command for WEBHDFS Use

["Larry McCay (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KNOX-2240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Larry McCay updated KNOX-2240:
------------------------------
    Fix Version/s: 1.4.0

> KnoxShell Custom Command for WEBHDFS Use
> ----------------------------------------
>
>                 Key: KNOX-2240
>                 URL: https://issues.apache.org/jira/browse/KNOX-2240
>             Project: Apache Knox
>          Issue Type: Improvement
>          Components: KnoxShell
>            Reporter: Larry McCay
>            Assignee: Larry McCay
>            Priority: Major
>             Fix For: 1.4.0
>
>
> I'd like to extend the KnoxShell environment to have a Custom Command for interacting with Hadoop FileSystems that support the WebHDFS REST API. We will wrap the use of the KnoxShell HDFS classes for posix like commands in the shell environment.
> In order to interact with multiple webhdfs filesystems we introduce the notion of mounting a webhdfs service from a Knox topology URL. For instance, see the following mount command to mount such a service to a mount point:
> {code}
> :fs mount https://knoxhost.example.com/cdp-retail-2-5-dataeng/cdp-proxy-api retail
> {code}
> The above mounts a Hadoop filesystem to a mount point called "retail".
> Given this mounted filesystem we are able to interact with it through the mountpoint as the root.
> {code}
> :fs ls /retail/user/lmccay
> {code}
> The above will list the contents of my home directory from the mounted filesystem as well as return the listing as a KnoxShellTable that can be sorted, selected, filtered, etc as any other KnoxShellTable.
> Additional commands
> {code}
> :fs mkdir /retail/user/lmccay/tmp 755
> :fs cat /retail/user/lmccay/tmp/README
> :fs put /retail/user/lmccay/tmp/README
> :fs get /retail/user/lmccay/tmp/README /home/lmccay/README
> :fs rename /retail/user/lmccay/tmp/README /retail/user/lmccay/tmp/README2
> :fs rm /retail/user/lmccay/tmp/README
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)