You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@knox.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2020/03/23 08:21:01 UTC

[jira] [Work logged] (KNOX-2240) KnoxShell Custom Command for WEBHDFS Use

     [ https://issues.apache.org/jira/browse/KNOX-2240?focusedWorklogId=407755&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-407755 ]

ASF GitHub Bot logged work on KNOX-2240:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 23/Mar/20 08:20
            Start Date: 23/Mar/20 08:20
    Worklog Time Spent: 10m 
      Work Description: smolnar82 commented on pull request #296: KNOX-2240 - KnoxShell Custom Command for WEBHDFS Use
URL: https://github.com/apache/knox/pull/296#discussion_r396255177
 
 

 ##########
 File path: gateway-shell/src/main/java/org/apache/knox/gateway/shell/KnoxSession.java
 ##########
 @@ -661,6 +676,20 @@ public static void persistDataSources(Map<String, KnoxDataSource> datasources) {
     return sqlHistories;
   }
 
+  public static Map<String, String> loadMountPoints() throws IOException {
+    Map<String, String> mounts = null;
+    String home = System.getProperty("user.home");
+
+    File mountFile = new File(
+        home + File.separator +
+        ".knoxshell" + File.separator + KNOXMOUNTPOINTS_JSON);
 
 Review comment:
   I'd recommend using `https://docs.oracle.com/javase/8/docs/api/java/nio/file/Paths.html#get-java.lang.String-java.lang.String...-`
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 407755)
    Time Spent: 40m  (was: 0.5h)

> KnoxShell Custom Command for WEBHDFS Use
> ----------------------------------------
>
>                 Key: KNOX-2240
>                 URL: https://issues.apache.org/jira/browse/KNOX-2240
>             Project: Apache Knox
>          Issue Type: Improvement
>          Components: KnoxShell
>            Reporter: Larry McCay
>            Assignee: Larry McCay
>            Priority: Major
>             Fix For: 1.4.0
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> I'd like to extend the KnoxShell environment to have a Custom Command for interacting with Hadoop FileSystems that support the WebHDFS REST API. We will wrap the use of the KnoxShell HDFS classes for posix like commands in the shell environment.
> In order to interact with multiple webhdfs filesystems we introduce the notion of mounting a webhdfs service from a Knox topology URL. For instance, see the following mount command to mount such a service to a mount point:
> {code}
> :fs mount https://knoxhost.example.com/topology/cdp-proxy-api retail
> {code}
> The above mounts a Hadoop filesystem to a mount point called "retail".
> Given this mounted filesystem we are able to interact with it through the mountpoint as the root.
> {code}
> :fs ls /retail/user/lmccay
> {code}
> The above will list the contents of my home directory from the mounted filesystem as well as return the listing as a KnoxShellTable that can be sorted, selected, filtered, etc as any other KnoxShellTable.
> Additional commands
> {code}
> :fs mkdir /retail/user/lmccay/tmp 755
> :fs cat /retail/user/lmccay/tmp/README
> :fs put /home/lmccay/README /retail/user/lmccay/tmp/README
> :fs get /retail/user/lmccay/tmp/README /home/lmccay/README
> :fs rename /retail/user/lmccay/tmp/README /retail/user/lmccay/tmp/README2
> :fs rm /retail/user/lmccay/tmp/README
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)