You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Aaron Kimball (JIRA)" <ji...@apache.org> on 2010/02/05 00:38:28 UTC

[jira] Updated: (HADOOP-273) Add a interactive shell for admistrative access to the DFS

     [ https://issues.apache.org/jira/browse/HADOOP-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Aaron Kimball updated HADOOP-273:
---------------------------------

    Attachment: HADOOP-273.patch

I still care! :)

Alex Loddengaard and I wrote a simple command shell that uses jline (a readline implementation) to create a simple shell that includes some handy features like tab completion for HDFS. This supports access to the various FsShell commands in an interactive fashion.

There's a definite need for something like this -- executing several {{hadoop fs ...}} commands in a bash script or in a regular interactive shell is very time-consuming due to the overhead of starting Java for each such command. Putting all the commands into a single JVM instance is a major win.

When using Hadoop from outside of Java, programs that wish to interact with
the DFS may need to run several commands through the {{hadoop fs ...}} interface, which is
very slow.

This shell:
* Supports interactive use of HDFS (with a reasonable notion of a "current directory", etc)
* Supports executing scripts of several commands

External programs could write a script of several DFS operations and batch them up for execution in a single Java process.

This changes some of the methods (e.g., {{ls()}}) from FsShell to be public instead of package-public so that their code can be reused here.

We tested CmdShell by running the various commands locally, as well as testing short scripts of the commands included together. Some basic functionality unit tests are also included in this patch.

If a committer could please re-open this issue and take a look at the attached code, I'd appreciate it.


> Add a interactive shell for admistrative access to the DFS
> ----------------------------------------------------------
>
>                 Key: HADOOP-273
>                 URL: https://issues.apache.org/jira/browse/HADOOP-273
>             Project: Hadoop Common
>          Issue Type: Improvement
>    Affects Versions: 0.7.1
>            Reporter: Marco Paga
>            Assignee: Sameer Paranjpye
>            Priority: Trivial
>         Attachments: HADOOP-273.patch, interactiveShell.patch, interactiveShell.patch
>
>
> Implement a shell that allows the user to work in the dfs like on the local fs.
> cd /user/
> cd test
> put text.txt someText.txt
> cat someText.txt
> rm someText.txt

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.