You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Vitásek, Ladislav <vi...@avast.com> on 2017/02/10 10:39:58 UTC

HDFS Shell tool

Hello Spark fans,
I would like to inform you about our tool we want to share in big data
community. I think it can be also handy for Spark users.

We created a new utility - HDFS Shell to work with HDFS data more easily.

https://github.com/avast/hdfs-shell

*Feature highlights*
- HDFS DFS command initiates JVM for each command call, HDFS Shell does it
only once - which means great speed enhancement when you need to work with
HDFS more often
- Commands can be used in a short way - eg. *hdfs dfs -ls /*, *ls /* - both
will work
- *HDFS path completion using TAB key*
- you can easily add any other HDFS manipulation function
- there is a command history persisting in history log
(~/.hdfs-shell/hdfs-shell.log)
- support for relative directory + commands *cd* and *pwd*
- it can be also launched as a daemon (using UNIX domain sockets)
- 100% Java, it's open source

Your suggestions are welcome.

-L. Vitasek aka Vity