You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Vitásek,
Ladislav <vi...@avast.com> on 2017/02/10 10:39:58 UTC
HDFS Shell tool
Hello Spark fans,
I would like to inform you about our tool we want to share in big data
community. I think it can be also handy for Spark users.
We created a new utility - HDFS Shell to work with HDFS data more easily.
https://github.com/avast/hdfs-shell
*Feature highlights*
- HDFS DFS command initiates JVM for each command call, HDFS Shell does it
only once - which means great speed enhancement when you need to work with
HDFS more often
- Commands can be used in a short way - eg. *hdfs dfs -ls /*, *ls /* - both
will work
- *HDFS path completion using TAB key*
- you can easily add any other HDFS manipulation function
- there is a command history persisting in history log
(~/.hdfs-shell/hdfs-shell.log)
- support for relative directory + commands *cd* and *pwd*
- it can be also launched as a daemon (using UNIX domain sockets)
- 100% Java, it's open source
Your suggestions are welcome.
-L. Vitasek aka Vity