You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by cm...@apache.org on 2014/10/22 22:28:40 UTC
git commit: HDFS-7254. Add documentation for hot swaping DataNode
drives (Lei Xu via Colin P. McCabe) (cherry picked from commit
66e8187ea1dbc6230ab2c633e4f609a7068b75db)
Repository: hadoop
Updated Branches:
refs/heads/branch-2 5e6494ea9 -> c212347d3
HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via Colin P. McCabe)
(cherry picked from commit 66e8187ea1dbc6230ab2c633e4f609a7068b75db)
Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/c212347d
Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/c212347d
Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/c212347d
Branch: refs/heads/branch-2
Commit: c212347d3249a4d38813ccf8dc607d40af8a0e4b
Parents: 5e6494e
Author: Colin Patrick Mccabe <cm...@cloudera.com>
Authored: Wed Oct 22 13:27:51 2014 -0700
Committer: Colin Patrick Mccabe <cm...@cloudera.com>
Committed: Wed Oct 22 13:28:34 2014 -0700
----------------------------------------------------------------------
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt | 3 +++
.../src/site/apt/HDFSCommands.apt.vm | 7 +++++++
.../src/site/apt/HdfsUserGuide.apt.vm | 20 ++++++++++++++++++++
3 files changed, 30 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c212347d/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
index 662aac3..73838ef 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
+++ b/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
@@ -28,6 +28,9 @@ Release 2.7.0 - UNRELEASED
HDFS-7221. TestDNFencingWithReplication fails consistently. (Charles Lamb via wang)
+ HDFS-7254. Add documentation for hot swaping DataNode drives (Lei Xu via
+ Colin P. McCabe)
+
OPTIMIZATIONS
BUG FIXES
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c212347d/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
index 7085110..8a212d1 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
+++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HDFSCommands.apt.vm
@@ -191,6 +191,7 @@ HDFS Commands Guide
[-refreshSuperUserGroupsConfiguration]
[-refreshCallQueue]
[-refresh <host:ipc_port> <key> [arg1..argn]]
+ [-reconfig <datanode|...> <host:ipc_port> <start|status>]
[-printTopology]
[-refreshNamenodes datanodehost:port]
[-deleteBlockPool datanode-host:port blockpoolId [force]]
@@ -284,6 +285,12 @@ HDFS Commands Guide
| of the resource specified by \<key\> on \<host:ipc_port\>.
| All other args after are sent to the host.
*-----------------+-----------------------------------------------------------+
+| -reconfig <datanode|...> <host:ipc_port> <start|status> | Start
+ | reconfiguration or get the status of an ongoing
+ | reconfiguration. The second parameter specifies the node
+ | type. Currently, only reloading DataNode's configuration is
+ | supported.
+*-----------------+-----------------------------------------------------------+
| -printTopology | Print a tree of the racks and their nodes as reported by
| the Namenode
*-----------------+-----------------------------------------------------------+
http://git-wip-us.apache.org/repos/asf/hadoop/blob/c212347d/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
----------------------------------------------------------------------
diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
index 55208c9..25a466e 100644
--- a/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
+++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsUserGuide.apt.vm
@@ -486,6 +486,26 @@ HDFS Users Guide
This is because data inconsistency can result if an edit log operation
refers to the destination of an automatically renamed file.
+* DataNode Hot Swap Drive
+
+ Datanode supports hot swappable drives. The user can add or replace HDFS data
+ volumes without shutting down the DataNode. The following briefly describes
+ the typical hot swapping drive procedure:
+
+ * If there are new storage directories, the user should format them and mount them
+ appropriately.
+
+ * The user updates the DataNode configuration <<<dfs.datanode.data.dir>>>
+ to reflect the data volume directories that will be actively in use.
+
+ * The user runs <<<dfsadmin -reconfig datanode HOST:PORT start>>> to start
+ the reconfiguration process. The user can use <<<dfsadmin -reconfig
+ datanode HOST:PORT status>>> to query the running status of the reconfiguration
+ task.
+
+ * Once the reconfiguration task has completed, the user can safely <<<umount>>>
+ the removed data volume directories and physically remove the disks.
+
* File Permissions and Security
The file permissions are designed to be similar to file permissions on