You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-commits@hadoop.apache.org by sz...@apache.org on 2011/11/23 23:09:35 UTC
svn commit: r1205630 - in
/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt:
./ Federation.apt.vm WebHDFS.apt.vm
Author: szetszwo
Date: Wed Nov 23 22:09:34 2011
New Revision: 1205630
URL: http://svn.apache.org/viewvc?rev=1205630&view=rev
Log:
svn merge -c 1205626 from trunk for HDFS-2587.
Added:
hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/WebHDFS.apt.vm
- copied unchanged from r1205626, hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/WebHDFS.apt.vm
Modified:
hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/ (props changed)
hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/Federation.apt.vm
Propchange: hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/
------------------------------------------------------------------------------
--- svn:mergeinfo (added)
+++ svn:mergeinfo Wed Nov 23 22:09:34 2011
@@ -0,0 +1,2 @@
+/hadoop/common/trunk/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt:1161777,1161781,1162188,1162421,1162491,1162499,1162613,1162928,1162954,1162979,1163050,1163069,1163490,1163768,1164255,1164301,1164339,1166402,1167001,1167383,1170379,1170459,1171297,1172916,1173402,1176550,1177487,1177531,1177859,1177864,1189932,1189982,1195575,1196113,1196129,1204114,1204117,1204122,1204124,1204129,1204131,1204370,1204376,1204388,1205260,1205626
+/hadoop/core/branches/branch-0.19/mapred/hadoop-yarn/hadoop-yarn-site/src/site/apt:713112
Modified: hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/Federation.apt.vm
URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/Federation.apt.vm?rev=1205630&r1=1205629&r2=1205630&view=diff
==============================================================================
--- hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/Federation.apt.vm (original)
+++ hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/hadoop-yarn/hadoop-yarn-site/src/site/apt/Federation.apt.vm Wed Nov 23 22:09:34 2011
@@ -12,7 +12,7 @@
~~ limitations under the License. See accompanying LICENSE file.
---
- Hadoop Map Reduce Next Generation-${project.version} - Cluster Setup
+ Hadoop Distributed File System-${project.version} - Federation
---
---
${maven.build.timestamp}
@@ -57,12 +57,12 @@ HDFS Federation
* Storage - is provided by datanodes by storing blocks on the local file
system and allows read/write access.
- The current HDFS architecture allows only a single namespace for the
+ The prior HDFS architecture allows only a single namespace for the
entire cluster. A single Namenode manages this namespace. HDFS
- Federation addresses limitation of current architecture by adding
+ Federation addresses limitation of the prior architecture by adding
support multiple Namenodes/namespaces to HDFS file system.
-* {HDFS Federation}
+* {Multiple Namenodes/Namespaces}
In order to scale the name service horizontally, federation uses multiple
independent Namenodes/namespaces. The Namenodes are federated, that is, the
@@ -103,9 +103,9 @@ HDFS Federation
of small files benefit from scaling the namespace by adding more
Namenodes to the cluster
- * Performance - File system operation throughput is currently limited
- by a single Namenode. Adding more Namenodes to the cluster scales the
- file system read/write operations throughput.
+ * Performance - File system operation throughput is limited by a single
+ Namenode in the prior architecture. Adding more Namenodes to the cluster
+ scales the file system read/write operations throughput.
* Isolation - A single Namenode offers no isolation in multi user
environment. An experimental application can overload the Namenode
@@ -265,7 +265,7 @@ HDFS Federation
> $HADOOP_PREFIX_HOME/bin/start-dfs.sh
----
- To start the cluster run the following command:
+ To stop the cluster run the following command:
----
> $HADOOP_PREFIX_HOME/bin/stop-dfs.sh
@@ -300,7 +300,7 @@ HDFS Federation
** Decommissioning
Decommissioning is similar to prior releases. The nodes that need to be
- decommissioning are added to the exclude file at all the Namenode. Each
+ decomissioned are added to the exclude file at all the Namenode. Each
Namenode decommissions its Block Pool. When all the Namenodes finish
decommissioning a datanode, the datanode is considered to be decommissioned.