You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by Apache Wiki <wi...@apache.org> on 2010/03/20 00:44:42 UTC

[Hadoop Wiki] Update of "HdfsFutures" by SanjayRadia

Dear Wiki user,

You have subscribed to a wiki page or wiki category on "Hadoop Wiki" for change notification.

The "HdfsFutures" page has been changed by SanjayRadia.
http://wiki.apache.org/hadoop/HdfsFutures?action=diff&rev1=8&rev2=9

--------------------------------------------------

     * Read-only Replicas of NN
        * Scales performance but not namespace
        * Adds reliability and one of the steps towards HA
-    * Partition Namespace: Multiple namespace volumes
+    * Partition Namespace statically: Multiple namespace volumes
        * Scales both
        * Retains HDFS’s design philosophy but need a simplified automounter and management of horizontal scaling of NN servers
+    * A truly distributed name server that automatically partitions the namespace dynamically 
     * Split function on NN (Namespace and Block maps)
        * scales name space x3, a little performance scaling
     * Page-in partial name space from disk (as in traditional FSs)
@@ -118, +119 @@

  
  Partition/distribute Name node (will also help performance)
     <<BR>>Several Options:
-    * Partition the namespace hierarchically and mount the volumes
+    * Statically Partition the namespace hierarchically and mount the volumes
        * In this scheme, there are multiple namespace volumes in a cluster.
        * All the name space volumes share the physical block storage (i.e. One storage pool)
        * Optionally All namespaces (ie volumes) are mounted at top level using an automounter like approach
        * A namepace can be explicitly mounted on to a node in another namename (a la mount in Posix)
           * Note the Cepf file system [ref] partitions automatically and mounts the partition
  
-    * Partition by a hash function - clients go to one NN by hashing the name
+    * A truly distributed name service that partitions the namespace dynamically.
  
     *    Only keep part of the namespace in memory.
        * This like a tradional file system where the entire namepsace is stored in secondary and page-in as needed.