You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hadoop.apache.org by dl...@comcast.net on 2015/01/26 19:30:30 UTC

NN config questions

If multiple directories are specified for dfs.namenode.name.dir and dfs.namenode.edits.dir, are the writes to the different directories done in parallel or serial? 

Does dfs.namenode.shared.edits.dir support multiple directories like the properties above? 

Thanks, 
Dave

Re: NN config questions

Posted by Ravi Prakash <ra...@ymail.com>.

Hi Dave!
Here the class which is used to store all the edits : https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java#L575
HTHRavi
 

     On Monday, January 26, 2015 10:32 AM, "dlmarion@comcast.net" <dl...@comcast.net> wrote:
   

 
 If multiple directories are specified for dfs.namenode.name.dir and dfs.namenode.edits.dir, are the writes to the different directories done in parallel or serial?

 Does dfs.namenode.shared.edits.dir support multiple directories like the properties above?

Thanks,
Dave

Re: NN config questions

Posted by Ravi Prakash <ra...@ymail.com>.

Hi Dave!
Here the class which is used to store all the edits : https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java#L575
HTHRavi
 

     On Monday, January 26, 2015 10:32 AM, "dlmarion@comcast.net" <dl...@comcast.net> wrote:
   

 
 If multiple directories are specified for dfs.namenode.name.dir and dfs.namenode.edits.dir, are the writes to the different directories done in parallel or serial?

 Does dfs.namenode.shared.edits.dir support multiple directories like the properties above?

Thanks,
Dave

Re: NN config questions

Posted by Ravi Prakash <ra...@ymail.com>.

Hi Dave!
Here the class which is used to store all the edits : https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java#L575
HTHRavi
 

     On Monday, January 26, 2015 10:32 AM, "dlmarion@comcast.net" <dl...@comcast.net> wrote:
   

 
 If multiple directories are specified for dfs.namenode.name.dir and dfs.namenode.edits.dir, are the writes to the different directories done in parallel or serial?

 Does dfs.namenode.shared.edits.dir support multiple directories like the properties above?

Thanks,
Dave

Re: NN config questions

Posted by Ravi Prakash <ra...@ymail.com>.

Hi Dave!
Here the class which is used to store all the edits : https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java#L575
HTHRavi
 

     On Monday, January 26, 2015 10:32 AM, "dlmarion@comcast.net" <dl...@comcast.net> wrote:
   

 
 If multiple directories are specified for dfs.namenode.name.dir and dfs.namenode.edits.dir, are the writes to the different directories done in parallel or serial?

 Does dfs.namenode.shared.edits.dir support multiple directories like the properties above?

Thanks,
Dave