You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-user@hadoop.apache.org by ccxixicc <cc...@foxmail.com> on 2011/05/25 08:38:33 UTC

What if one of the directory(dfs.name.dir) rw error ?

Hi,all

I set dfs.name.dir to a comma-delimited list of directories, dir1 is in /dev/sdb1 dir2 is in /dev/sdb2 and dir3 is nfs derectory.
What happens if /dev/sdb1 disk error, so dir1 cannot be read and write?

What happens if nfs server down, so dir3 cannot be read and write?
Will hadoop ignore the bad directory and use the good directory and continue server?

Thanks.

Re: What if one of the directory(dfs.name.dir) rw error ?

Posted by Harsh J <ha...@cloudera.com>.

Yes. But depending on the version you're using, you may have to
manually restart the NN after fixing the mount points, to get the
directories in action again.

2011/5/25 ccxixicc <cc...@foxmail.com>:
>
> Hi,all
> I set dfs.name.dir to a comma-delimited list of directories, dir1 is in
> /dev/sdb1 dir2 is in /dev/sdb2 and dir3 is nfs derectory.
> What happens if /dev/sdb1 disk error, so dir1 cannot be read and write?
> What happens if nfs server down, so dir3 cannot be read and write?
> Will hadoop ignore the bad directory and use the good directory and continue
> server?
> Thanks.
>



-- 
Harsh J

Re: What if one of the directory(dfs.name.dir) rw error ?

Posted by Tom Hall <th...@gmail.com>.

In my experience I had to edit hdfs and mapred setup on a server with
a disk missing.

Tom

2011/5/25 ccxixicc <cc...@foxmail.com>:
>
> Hi,all
> I set dfs.name.dir to a comma-delimited list of directories, dir1 is in
> /dev/sdb1 dir2 is in /dev/sdb2 and dir3 is nfs derectory.
> What happens if /dev/sdb1 disk error, so dir1 cannot be read and write?
> What happens if nfs server down, so dir3 cannot be read and write?
> Will hadoop ignore the bad directory and use the good directory and continue
> server?
> Thanks.
>