You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Cagdas Gerede <ca...@gmail.com> on 2008/04/15 00:14:35 UTC

How often Name node fails?

>From your experience with Hadoop Distributed File System,
how reliable is the namenode? How often does it fail? Are there mechanisms
developed outside of Hadoop to make namenode more fault tolerant?

Thanks for your feedback,



-- 
------------
Best Regards, Cagdas Evren Gerede
Home Page: http://cagdasgerede.info

Re: How often Name node fails?

Posted by André Martin <ma...@andremartin.de>.
Hi Cagdas & Michael,
our cluster works fine with no crashes so far even with more than one 
million files - we have 11 datanodes and one namenode...

Cu on the 'net,
                        Bye - bye,

                                   <<<<< André <<<< >>>> èrbnA >>>>>

Michael Bieniosek wrote:
> From my experience, the namenode almost never crashes.  It does use a lot of RAM, but not nearly as much as it used to.  You might have problems if you have many many small files (maybe 100,000s?).
>
> I have had more problems with datanode failures, particularly when there is mapreduce-generated load on the machines running the datanodes.
>
> -Michael
>
> On 4/14/08 3:14 PM, "Cagdas Gerede" <ca...@gmail.com> wrote:
>
> From your experience with Hadoop Distributed File System,
> how reliable is the namenode? How often does it fail? Are there mechanisms
> developed outside of Hadoop to make namenode more fault tolerant?
>
> Thanks for your feedback,

Re: How often Name node fails?

Posted by Michael Bieniosek <mi...@powerset.com>.
>From my experience, the namenode almost never crashes.  It does use a lot of RAM, but not nearly as much as it used to.  You might have problems if you have many many small files (maybe 100,000s?).

I have had more problems with datanode failures, particularly when there is mapreduce-generated load on the machines running the datanodes.

-Michael

On 4/14/08 3:14 PM, "Cagdas Gerede" <ca...@gmail.com> wrote:

>From your experience with Hadoop Distributed File System,
how reliable is the namenode? How often does it fail? Are there mechanisms
developed outside of Hadoop to make namenode more fault tolerant?

Thanks for your feedback,



--
------------
Best Regards, Cagdas Evren Gerede
Home Page: http://cagdasgerede.info