HDFS: What happens when a harddrive fails

[Cagdas Gerede <ca...@gmail.com>]

I was wondering
1) what happens if a data node is alive but its harddrive fails? Does it
throw an exception and dies?
2) If It continues to run and continue to do blockreporting, is there a
console showing datanodes with healthy hard drives and unhealthy hard
drives? I know the web server of the name node shows runing and not running
data nodes, but I am not sure if it differentiates between datanodes with
healthy and unhealthy hard drives.

Thanks for your help
Cagdas

Most excellent Hadoop Summit

[C G <pa...@yahoo.com>]

Dear Yahoo, Amazon, and Hadoop Community:
   
  Thank you very much for a very well-done Hadoop Summit.  It came as a complete surprise that a FREE conference would include breakfast, lunch, snacks, happy hour, and swag - very classy and very nice.
   
  All the presentations and discussions were interesting (and I do mean ALL), and I learned a great deal in a very short time.  Thanks to the presenters for doing a good job preparing and an equally fine job presenting.  
   
  It was also a lot of fun putting faces to the names we see on the email list and having some time to chat and network with everyone.
   
  The day-ending roundtable on the future of Hadoop made it clear that all the major players and participants are in this for the long-haul.  Thanks to all for presenting what I thought was a very clear, very logical roadmap.
   
  I'm back in Boston after having flown out to the valley literally just to attend the Summit.  It was money and time well spent to attend (and I can't wait until the airlines provide in-flight internet access...).   I would like to encourage everyone to consider future Summits, with perhaps an even larger venue if possible - I know that I would be willing to pay the usual conference registration fees to attend.
   
  In short:  Well done...bravo.
   
  Thanks,
  Chris
   

       
---------------------------------
Looking for last minute shopping deals?  Find them fast with Yahoo! Search.

Re: HDFS: What happens when a harddrive fails

[Ted Dunning <td...@veoh.com>]

It depends on the failure.

For some failure modes, the disk just becomes very slow.


On 3/26/08 4:39 PM, "Cagdas Gerede" <ca...@gmail.com> wrote:

> I was wondering
> 1) what happens if a data node is alive but its harddrive fails? Does it
> throw an exception and dies?
> 2) If It continues to run and continue to do blockreporting, is there a
> console showing datanodes with healthy hard drives and unhealthy hard
> drives? I know the web server of the name node shows runing and not running
> data nodes, but I am not sure if it differentiates between datanodes with
> healthy and unhealthy hard drives.
> 
> Thanks for your help
> Cagdas