You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2006/03/23 19:14:20 UTC

[jira] Resolved: (HADOOP-83) infinite retries accessing a missing block

     [ http://issues.apache.org/jira/browse/HADOOP-83?page=all ]
     
Doug Cutting resolved HADOOP-83:
--------------------------------

    Resolution: Fixed

Okay, I've commited this.

Note that this situation can occur while a dfs system is starting up.  If one lanuches the namenode prior to the datanodes then the namenode will know about files but not yet know wherre their blocks are, until the datanodes check in for the first time.  I recently changed the bin/start-all.sh script to start the namenode first, so that datanodes would not all initially report problems connecting to the namenode.  I knew there was a reason that it was done in the other order, but could not remember what the reason was.  Now I remember!  I switched that back and added a comment.

Also, next time, can you please attach a patch file, so that I don't have to manually make your suggested changes?  Thanks!


> infinite retries accessing a missing block
> ------------------------------------------
>
>          Key: HADOOP-83
>          URL: http://issues.apache.org/jira/browse/HADOOP-83
>      Project: Hadoop
>         Type: Bug
>   Components: dfs
>     Versions: 0.1
>     Reporter: Yoram Arnon
>     Assignee: Konstantin Shvachko

>
> A file in the DFS got corrupted - the reason for that is unknown, but might be justified.
> when accessing the file, I get an infinite stream of error messages from the client - attached below.
> The client aparently increments an error counter, but never checks it.
> Correct behaviour is for the client to retry a few times, then abort.
> 060315 105436 No node available for block blk_2690692619196463439
> 060315 105436 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105446 No node available for block blk_2690692619196463439
> 060315 105446 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105456 No node available for block blk_2690692619196463439
> 060315 105456 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105506 No node available for block blk_2690692619196463439
> 060315 105506 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105516 No node available for block blk_2690692619196463439
> 060315 105516 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105526 No node available for block blk_2690692619196463439
> 060315 105526 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105536 No node available for block blk_2690692619196463439
> 060315 105536 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105546 No node available for block blk_2690692619196463439
> 060315 105546 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105556 No node available for block blk_2690692619196463439
> 060315 105556 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105606 No node available for block blk_2690692619196463439
> 060315 105606 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105616 No node available for block blk_2690692619196463439
> 060315 105616 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105626 No node available for block blk_2690692619196463439
> 060315 105626 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105636 No node available for block blk_2690692619196463439
> 060315 105636 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105646 No node available for block blk_2690692619196463439
> 060315 105646 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105657 No node available for block blk_2690692619196463439
> 060315 105657 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105707 No node available for block blk_2690692619196463439
> 060315 105707 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105717 No node available for block blk_2690692619196463439
> 060315 105717 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105727 No node available for block blk_2690692619196463439
> 060315 105727 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105737 No node available for block blk_2690692619196463439
> 060315 105737 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105747 No node available for block blk_2690692619196463439
> 060315 105747 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105757 No node available for block blk_2690692619196463439
> 060315 105757 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105807 No node available for block blk_2690692619196463439
> 060315 105807 Could not obtain block from any node:  java.io.IOException: No live nodes contain current block
> 060315 105817 No node available for block blk_2690692619196463439

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
   http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
   http://www.atlassian.com/software/jira