You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by Manoj Babu <ma...@gmail.com> on 2012/12/09 08:03:07 UTC
IOException:Error Recovery for block
Hi All,
When grepping the error logs i could see the below for a job which process
some 500GB of data. What would be the cause and how to avoid it further?
java.io.IOException: Error Recovery for block
blk_4907953961673137346_1929435 failed because recovery from primary
datanode 12.104.0.154:50010 failed 6 times. Pipeline was
12.104.0.154:50010. Aborting...
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
Cheers!
Manoj.
Re: IOException:Error Recovery for block
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
Can you let us know which Hadoop version you are using?
Thanks
ac
On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:
> Hi All,
>
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
>
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed because recovery from primary datanode 12.104.0.154:50010 failed 6 times. Pipeline was 12.104.0.154:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
>
> Cheers!
> Manoj.
>
Re: IOException:Error Recovery for block
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
Can you let us know which Hadoop version you are using?
Thanks
ac
On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:
> Hi All,
>
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
>
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed because recovery from primary datanode 12.104.0.154:50010 failed 6 times. Pipeline was 12.104.0.154:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
>
> Cheers!
> Manoj.
>
Re: IOException:Error Recovery for block
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
Can you let us know which Hadoop version you are using?
Thanks
ac
On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:
> Hi All,
>
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
>
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed because recovery from primary datanode 12.104.0.154:50010 failed 6 times. Pipeline was 12.104.0.154:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
>
> Cheers!
> Manoj.
>
Re: IOException:Error Recovery for block
Posted by "ac@hsk.hk" <ac...@hsk.hk>.
Hi,
Can you let us know which Hadoop version you are using?
Thanks
ac
On 9 Dec 2012, at 3:03 PM, Manoj Babu wrote:
> Hi All,
>
> When grepping the error logs i could see the below for a job which process some 500GB of data. What would be the cause and how to avoid it further?
>
> java.io.IOException: Error Recovery for block blk_4907953961673137346_1929435 failed because recovery from primary datanode 12.104.0.154:50010 failed 6 times. Pipeline was 12.104.0.154:50010. Aborting...
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2833)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305)
> at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477)
>
> Cheers!
> Manoj.
>