You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Jesse Hires <jh...@gmail.com> on 2009/10/17 02:16:03 UTC
ERROR datanode.DataNode - DatanodeRegistration ...
BlockAlreadyExistsException
Does anyone have any insight into the following error I am seeing in the
hadoop logs? Is this something I should be concerned with, or is it expected
that this shows up in the logs from time to time? If it is not expected,
where can I look for more information on what is going on?
2009-10-16 17:02:43,061 ERROR datanode.DataNode -
DatanodeRegistration(192.168.1.7:50010,
storageID=DS-1226842861-192.168.1.7-50010-1254609174303,
infoPort=50075, ipcPort=50020):DataXceiver
org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException:
Block blk_909837363833332565_3277 is valid, and cannot be written to.
at org.apache.hadoop.hdfs.server.datanode.FSDataset.writeToBlock(FSDataset.java:975)
at org.apache.hadoop.hdfs.server.datanode.BlockReceiver.<init>(BlockReceiver.java:97)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:259)
at org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:103)
at java.lang.Thread.run(Thread.java:636)
I am able to produce this just injecting the urls (2 of them), but it shows
up on both datanodes, and happens whenever I run an opperation that uses
dfs.
I am running the latest sources from the trunk.
Admittedly this is running on low end hardware.
Two data nodes, both configured identical. Atom 330 proc, 2gigs ram, 320g
SATA 3.0 hard drive, Fedora Core 10.
One name node, running some amd x86 proc, 2 gigs memory, 750g SATA, Fedora
Core 10.
All across a 100mb network.
Jesse
int GetRandomNumber()
{
return 4; // Chosen by fair roll of dice
// Guaranteed to be random
} // xkcd.com
Re: ERROR datanode.DataNode - DatanodeRegistration ...
BlockAlreadyExistsException
Posted by Jesse Hires <jh...@gmail.com>.
I verified on both of the datanodes, the only nutch processes running are
one instance each of:
org.apache.hadoop.hdfs.server.datanode.DataNode
and
org.apache.hadoop.mapred.TaskTracker
Jesse
int GetRandomNumber()
{
return 4; // Chosen by fair roll of dice
// Guaranteed to be random
} // xkcd.com
On Sat, Oct 17, 2009 at 11:49 AM, Andrzej Bialecki <ab...@getopt.org> wrote:
> Jesse Hires wrote:
>
>> Does anyone have any insight into the following error I am seeing in the
>> hadoop logs? Is this something I should be concerned with, or is it
>> expected
>> that this shows up in the logs from time to time? If it is not expected,
>> where can I look for more information on what is going on?
>>
>> 2009-10-16 17:02:43,061 ERROR datanode.DataNode -
>> DatanodeRegistration(192.168.1.7:50010,
>> storageID=DS-1226842861-192.168.1.7-50010-1254609174303,
>> infoPort=50075, ipcPort=50020):DataXceiver
>> org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException:
>> Block blk_909837363833332565_3277 is valid, and cannot be written to.
>>
>
> Are you sure you are running a single datanode process per machine?
>
>
> --
> Best regards,
> Andrzej Bialecki <><
> ___. ___ ___ ___ _ _ __________________________________
> [__ || __|__/|__||\/| Information Retrieval, Semantic Web
> ___|||__|| \| || | Embedded Unix, System Integration
> http://www.sigram.com Contact: info at sigram dot com
>
>
Re: ERROR datanode.DataNode - DatanodeRegistration ... BlockAlreadyExistsException
Posted by Andrzej Bialecki <ab...@getopt.org>.
Jesse Hires wrote:
> Does anyone have any insight into the following error I am seeing in the
> hadoop logs? Is this something I should be concerned with, or is it expected
> that this shows up in the logs from time to time? If it is not expected,
> where can I look for more information on what is going on?
>
> 2009-10-16 17:02:43,061 ERROR datanode.DataNode -
> DatanodeRegistration(192.168.1.7:50010,
> storageID=DS-1226842861-192.168.1.7-50010-1254609174303,
> infoPort=50075, ipcPort=50020):DataXceiver
> org.apache.hadoop.hdfs.server.datanode.BlockAlreadyExistsException:
> Block blk_909837363833332565_3277 is valid, and cannot be written to.
Are you sure you are running a single datanode process per machine?
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com