You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by HUYLEBROECK Jeremy RD-ILAB-SSF <je...@orange-ft.com> on 2006/08/18 00:43:50 UTC
Hadoop replication warning
On my dev machine, I have dfs.replication set to 1 in
conf/hadoop-site.xml.
But I get those warning messages in hadoop.log
Fs.FSNamesystem - Replication requested of 2 is larger than cluster
size(1). Using cluster size.
Zero targets found, forbidden1.size=1 forbidden2.size()=0
I don't know where the 2 is coming from as hadoop-default.xml set it to
3 and the hadoop code uses also 3 by default.
Also, the hadoop-site.xml is read properly (fs config is properly used
for instance)
Can I completely ignore those warnings or it means that there is
something bad going on?
I use hadoop-0.4 with nutch-0.8
Re: Hadoop replication warning
Posted by Andrzej Bialecki <ab...@getopt.org>.
HUYLEBROECK Jeremy RD-ILAB-SSF wrote:
> On my dev machine, I have dfs.replication set to 1 in
> conf/hadoop-site.xml.
>
> But I get those warning messages in hadoop.log
>
> Fs.FSNamesystem - Replication requested of 2 is larger than cluster
> size(1). Using cluster size.
> Zero targets found, forbidden1.size=1 forbidden2.size()=0
>
> I don't know where the 2 is coming from as hadoop-default.xml set it to
> 3 and the hadoop code uses also 3 by default.
> Also, the hadoop-site.xml is read properly (fs config is properly used
> for instance)
>
> Can I completely ignore those warnings or it means that there is
> something bad going on?
>
> I use hadoop-0.4 with nutch-0.8
>
>
This could indicate a corrupted file (missing blocks). Please run
'hadoop fsck /' and check the output.
--
Best regards,
Andrzej Bialecki <><
___. ___ ___ ___ _ _ __________________________________
[__ || __|__/|__||\/| Information Retrieval, Semantic Web
___|||__|| \| || | Embedded Unix, System Integration
http://www.sigram.com Contact: info at sigram dot com
Re: Hadoop replication warning
Posted by kelvin pang <ke...@gmail.com>.
hi,
what's the meaning of Hadoop ?
2006/8/18, HUYLEBROECK Jeremy RD-ILAB-SSF <jeremy.huylebroeck@orange-ft.com
>:
>
> On my dev machine, I have dfs.replication set to 1 in
> conf/hadoop-site.xml.
>
> But I get those warning messages in hadoop.log
>
> Fs.FSNamesystem - Replication requested of 2 is larger than cluster
> size(1). Using cluster size.
> Zero targets found, forbidden1.size=1 forbidden2.size()=0
>
> I don't know where the 2 is coming from as hadoop-default.xml set it to
> 3 and the hadoop code uses also 3 by default.
> Also, the hadoop-site.xml is read properly (fs config is properly used
> for instance)
>
> Can I completely ignore those warnings or it means that there is
> something bad going on?
>
> I use hadoop-0.4 with nutch-0.8
>
>
--
kevin