You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Kashif Khadim <ka...@yahoo.com> on 2005/10/30 07:09:25 UTC
mapred error on windows
I am unable to crawl with mapred on windows. I get
this error after i run.
bin/nutch crawl urls
Error:
051030 004819 parsing
file:/C:/nutch/mapred/conf/nutch-default.xml
051030 004819 parsing
file:/C:/nutch/mapred/conf/nutch-site.xml
051030 004819 Server listener on port 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004819 Server handler on 9009: starting
051030 004822 Server connection on port 9009 from
80.139.7.173: starting
051030 004914 Server connection on port 9009 from
80.139.7.173: starting
051030 004931 While choosing target, totalMachines is
0
051030 004931 Target-length is 0, below
MIN_REPLICATION (1)
051030 004931 Server handler on 9009 call error:
java.io.IOException: Cannot create file
/tmp/nutch/mapred/system/submit_ogykqp/job.xml
java.io.IOException: Cannot create file
/tmp/nutch/mapred/system/submit_ogykqp/job.xml
at
org.apache.nutch.ndfs.NameNode.create(NameNode.java:98)
at
sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:582)
at org.apache.nutch.ipc.RPC$1.call(RPC.java:187)
at
org.apache.nutch.ipc.Server$Handler.run(Server.java:198)
051030 004934 Server connection on port 9009 from
80.139.7.173: exiting
Thanks.
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
Re: mapred error on windows
Posted by Kashif Khadim <ka...@yahoo.com>.
Thanks Doug , it is working now.
Kashif.
--- Doug Cutting <cu...@nutch.org> wrote:
> It looks like you are using ndfs but not running any
> datanodes. An ndfs
> filesystem requires one namenode and at least one
> datanode, typically a
> large number running on different machines. Look at
> the
> bin/start-all.sh script for an example of what is
> started in a typical
> mapred/ndfs deployment.
>
> Doug
>
> Kashif Khadim wrote:
> > I am unable to crawl with mapred on windows. I get
> > this error after i run.
> >
> >
> > bin/nutch crawl urls
> >
> > Error:
> >
> > 051030 004819 parsing
> > file:/C:/nutch/mapred/conf/nutch-default.xml
> > 051030 004819 parsing
> > file:/C:/nutch/mapred/conf/nutch-site.xml
> > 051030 004819 Server listener on port 9009:
> starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004819 Server handler on 9009: starting
> > 051030 004822 Server connection on port 9009 from
> > 80.139.7.173: starting
> > 051030 004914 Server connection on port 9009 from
> > 80.139.7.173: starting
> > 051030 004931 While choosing target, totalMachines
> is
> > 0
> > 051030 004931 Target-length is 0, below
> > MIN_REPLICATION (1)
> > 051030 004931 Server handler on 9009 call error:
> > java.io.IOException: Cannot create file
> > /tmp/nutch/mapred/system/submit_ogykqp/job.xml
> > java.io.IOException: Cannot create file
> > /tmp/nutch/mapred/system/submit_ogykqp/job.xml
> > at
> >
>
org.apache.nutch.ndfs.NameNode.create(NameNode.java:98)
> > at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> > at
> >
>
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > at
> >
>
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at
> java.lang.reflect.Method.invoke(Method.java:582)
> > at org.apache.nutch.ipc.RPC$1.call(RPC.java:187)
> > at
> >
>
org.apache.nutch.ipc.Server$Handler.run(Server.java:198)
> > 051030 004934 Server connection on port 9009 from
> > 80.139.7.173: exiting
> >
> >
> > Thanks.
> >
> >
> > __________________________________________________
> > Do You Yahoo!?
> > Tired of spam? Yahoo! Mail has the best spam
> protection around
> > http://mail.yahoo.com
>
__________________________________
Yahoo! Mail - PC Magazine Editors' Choice 2005
http://mail.yahoo.com
Re: mapred error on windows
Posted by Doug Cutting <cu...@nutch.org>.
It looks like you are using ndfs but not running any datanodes. An ndfs
filesystem requires one namenode and at least one datanode, typically a
large number running on different machines. Look at the
bin/start-all.sh script for an example of what is started in a typical
mapred/ndfs deployment.
Doug
Kashif Khadim wrote:
> I am unable to crawl with mapred on windows. I get
> this error after i run.
>
>
> bin/nutch crawl urls
>
> Error:
>
> 051030 004819 parsing
> file:/C:/nutch/mapred/conf/nutch-default.xml
> 051030 004819 parsing
> file:/C:/nutch/mapred/conf/nutch-site.xml
> 051030 004819 Server listener on port 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004819 Server handler on 9009: starting
> 051030 004822 Server connection on port 9009 from
> 80.139.7.173: starting
> 051030 004914 Server connection on port 9009 from
> 80.139.7.173: starting
> 051030 004931 While choosing target, totalMachines is
> 0
> 051030 004931 Target-length is 0, below
> MIN_REPLICATION (1)
> 051030 004931 Server handler on 9009 call error:
> java.io.IOException: Cannot create file
> /tmp/nutch/mapred/system/submit_ogykqp/job.xml
> java.io.IOException: Cannot create file
> /tmp/nutch/mapred/system/submit_ogykqp/job.xml
> at
> org.apache.nutch.ndfs.NameNode.create(NameNode.java:98)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:582)
> at org.apache.nutch.ipc.RPC$1.call(RPC.java:187)
> at
> org.apache.nutch.ipc.Server$Handler.run(Server.java:198)
> 051030 004934 Server connection on port 9009 from
> 80.139.7.173: exiting
>
>
> Thanks.
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com