You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Piyush Garg <pi...@gmail.com> on 2011/07/28 12:25:59 UTC
not able to start nutch 1.3
Hi All,
I have installed nutch 1.3, hadoop-0.20.2 and I was going through the
tutorial http://wiki.apache.org/nutch/NutchTutorial
I have done as it is mentioned there and edited $NUTCH_HOME/conf/nutch-site.xml
as well as nutch-default.xml and
$NUTCH_HOME/runtime/local/conf/nutch-site.xml
but did not able to make it work.
What am I missing here?
...
...
...
11/07/28 15:18:36 INFO mapred.JobClient: Combine input records=0
11/07/28 15:18:36 INFO mapred.JobClient: Map output records=1
11/07/28 15:18:36 INFO mapred.JobClient: Reduce input records=1
11/07/28 15:18:36 INFO crawl.Generator: Generator: finished at 2011-07-28
15:18:36, elapsed: 00:00:03
11/07/28 15:18:36 FATAL fetcher.Fetcher: Fetcher: No agents listed in '
http.agent.name' property.
Exception in thread "main" java.lang.IllegalArgumentException: Fetcher: No
agents listed in 'http.agent.name' property.
at org.apache.nutch.fetcher.Fetcher.checkConfiguration(Fetcher.java:1166)
at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:1068)
at org.apache.nutch.crawl.Crawl.run(Crawl.java:135)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.crawl.Crawl.main(Crawl.java:54)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
--
Thanks and Regards
Piyush Garg
Re: not able to start nutch 1.3
Posted by Piyush Garg <pi...@gmail.com>.
Sorry, got it working, I was using runtime/deploy/bin/nutch instead of
runtime/local/bin/nutch
Thanks Julien for your response.
On Thu, Jul 28, 2011 at 4:35 PM, Julien Nioche <
lists.digitalpebble@gmail.com> wrote:
> http://wiki.apache.org/nutch/NutchTutorial =>
>
> 1.
>
> Edit $NUTCH_HOME/conf/nutch-site.xml (or
> $*NUTCH_HOME/runtime/local/conf/nutch-site.xml
> with version >= 1.3*) and add
>
> Have modified the WIKI now that the tutorial is for 1.3 only
>
> Thanks
>
> Julien
>
> On 28 July 2011 11:25, Piyush Garg <pi...@gmail.com> wrote:
>
> > Hi All,
> >
> > I have installed nutch 1.3, hadoop-0.20.2 and I was going through the
> > tutorial http://wiki.apache.org/nutch/NutchTutorial
> > I have done as it is mentioned there and edited
> > $NUTCH_HOME/conf/nutch-site.xml
> > as well as nutch-default.xml and
> > $NUTCH_HOME/runtime/local/conf/nutch-site.xml
> > but did not able to make it work.
> > What am I missing here?
> >
> > ...
> > ...
> > ...
> > 11/07/28 15:18:36 INFO mapred.JobClient: Combine input records=0
> > 11/07/28 15:18:36 INFO mapred.JobClient: Map output records=1
> > 11/07/28 15:18:36 INFO mapred.JobClient: Reduce input records=1
> > 11/07/28 15:18:36 INFO crawl.Generator: Generator: finished at 2011-07-28
> > 15:18:36, elapsed: 00:00:03
> > 11/07/28 15:18:36 FATAL fetcher.Fetcher: Fetcher: No agents listed in '
> > http.agent.name' property.
> > Exception in thread "main" java.lang.IllegalArgumentException: Fetcher:
> No
> > agents listed in 'http.agent.name' property.
> > at org.apache.nutch.fetcher.Fetcher.checkConfiguration(Fetcher.java:1166)
> > at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:1068)
> > at org.apache.nutch.crawl.Crawl.run(Crawl.java:135)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > at org.apache.nutch.crawl.Crawl.main(Crawl.java:54)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > at java.lang.reflect.Method.invoke(Method.java:616)
> > at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> >
> >
> > --
> > Thanks and Regards
> > Piyush Garg
> >
>
>
>
> --
> *
> *Open Source Solutions for Text Engineering
>
> http://digitalpebble.blogspot.com/
> http://www.digitalpebble.com
>
--
Thanks and Regards
Piyush Garg
Re: not able to start nutch 1.3
Posted by Julien Nioche <li...@gmail.com>.
http://wiki.apache.org/nutch/NutchTutorial =>
1.
Edit $NUTCH_HOME/conf/nutch-site.xml (or
$*NUTCH_HOME/runtime/local/conf/nutch-site.xml
with version >= 1.3*) and add
Have modified the WIKI now that the tutorial is for 1.3 only
Thanks
Julien
On 28 July 2011 11:25, Piyush Garg <pi...@gmail.com> wrote:
> Hi All,
>
> I have installed nutch 1.3, hadoop-0.20.2 and I was going through the
> tutorial http://wiki.apache.org/nutch/NutchTutorial
> I have done as it is mentioned there and edited
> $NUTCH_HOME/conf/nutch-site.xml
> as well as nutch-default.xml and
> $NUTCH_HOME/runtime/local/conf/nutch-site.xml
> but did not able to make it work.
> What am I missing here?
>
> ...
> ...
> ...
> 11/07/28 15:18:36 INFO mapred.JobClient: Combine input records=0
> 11/07/28 15:18:36 INFO mapred.JobClient: Map output records=1
> 11/07/28 15:18:36 INFO mapred.JobClient: Reduce input records=1
> 11/07/28 15:18:36 INFO crawl.Generator: Generator: finished at 2011-07-28
> 15:18:36, elapsed: 00:00:03
> 11/07/28 15:18:36 FATAL fetcher.Fetcher: Fetcher: No agents listed in '
> http.agent.name' property.
> Exception in thread "main" java.lang.IllegalArgumentException: Fetcher: No
> agents listed in 'http.agent.name' property.
> at org.apache.nutch.fetcher.Fetcher.checkConfiguration(Fetcher.java:1166)
> at org.apache.nutch.fetcher.Fetcher.fetch(Fetcher.java:1068)
> at org.apache.nutch.crawl.Crawl.run(Crawl.java:135)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.nutch.crawl.Crawl.main(Crawl.java:54)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
>
> --
> Thanks and Regards
> Piyush Garg
>
--
*
*Open Source Solutions for Text Engineering
http://digitalpebble.blogspot.com/
http://www.digitalpebble.com