You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Victor Lee <vi...@yahoo.com> on 2005/11/10 00:37:36 UTC
Java Exception When Starting Nutch?!!
Hi,
I followed the tutorial and issued the following
command:
bin/nutch admin db -create
bin/nutch inject db -urlfile url.txt
But it said the following:
051109 152542 Starting URL processing
051109 152542 Plugins: directory not found: plugins
Exception in thread "main"
java.lang.ExceptionInInitializerError
at java.lang.Class.initializeClass()
(/usr/lib/libgcj.so.6.0.0)
at
org.apache.nutch.db.WebDBInjector.addPage(java.lang.String)
(Unknown Source)
at
org.apache.nutch.db.WebDBInjector.injectURLFile(java.io.File)
(Unknown Source)
at
org.apache.nutch.db.WebDBInjector.main(java.lang.String[])
(Unknown Source)
at gnu.java.lang.MainThread.call_main()
(/usr/lib/libgcj.so.6.0.0)
at gnu.java.lang.MainThread.run()
(/usr/lib/libgcj.so.6.0.0)
Caused by: java.lang.RuntimeException:
org.apache.nutch.net.URLFilter not found. at
org.apache.nutch.net.URLFilters.<clinit>() (Unknown
Source)
at java.lang.Class.initializeClass()
(/usr/lib/libgcj.so.6.0.0)
...5 more
__________________________________
Yahoo! FareChase: Search multiple travel sites in one click.
http://farechase.yahoo.com
Re: Proxy & base href Problem
Posted by Stefan Groschupf <sg...@media-style.com>.
I hope I understand you question correct but I guess you need mod jk
installed,
may this url will give you an idea.
HTH
Stefan
Am 10.11.2005 um 08:41 schrieb Bill Goffe:
> I'm having a specific problem running Nutch through a proxy server.
> I run
> http://rfe.org (a directory of resources for economists). I'd like
> to run
> Nutch with data from the web sites listed in rfe and other sites
> out of
> http://rfe.org/search (as you might guess, Nutch would be a very nice
> thing to add to a directory of resources). I've currently got 1.4M
> pages
> in a database and by tweaking various parameters in nutch-
> default.xml I'm
> getting pretty good results and would really like to move to
> production
> use.
>
> At any rate, in my apache2.conf file I have a bunch of ProxyPass and
> ProxyPassReverse statements for the different files & directories
> that I'd
> like to pass from Tomcat to Apache. I also added a connector in
> Tomcat's
> server.xml.
>
> This almost works (feel free to try), but, for one problem -- the base
> href in pages returned by Nutch: <base href="http://localhost:8080/
> en/"> .
> Clearly, this messes up relative URLs in the pages Nutch returns. How
> could I go about changing the base URL in pages that Nutch returns? I
> don't see anything obvious in Tomcat's configuration (likely
> wouldn't want
> there anyway I suspect), nutch/conf, mod_proxy, mod_proxy_html, or
> mod_rewrite.
>
> Thanks a bunch,
>
> Bill
>
> --
> *------------------------------------------------------*
> | Bill Goffe goffe@oswego.edu |
> | Department of Economics voice: (315) 312-3444 |
> | SUNY Oswego fax: (315) 312-5444 |
> | 416 Mahar Hall <http://cook.rfe.org> |
> | Oswego, NY 13126 |
> *--------*------------------------------------------------------
> *-----------*
> | "If you compare the way you'd teach anything to the way juries
> are |
> | 'taught,' it's amazing juries do as well as they
> do." |
> | -- Catherine T. Struve, a law professor at the University
> of |
> | Pennsylvania, on how well juries do in spite of not being
> able to |
> | take notes or for lawyers to summarize material for
> them. |
> | "Making Malpractice Harder to Prove," Michelle Andrews, New
> York |
> | Times,
> 12/21/03. |
> *---------------------------------------------------------------------
> ------*
>
Proxy & base href Problem
Posted by Bill Goffe <go...@Oswego.EDU>.
I'm having a specific problem running Nutch through a proxy server. I run
http://rfe.org (a directory of resources for economists). I'd like to run
Nutch with data from the web sites listed in rfe and other sites out of
http://rfe.org/search (as you might guess, Nutch would be a very nice
thing to add to a directory of resources). I've currently got 1.4M pages
in a database and by tweaking various parameters in nutch-default.xml I'm
getting pretty good results and would really like to move to production
use.
At any rate, in my apache2.conf file I have a bunch of ProxyPass and
ProxyPassReverse statements for the different files & directories that I'd
like to pass from Tomcat to Apache. I also added a connector in Tomcat's
server.xml.
This almost works (feel free to try), but, for one problem -- the base
href in pages returned by Nutch: <base href="http://localhost:8080/en/"> .
Clearly, this messes up relative URLs in the pages Nutch returns. How
could I go about changing the base URL in pages that Nutch returns? I
don't see anything obvious in Tomcat's configuration (likely wouldn't want
there anyway I suspect), nutch/conf, mod_proxy, mod_proxy_html, or
mod_rewrite.
Thanks a bunch,
Bill
--
*------------------------------------------------------*
| Bill Goffe goffe@oswego.edu |
| Department of Economics voice: (315) 312-3444 |
| SUNY Oswego fax: (315) 312-5444 |
| 416 Mahar Hall <http://cook.rfe.org> |
| Oswego, NY 13126 |
*--------*------------------------------------------------------*-----------*
| "If you compare the way you'd teach anything to the way juries are |
| 'taught,' it's amazing juries do as well as they do." |
| -- Catherine T. Struve, a law professor at the University of |
| Pennsylvania, on how well juries do in spite of not being able to |
| take notes or for lawyers to summarize material for them. |
| "Making Malpractice Harder to Prove," Michelle Andrews, New York |
| Times, 12/21/03. |
*---------------------------------------------------------------------------*
Re: Java Exception When Starting Nutch?!!
Posted by Victor Lee <vi...@yahoo.com>.
I have to set the nutch-default.xml directly to make
it work. It doesn't work if I set classpath. Don't
know why.
--- Victor Lee <vi...@yahoo.com> wrote:
> I already set the classpath, but still got the same
> error. This is so stupid, I can't even get pass the
> injection. What's up with that?
>
>
> --- Ruban Phukan <ph...@yahoo.com> wrote:
>
> > Hi Victor,
> >
> > I think you have to add the path to the nutch
> > plugins directory in the CLASSPATH.
> >
> > Regards
> > - Ruban
> >
> >
> >
> > ----- Original Message ----
> > From: Victor Lee <vi...@yahoo.com>
> > To: "nutch-user@lucene.apache.org"
> > <nu...@lucene.apache.org>
> > Sent: Thursday, November 10, 2005 05:07:36
> > Subject: Java Exception When Starting Nutch?!!
> >
> > Hi,
> > I followed the tutorial and issued the following
> > command:
> > bin/nutch admin db -create
> > bin/nutch inject db -urlfile url.txt
> >
> > But it said the following:
> >
> > 051109 152542 Starting URL processing
> > 051109 152542 Plugins: directory not found:
> plugins
> > Exception in thread "main"
> > java.lang.ExceptionInInitializerError
> > at java.lang.Class.initializeClass()
> > (/usr/lib/libgcj.so.6.0.0)
> > at
> >
>
org.apache.nutch.db.WebDBInjector.addPage(java.lang.String)
> > (Unknown Source)
> > at
> >
>
org.apache.nutch.db.WebDBInjector.injectURLFile(java.io.File)
> > (Unknown Source)
> > at
> >
>
org.apache.nutch.db.WebDBInjector.main(java.lang.String[])
> > (Unknown Source)
> > at gnu.java.lang.MainThread.call_main()
> > (/usr/lib/libgcj.so.6.0.0)
> > at gnu.java.lang.MainThread.run()
> > (/usr/lib/libgcj.so.6.0.0)
> > Caused by: java.lang.RuntimeException:
> > org.apache.nutch.net.URLFilter not found. at
> > org.apache.nutch.net.URLFilters.<clinit>()
> (Unknown
> > Source)
> > at java.lang.Class.initializeClass()
> > (/usr/lib/libgcj.so.6.0.0)
> > ...5 more
> >
> >
> >
> >
> > __________________________________
> > Yahoo! FareChase: Search multiple travel sites in
> > one click.
> > http://farechase.yahoo.com
> >
> >
> >
> >
> >
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam
> protection around
> http://mail.yahoo.com
>
__________________________________
Yahoo! Mail - PC Magazine Editors' Choice 2005
http://mail.yahoo.com
Re: Java Exception When Starting Nutch?!!
Posted by Victor Lee <vi...@yahoo.com>.
I already set the classpath, but still got the same
error. This is so stupid, I can't even get pass the
injection. What's up with that?
--- Ruban Phukan <ph...@yahoo.com> wrote:
> Hi Victor,
>
> I think you have to add the path to the nutch
> plugins directory in the CLASSPATH.
>
> Regards
> - Ruban
>
>
>
> ----- Original Message ----
> From: Victor Lee <vi...@yahoo.com>
> To: "nutch-user@lucene.apache.org"
> <nu...@lucene.apache.org>
> Sent: Thursday, November 10, 2005 05:07:36
> Subject: Java Exception When Starting Nutch?!!
>
> Hi,
> I followed the tutorial and issued the following
> command:
> bin/nutch admin db -create
> bin/nutch inject db -urlfile url.txt
>
> But it said the following:
>
> 051109 152542 Starting URL processing
> 051109 152542 Plugins: directory not found: plugins
> Exception in thread "main"
> java.lang.ExceptionInInitializerError
> at java.lang.Class.initializeClass()
> (/usr/lib/libgcj.so.6.0.0)
> at
>
org.apache.nutch.db.WebDBInjector.addPage(java.lang.String)
> (Unknown Source)
> at
>
org.apache.nutch.db.WebDBInjector.injectURLFile(java.io.File)
> (Unknown Source)
> at
>
org.apache.nutch.db.WebDBInjector.main(java.lang.String[])
> (Unknown Source)
> at gnu.java.lang.MainThread.call_main()
> (/usr/lib/libgcj.so.6.0.0)
> at gnu.java.lang.MainThread.run()
> (/usr/lib/libgcj.so.6.0.0)
> Caused by: java.lang.RuntimeException:
> org.apache.nutch.net.URLFilter not found. at
> org.apache.nutch.net.URLFilters.<clinit>() (Unknown
> Source)
> at java.lang.Class.initializeClass()
> (/usr/lib/libgcj.so.6.0.0)
> ...5 more
>
>
>
>
> __________________________________
> Yahoo! FareChase: Search multiple travel sites in
> one click.
> http://farechase.yahoo.com
>
>
>
>
>
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
Re: Java Exception When Starting Nutch?!!
Posted by Ruban Phukan <ph...@yahoo.com>.
Hi Victor,
I think you have to add the path to the nutch plugins directory in the CLASSPATH.
Regards
- Ruban
----- Original Message ----
From: Victor Lee <vi...@yahoo.com>
To: "nutch-user@lucene.apache.org" <nu...@lucene.apache.org>
Sent: Thursday, November 10, 2005 05:07:36
Subject: Java Exception When Starting Nutch?!!
Hi,
I followed the tutorial and issued the following
command:
bin/nutch admin db -create
bin/nutch inject db -urlfile url.txt
But it said the following:
051109 152542 Starting URL processing
051109 152542 Plugins: directory not found: plugins
Exception in thread "main"
java.lang.ExceptionInInitializerError
at java.lang.Class.initializeClass()
(/usr/lib/libgcj.so.6.0.0)
at
org.apache.nutch.db.WebDBInjector.addPage(java.lang.String)
(Unknown Source)
at
org.apache.nutch.db.WebDBInjector.injectURLFile(java.io.File)
(Unknown Source)
at
org.apache.nutch.db.WebDBInjector.main(java.lang.String[])
(Unknown Source)
at gnu.java.lang.MainThread.call_main()
(/usr/lib/libgcj.so.6.0.0)
at gnu.java.lang.MainThread.run()
(/usr/lib/libgcj.so.6.0.0)
Caused by: java.lang.RuntimeException:
org.apache.nutch.net.URLFilter not found. at
org.apache.nutch.net.URLFilters.<clinit>() (Unknown
Source)
at java.lang.Class.initializeClass()
(/usr/lib/libgcj.so.6.0.0)
...5 more
__________________________________
Yahoo! FareChase: Search multiple travel sites in one click.
http://farechase.yahoo.com