You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Kai_testing Middleton <ka...@yahoo.com> on 2007/08/08 05:35:47 UTC
Re: SearchApp from "Introduction to Nutch, Part 2: Searching"
Doğacan, you wrote:
* Have you tried including nutch's job file only?
* Despite its extension, it is actually a jar file
* and it should include everything necessary
* to launch applications.
I'm still curious about this problem. I tried your suggestion of using the .job file:
javac -cp $NUTCH_HOME/src/java:$NUTCH_HOME/nutch-2007-06-27_06-52-44.job SearchApp.java
but I still get a hundred compile errors:
SearchApp.java:3: package org.apache.hadoop.conf does not exist
import org.apache.hadoop.conf.Configuration;
^
/usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:24: package javax.servlet does not exist
import javax.servlet.ServletContext;
^
/usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:27: package org.apache.hadoop.conf does not exist
import org.apache.hadoop.conf.Configuration;
^
/usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:28: package org.apache.hadoop.io does not exist
import org.apache.hadoop.io.WritableName;
^
/usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:48: cannot find symbol
symbol : class Configuration
location: class org.apache.nutch.util.NutchConfiguration
public static Configuration create() {
.
.
.
/usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/metadata/Nutch.java:19: package org.apache.hadoop.io does not exist
import org.apache.hadoop.io.Text;
^
Note: /usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/analysis/FastCharStream.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.
100 errors
I was able to fix the problem by hitting it over the head, but I find it to be an inelegant solution as the list could change:
#!/bin/bash
javac -cp $NUTCH_HOME/src/java:
$NUTCH_HOME/lib/jetty-ext/ant.jar:
$NUTCH_HOME/lib/jetty-ext/commons-el.jar:
$NUTCH_HOME/lib/jetty-ext/jasper-compiler.jar:
$NUTCH_HOME/lib/jetty-ext/jasper-runtime.jar:
$NUTCH_HOME/lib/jetty-ext/jsp-api.jar:
$NUTCH_HOME/lib/pmd-ext/jakarta-oro-2.0.8.jar:
$NUTCH_HOME/lib/pmd-ext/jaxen-1.1-beta-7.jar:
$NUTCH_HOME/lib/pmd-ext/pmd-3.6.jar:
$NUTCH_HOME/lib/commons-cli-2.0-SNAPSHOT.jar:
$NUTCH_HOME/lib/commons-codec-1.3.jar:
$NUTCH_HOME/lib/commons-httpclient-3.0.1.jar:
$NUTCH_HOME/lib/commons-lang-2.1.jar:
$NUTCH_HOME/lib/commons-logging-1.0.4.jar:
$NUTCH_HOME/lib/commons-logging-api-1.0.4.jar:
$NUTCH_HOME/lib/hadoop-0.12.3-core.jar:
$NUTCH_HOME/lib/jakarta-oro-2.0.7.jar:
$NUTCH_HOME/lib/jets3t-0.5.0.jar:
$NUTCH_HOME/lib/jetty-5.1.4.jar:
$NUTCH_HOME/lib/junit-3.8.1.jar:
$NUTCH_HOME/lib/log4j-1.2.13.jar:
$NUTCH_HOME/lib/lucene-core-2.2.0.jar:
$NUTCH_HOME/lib/lucene-misc-2.2.0.jar:
$NUTCH_HOME/lib/servlet-api.jar:
$NUTCH_HOME/lib/taglibs-i18n.jar:
$NUTCH_HOME/lib/xerces-2_6_2-apis.jar:
$NUTCH_HOME/lib/xerces-2_6_2.jar:
$NUTCH_HOME/plugins/clustering-carrot2/Jama-1.0.1-patched.jar:
$NUTCH_HOME/plugins/clustering-carrot2/carrot2-filter-lingo.jar:
$NUTCH_HOME/plugins/clustering-carrot2/carrot2-local-core.jar:
$NUTCH_HOME/plugins/clustering-carrot2/carrot2-snowball-stemmers.jar:
$NUTCH_HOME/plugins/clustering-carrot2/carrot2-util-common.jar:
$NUTCH_HOME/plugins/clustering-carrot2/carrot2-util-tokenizer.jar:
$NUTCH_HOME/plugins/clustering-carrot2/clustering-carrot2.jar:
$NUTCH_HOME/plugins/clustering-carrot2/commons-collections-3.1-patched.jar:
$NUTCH_HOME/plugins/clustering-carrot2/commons-pool-1.1.jar:
$NUTCH_HOME/plugins/clustering-carrot2/violinstrings-1.0.2.jar:
$NUTCH_HOME/plugins/creativecommons/creativecommons.jar:
$NUTCH_HOME/plugins/feed/feed.jar:
$NUTCH_HOME/plugins/feed/rome-0.9.jar:
$NUTCH_HOME/plugins/index-basic/index-basic.jar:
$NUTCH_HOME/plugins/index-more/index-more.jar:
$NUTCH_HOME/plugins/language-identifier/language-identifier.jar:
$NUTCH_HOME/plugins/lib-http/lib-http.jar:
$NUTCH_HOME/plugins/lib-jakarta-poi/poi-3.0-alpha1-20050704.jar:
$NUTCH_HOME/plugins/lib-jakarta-poi/poi-scratchpad-3.0-alpha1-20050704.jar:
$NUTCH_HOME/plugins/lib-lucene-analyzers/lucene-analyzers-2.2.0.jar:
$NUTCH_HOME/plugins/lib-nekohtml/nekohtml-0.9.4.jar:
$NUTCH_HOME/plugins/lib-parsems/lib-parsems.jar:
$NUTCH_HOME/plugins/lib-regex-filter/lib-regex-filter.jar:
$NUTCH_HOME/plugins/lib-xml/jaxen-core.jar:
$NUTCH_HOME/plugins/lib-xml/jaxen-jdom.jar:
$NUTCH_HOME/plugins/lib-xml/jdom.jar:
$NUTCH_HOME/plugins/lib-xml/saxpath.jar:
$NUTCH_HOME/plugins/lib-xml/xercesImpl.jar:
$NUTCH_HOME/plugins/microformats-reltag/microformats-reltag.jar:
$NUTCH_HOME/plugins/nutch-extensionpoints/nutch-extensionpoints.jar:
$NUTCH_HOME/plugins/ontology/icu4j_2_6_1.jar:
$NUTCH_HOME/plugins/ontology/jena-2.1.jar:
$NUTCH_HOME/plugins/ontology/ontology.jar:
$NUTCH_HOME/plugins/parse-ext/parse-ext.jar:
$NUTCH_HOME/plugins/parse-html/parse-html.jar:
$NUTCH_HOME/plugins/parse-html/tagsoup-1.0rc3.jar:
$NUTCH_HOME/plugins/parse-js/parse-js.jar:
$NUTCH_HOME/plugins/parse-msexcel/parse-msexcel.jar:
$NUTCH_HOME/plugins/parse-msword/parse-msword.jar:
$NUTCH_HOME/plugins/parse-mspowerpoint/parse-mspowerpoint.jar:
$NUTCH_HOME/plugins/parse-oo/parse-oo.jar:
$NUTCH_HOME/plugins/parse-pdf/PDFBox-0.7.2-log4j.jar:
$NUTCH_HOME/plugins/parse-pdf/parse-pdf.jar:
$NUTCH_HOME/plugins/parse-rss/commons-feedparser-0.6-fork.jar:
$NUTCH_HOME/plugins/parse-rss/parse-rss.jar:
$NUTCH_HOME/plugins/parse-rss/xmlrpc-1.2.jar:
$NUTCH_HOME/plugins/parse-swf/javaswf.jar:
$NUTCH_HOME/plugins/parse-swf/parse-swf.jar:
$NUTCH_HOME/plugins/parse-text/parse-text.jar:
$NUTCH_HOME/plugins/parse-zip/parse-zip.jar:
$NUTCH_HOME/plugins/protocol-file/protocol-file.jar:
$NUTCH_HOME/plugins/protocol-ftp/commons-net-1.2.0-dev.jar:
$NUTCH_HOME/plugins/protocol-ftp/protocol-ftp.jar:
$NUTCH_HOME/plugins/protocol-http/protocol-http.jar:
$NUTCH_HOME/plugins/protocol-httpclient/protocol-httpclient.jar:
$NUTCH_HOME/plugins/query-basic/query-basic.jar:
$NUTCH_HOME/plugins/query-more/query-more.jar:
$NUTCH_HOME/plugins/query-site/query-site.jar:
$NUTCH_HOME/plugins/query-url/query-url.jar:
$NUTCH_HOME/plugins/scoring-opic/scoring-opic.jar:
$NUTCH_HOME/plugins/subcollection/subcollection.jar:
$NUTCH_HOME/plugins/summary-basic/summary-basic.jar:
$NUTCH_HOME/plugins/summary-lucene/lucene-highlighter-2.2.0.jar:
$NUTCH_HOME/plugins/summary-lucene/summary-lucene.jar:
$NUTCH_HOME/plugins/urlfilter-automaton/automaton.jar:
$NUTCH_HOME/plugins/urlfilter-automaton/urlfilter-automaton.jar:
$NUTCH_HOME/plugins/urlfilter-prefix/urlfilter-prefix.jar:
$NUTCH_HOME/plugins/urlfilter-regex/urlfilter-regex.jar:
$NUTCH_HOME/plugins/urlfilter-suffix/urlfilter-suffix.jar:
$NUTCH_HOME/plugins/urlnormalizer-basic/urlnormalizer-basic.jar:
$NUTCH_HOME/plugins/urlnormalizer-pass/urlnormalizer-pass.jar:
$NUTCH_HOME/plugins/urlnormalizer-regex/urlnormalizer-regex.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/Jama-1.0.1-patched.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-filter-lingo.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-local-core.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-snowball-stemmers.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-util-common.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-util-tokenizer.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/commons-collections-3.1-patched.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/commons-pool-1.1.jar:
$NUTCH_HOME/src/plugin/clustering-carrot2/lib/violinstrings-1.0.2.jar:
$NUTCH_HOME/src/plugin/feed/lib/rome-0.9.jar:
$NUTCH_HOME/src/plugin/lib-jakarta-poi/lib/poi-3.0-alpha1-20050704.jar:
$NUTCH_HOME/src/plugin/lib-jakarta-poi/lib/poi-scratchpad-3.0-alpha1-20050704.jar:
$NUTCH_HOME/src/plugin/lib-lucene-analyzers/lib/lucene-analyzers-2.2.0.jar:
$NUTCH_HOME/src/plugin/lib-nekohtml/lib/nekohtml-0.9.4.jar:
$NUTCH_HOME/src/plugin/lib-xml/lib/jaxen-core.jar:
$NUTCH_HOME/src/plugin/lib-xml/lib/jaxen-jdom.jar:
$NUTCH_HOME/src/plugin/lib-xml/lib/jdom.jar:
$NUTCH_HOME/src/plugin/lib-xml/lib/saxpath.jar:
$NUTCH_HOME/src/plugin/lib-xml/lib/xercesImpl.jar:
$NUTCH_HOME/src/plugin/ontology/lib/icu4j_2_6_1.jar:
$NUTCH_HOME/src/plugin/ontology/lib/jena-2.1.jar:
$NUTCH_HOME/src/plugin/parse-html/lib/tagsoup-1.0rc3.jar:
$NUTCH_HOME/src/plugin/parse-pdf/lib/PDFBox-0.7.2-log4j.jar:
$NUTCH_HOME/src/plugin/parse-rss/lib/commons-feedparser-0.6-fork.jar:
$NUTCH_HOME/src/plugin/parse-rss/lib/xmlrpc-1.2.jar:
$NUTCH_HOME/src/plugin/parse-swf/lib/javaswf.jar:
$NUTCH_HOME/src/plugin/protocol-ftp/lib/commons-net-1.2.0-dev.jar:
$NUTCH_HOME/src/plugin/summary-lucene/lib/lucene-highlighter-2.2.0.jar:
$NUTCH_HOME/src/plugin/urlfilter-automaton/lib/automaton.jar:
$NUTCH_HOME/nutch-2007-06-27_06-52-44.jar:
$NUTCH_HOME/build/clustering-carrot2/clustering-carrot2.jar:
$NUTCH_HOME/build/lib-nekohtml/nekohtml-0.9.4.jar:
$NUTCH_HOME/build/plugins/lib-nekohtml/nekohtml-0.9.4.jar:
$NUTCH_HOME/build/plugins/nutch-extensionpoints/nutch-extensionpoints.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/clustering-carrot2.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/Jama-1.0.1-patched.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/commons-collections-3.1-patched.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-util-common.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/violinstrings-1.0.2.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-util-tokenizer.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-filter-lingo.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-local-core.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-snowball-stemmers.jar:
$NUTCH_HOME/build/plugins/clustering-carrot2/commons-pool-1.1.jar:
$NUTCH_HOME/build/plugins/parse-html/parse-html.jar:
$NUTCH_HOME/build/plugins/parse-html/tagsoup-1.0rc3.jar:
$NUTCH_HOME/build/plugins/creativecommons/creativecommons.jar:
$NUTCH_HOME/build/plugins/protocol-file/protocol-file.jar:
$NUTCH_HOME/build/plugins/feed/feed.jar:
$NUTCH_HOME/build/plugins/feed/rome-0.9.jar:
$NUTCH_HOME/build/plugins/index-basic/index-basic.jar:
$NUTCH_HOME/build/plugins/index-more/index-more.jar:
$NUTCH_HOME/build/plugins/language-identifier/language-identifier.jar:
$NUTCH_HOME/build/plugins/lib-http/lib-http.jar:
$NUTCH_HOME/build/plugins/lib-jakarta-poi/poi-3.0-alpha1-20050704.jar:
$NUTCH_HOME/build/plugins/lib-jakarta-poi/poi-scratchpad-3.0-alpha1-20050704.jar:
$NUTCH_HOME/build/plugins/lib-lucene-analyzers/lucene-analyzers-2.2.0.jar:
$NUTCH_HOME/build/plugins/lib-parsems/lib-parsems.jar:
$NUTCH_HOME/build/plugins/lib-regex-filter/lib-regex-filter.jar:
$NUTCH_HOME/build/plugins/lib-xml/jaxen-core.jar:
$NUTCH_HOME/build/plugins/lib-xml/jdom.jar:
$NUTCH_HOME/build/plugins/lib-xml/xercesImpl.jar:
$NUTCH_HOME/build/plugins/lib-xml/saxpath.jar:
$NUTCH_HOME/build/plugins/lib-xml/jaxen-jdom.jar:
$NUTCH_HOME/build/plugins/microformats-reltag/microformats-reltag.jar:
$NUTCH_HOME/build/plugins/ontology/ontology.jar:
$NUTCH_HOME/build/plugins/ontology/jena-2.1.jar:
$NUTCH_HOME/build/plugins/ontology/icu4j_2_6_1.jar:
$NUTCH_HOME/build/plugins/protocol-ftp/protocol-ftp.jar:
$NUTCH_HOME/build/plugins/protocol-ftp/commons-net-1.2.0-dev.jar:
$NUTCH_HOME/build/plugins/protocol-http/protocol-http.jar:
$NUTCH_HOME/build/plugins/protocol-httpclient/protocol-httpclient.jar:
$NUTCH_HOME/build/plugins/parse-ext/parse-ext.jar:
$NUTCH_HOME/build/plugins/parse-js/parse-js.jar:
$NUTCH_HOME/build/plugins/parse-msexcel/parse-msexcel.jar:
$NUTCH_HOME/build/plugins/parse-mspowerpoint/parse-mspowerpoint.jar:
$NUTCH_HOME/build/plugins/parse-msword/parse-msword.jar:
$NUTCH_HOME/build/plugins/parse-oo/parse-oo.jar:
$NUTCH_HOME/build/plugins/parse-pdf/parse-pdf.jar:
$NUTCH_HOME/build/plugins/parse-pdf/PDFBox-0.7.2-log4j.jar:
$NUTCH_HOME/build/plugins/parse-rss/parse-rss.jar:
$NUTCH_HOME/build/plugins/parse-rss/xmlrpc-1.2.jar:
$NUTCH_HOME/build/plugins/parse-rss/commons-feedparser-0.6-fork.jar:
$NUTCH_HOME/build/plugins/parse-swf/parse-swf.jar:
$NUTCH_HOME/build/plugins/parse-swf/javaswf.jar:
$NUTCH_HOME/build/plugins/parse-text/parse-text.jar:
$NUTCH_HOME/build/plugins/parse-zip/parse-zip.jar:
$NUTCH_HOME/build/plugins/query-basic/query-basic.jar:
$NUTCH_HOME/build/plugins/query-more/query-more.jar:
$NUTCH_HOME/build/plugins/query-site/query-site.jar:
$NUTCH_HOME/build/plugins/query-url/query-url.jar:
$NUTCH_HOME/build/plugins/scoring-opic/scoring-opic.jar:
$NUTCH_HOME/build/plugins/summary-basic/summary-basic.jar:
$NUTCH_HOME/build/plugins/subcollection/subcollection.jar:
$NUTCH_HOME/build/plugins/summary-lucene/summary-lucene.jar:
$NUTCH_HOME/build/plugins/summary-lucene/lucene-highlighter-2.2.0.jar:
$NUTCH_HOME/build/plugins/urlfilter-automaton/urlfilter-automaton.jar:
$NUTCH_HOME/build/plugins/urlfilter-automaton/automaton.jar:
$NUTCH_HOME/build/plugins/urlfilter-prefix/urlfilter-prefix.jar:
$NUTCH_HOME/build/plugins/urlfilter-regex/urlfilter-regex.jar:
$NUTCH_HOME/build/plugins/urlfilter-suffix/urlfilter-suffix.jar:
$NUTCH_HOME/build/plugins/urlnormalizer-basic/urlnormalizer-basic.jar:
$NUTCH_HOME/build/plugins/urlnormalizer-pass/urlnormalizer-pass.jar:
$NUTCH_HOME/build/plugins/urlnormalizer-regex/urlnormalizer-regex.jar:
$NUTCH_HOME/build/nutch-extensionpoints/nutch-extensionpoints.jar:
$NUTCH_HOME/build/creativecommons/creativecommons.jar:
$NUTCH_HOME/build/parse-html/parse-html.jar:
$NUTCH_HOME/build/feed/feed.jar:
$NUTCH_HOME/build/lib-xml/jaxen-core.jar:
$NUTCH_HOME/build/lib-xml/jdom.jar:
$NUTCH_HOME/build/lib-xml/xercesImpl.jar:
$NUTCH_HOME/build/lib-xml/saxpath.jar:
$NUTCH_HOME/build/lib-xml/jaxen-jdom.jar:
$NUTCH_HOME/build/protocol-file/protocol-file.jar:
$NUTCH_HOME/build/index-basic/index-basic.jar:
$NUTCH_HOME/build/index-more/index-more.jar:
$NUTCH_HOME/build/language-identifier/language-identifier.jar:
$NUTCH_HOME/build/lib-http/lib-http.jar:
$NUTCH_HOME/build/lib-jakarta-poi/poi-3.0-alpha1-20050704.jar:
$NUTCH_HOME/build/lib-jakarta-poi/poi-scratchpad-3.0-alpha1-20050704.jar:
$NUTCH_HOME/build/lib-lucene-analyzers/lucene-analyzers-2.2.0.jar:
$NUTCH_HOME/build/lib-parsems/lib-parsems.jar:
$NUTCH_HOME/build/lib-regex-filter/lib-regex-filter.jar:
$NUTCH_HOME/build/microformats-reltag/microformats-reltag.jar:
$NUTCH_HOME/build/ontology/ontology.jar:
$NUTCH_HOME/build/protocol-ftp/protocol-ftp.jar:
$NUTCH_HOME/build/protocol-http/protocol-http.jar:
$NUTCH_HOME/build/protocol-httpclient/protocol-httpclient.jar:
$NUTCH_HOME/build/parse-ext/parse-ext.jar:
$NUTCH_HOME/build/parse-js/parse-js.jar:
$NUTCH_HOME/build/parse-msexcel/parse-msexcel.jar:
$NUTCH_HOME/build/parse-mspowerpoint/parse-mspowerpoint.jar:
$NUTCH_HOME/build/parse-msword/parse-msword.jar:
$NUTCH_HOME/build/parse-oo/parse-oo.jar:
$NUTCH_HOME/build/parse-pdf/parse-pdf.jar:
$NUTCH_HOME/build/parse-rss/parse-rss.jar:
$NUTCH_HOME/build/parse-swf/parse-swf.jar:
$NUTCH_HOME/build/parse-text/parse-text.jar:
$NUTCH_HOME/build/parse-zip/parse-zip.jar:
$NUTCH_HOME/build/query-basic/query-basic.jar:
$NUTCH_HOME/build/query-more/query-more.jar:
$NUTCH_HOME/build/query-site/query-site.jar:
$NUTCH_HOME/build/query-url/query-url.jar:
$NUTCH_HOME/build/scoring-opic/scoring-opic.jar:
$NUTCH_HOME/build/summary-basic/summary-basic.jar:
$NUTCH_HOME/build/subcollection/subcollection.jar:
$NUTCH_HOME/build/summary-lucene/summary-lucene.jar:
$NUTCH_HOME/build/urlfilter-automaton/urlfilter-automaton.jar:
$NUTCH_HOME/build/urlfilter-prefix/urlfilter-prefix.jar:
$NUTCH_HOME/build/urlfilter-regex/urlfilter-regex.jar:
$NUTCH_HOME/build/urlfilter-suffix/urlfilter-suffix.jar:
$NUTCH_HOME/build/urlnormalizer-basic/urlnormalizer-basic.jar:
$NUTCH_HOME/build/urlnormalizer-pass/urlnormalizer-pass.jar:
$NUTCH_HOME/build/urlnormalizer-regex/urlnormalizer-regex.jar
SearchApp.java
____________________________________________________________________________________
Need a vacation? Get great deals
to amazing places on Yahoo! Travel.
http://travel.yahoo.com/
Re: SearchApp from "Introduction to Nutch, Part 2: Searching"
Posted by Doğacan Güney <do...@gmail.com>.
On 8/8/07, Kai_testing Middleton <ka...@yahoo.com> wrote:
> Doğacan, you wrote:
> * Have you tried including nutch's job file only?
> * Despite its extension, it is actually a jar file
> * and it should include everything necessary
> * to launch applications.
>
> I'm still curious about this problem. I tried your suggestion of using the .job file:
> javac -cp $NUTCH_HOME/src/java:$NUTCH_HOME/nutch-2007-06-27_06-52-44.job SearchApp.java
>
> but I still get a hundred compile errors:
Yeah, I forgot that job file needs a MANIFEST to add jars (in
nutch.job) to classpath.
You may try somethink like this:
javac -cp `for i in \`find lib -name "*.jar"\`; do echo -n
$NUTCH_HOME/$i:; done`.:$NUTCH_HOME/build/nutch-1.0-dev.job
SearchApp.java
It should add every jar under lib + cwd + nutch.job to CLASSPATH.
>
> SearchApp.java:3: package org.apache.hadoop.conf does not exist
> import org.apache.hadoop.conf.Configuration;
> ^
> /usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:24: package javax.servlet does not exist
> import javax.servlet.ServletContext;
> ^
> /usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:27: package org.apache.hadoop.conf does not exist
> import org.apache.hadoop.conf.Configuration;
> ^
> /usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:28: package org.apache.hadoop.io does not exist
> import org.apache.hadoop.io.WritableName;
> ^
> /usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/util/NutchConfiguration.java:48: cannot find symbol
> symbol : class Configuration
> location: class org.apache.nutch.util.NutchConfiguration
> public static Configuration create() {
>
> .
> .
> .
>
> /usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/metadata/Nutch.java:19: package org.apache.hadoop.io does not exist
> import org.apache.hadoop.io.Text;
> ^
> Note: /usr/local/nutch-2007-06-27_06-52-44/src/java/org/apache/nutch/analysis/FastCharStream.java uses or overrides a deprecated API.
> Note: Recompile with -Xlint:deprecation for details.
> Note: Some input files use unchecked or unsafe operations.
> Note: Recompile with -Xlint:unchecked for details.
> 100 errors
>
>
> I was able to fix the problem by hitting it over the head, but I find it to be an inelegant solution as the list could change:
>
> #!/bin/bash
> javac -cp $NUTCH_HOME/src/java:
> $NUTCH_HOME/lib/jetty-ext/ant.jar:
> $NUTCH_HOME/lib/jetty-ext/commons-el.jar:
> $NUTCH_HOME/lib/jetty-ext/jasper-compiler.jar:
> $NUTCH_HOME/lib/jetty-ext/jasper-runtime.jar:
> $NUTCH_HOME/lib/jetty-ext/jsp-api.jar:
> $NUTCH_HOME/lib/pmd-ext/jakarta-oro-2.0.8.jar:
> $NUTCH_HOME/lib/pmd-ext/jaxen-1.1-beta-7.jar:
> $NUTCH_HOME/lib/pmd-ext/pmd-3.6.jar:
> $NUTCH_HOME/lib/commons-cli-2.0-SNAPSHOT.jar:
> $NUTCH_HOME/lib/commons-codec-1.3.jar:
> $NUTCH_HOME/lib/commons-httpclient-3.0.1.jar:
> $NUTCH_HOME/lib/commons-lang-2.1.jar:
> $NUTCH_HOME/lib/commons-logging-1.0.4.jar:
> $NUTCH_HOME/lib/commons-logging-api-1.0.4.jar:
> $NUTCH_HOME/lib/hadoop-0.12.3-core.jar:
> $NUTCH_HOME/lib/jakarta-oro-2.0.7.jar:
> $NUTCH_HOME/lib/jets3t-0.5.0.jar:
> $NUTCH_HOME/lib/jetty-5.1.4.jar:
> $NUTCH_HOME/lib/junit-3.8.1.jar:
> $NUTCH_HOME/lib/log4j-1.2.13.jar:
> $NUTCH_HOME/lib/lucene-core-2.2.0.jar:
> $NUTCH_HOME/lib/lucene-misc-2.2.0.jar:
> $NUTCH_HOME/lib/servlet-api.jar:
> $NUTCH_HOME/lib/taglibs-i18n.jar:
> $NUTCH_HOME/lib/xerces-2_6_2-apis.jar:
> $NUTCH_HOME/lib/xerces-2_6_2.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/Jama-1.0.1-patched.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/carrot2-filter-lingo.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/carrot2-local-core.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/carrot2-snowball-stemmers.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/carrot2-util-common.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/carrot2-util-tokenizer.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/clustering-carrot2.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/commons-collections-3.1-patched.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/commons-pool-1.1.jar:
> $NUTCH_HOME/plugins/clustering-carrot2/violinstrings-1.0.2.jar:
> $NUTCH_HOME/plugins/creativecommons/creativecommons.jar:
> $NUTCH_HOME/plugins/feed/feed.jar:
> $NUTCH_HOME/plugins/feed/rome-0.9.jar:
> $NUTCH_HOME/plugins/index-basic/index-basic.jar:
> $NUTCH_HOME/plugins/index-more/index-more.jar:
> $NUTCH_HOME/plugins/language-identifier/language-identifier.jar:
> $NUTCH_HOME/plugins/lib-http/lib-http.jar:
> $NUTCH_HOME/plugins/lib-jakarta-poi/poi-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/plugins/lib-jakarta-poi/poi-scratchpad-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/plugins/lib-lucene-analyzers/lucene-analyzers-2.2.0.jar:
> $NUTCH_HOME/plugins/lib-nekohtml/nekohtml-0.9.4.jar:
> $NUTCH_HOME/plugins/lib-parsems/lib-parsems.jar:
> $NUTCH_HOME/plugins/lib-regex-filter/lib-regex-filter.jar:
> $NUTCH_HOME/plugins/lib-xml/jaxen-core.jar:
> $NUTCH_HOME/plugins/lib-xml/jaxen-jdom.jar:
> $NUTCH_HOME/plugins/lib-xml/jdom.jar:
> $NUTCH_HOME/plugins/lib-xml/saxpath.jar:
> $NUTCH_HOME/plugins/lib-xml/xercesImpl.jar:
> $NUTCH_HOME/plugins/microformats-reltag/microformats-reltag.jar:
> $NUTCH_HOME/plugins/nutch-extensionpoints/nutch-extensionpoints.jar:
> $NUTCH_HOME/plugins/ontology/icu4j_2_6_1.jar:
> $NUTCH_HOME/plugins/ontology/jena-2.1.jar:
> $NUTCH_HOME/plugins/ontology/ontology.jar:
> $NUTCH_HOME/plugins/parse-ext/parse-ext.jar:
> $NUTCH_HOME/plugins/parse-html/parse-html.jar:
> $NUTCH_HOME/plugins/parse-html/tagsoup-1.0rc3.jar:
> $NUTCH_HOME/plugins/parse-js/parse-js.jar:
> $NUTCH_HOME/plugins/parse-msexcel/parse-msexcel.jar:
> $NUTCH_HOME/plugins/parse-msword/parse-msword.jar:
> $NUTCH_HOME/plugins/parse-mspowerpoint/parse-mspowerpoint.jar:
> $NUTCH_HOME/plugins/parse-oo/parse-oo.jar:
> $NUTCH_HOME/plugins/parse-pdf/PDFBox-0.7.2-log4j.jar:
> $NUTCH_HOME/plugins/parse-pdf/parse-pdf.jar:
> $NUTCH_HOME/plugins/parse-rss/commons-feedparser-0.6-fork.jar:
> $NUTCH_HOME/plugins/parse-rss/parse-rss.jar:
> $NUTCH_HOME/plugins/parse-rss/xmlrpc-1.2.jar:
> $NUTCH_HOME/plugins/parse-swf/javaswf.jar:
> $NUTCH_HOME/plugins/parse-swf/parse-swf.jar:
> $NUTCH_HOME/plugins/parse-text/parse-text.jar:
> $NUTCH_HOME/plugins/parse-zip/parse-zip.jar:
> $NUTCH_HOME/plugins/protocol-file/protocol-file.jar:
> $NUTCH_HOME/plugins/protocol-ftp/commons-net-1.2.0-dev.jar:
> $NUTCH_HOME/plugins/protocol-ftp/protocol-ftp.jar:
> $NUTCH_HOME/plugins/protocol-http/protocol-http.jar:
> $NUTCH_HOME/plugins/protocol-httpclient/protocol-httpclient.jar:
> $NUTCH_HOME/plugins/query-basic/query-basic.jar:
> $NUTCH_HOME/plugins/query-more/query-more.jar:
> $NUTCH_HOME/plugins/query-site/query-site.jar:
> $NUTCH_HOME/plugins/query-url/query-url.jar:
> $NUTCH_HOME/plugins/scoring-opic/scoring-opic.jar:
> $NUTCH_HOME/plugins/subcollection/subcollection.jar:
> $NUTCH_HOME/plugins/summary-basic/summary-basic.jar:
> $NUTCH_HOME/plugins/summary-lucene/lucene-highlighter-2.2.0.jar:
> $NUTCH_HOME/plugins/summary-lucene/summary-lucene.jar:
> $NUTCH_HOME/plugins/urlfilter-automaton/automaton.jar:
> $NUTCH_HOME/plugins/urlfilter-automaton/urlfilter-automaton.jar:
> $NUTCH_HOME/plugins/urlfilter-prefix/urlfilter-prefix.jar:
> $NUTCH_HOME/plugins/urlfilter-regex/urlfilter-regex.jar:
> $NUTCH_HOME/plugins/urlfilter-suffix/urlfilter-suffix.jar:
> $NUTCH_HOME/plugins/urlnormalizer-basic/urlnormalizer-basic.jar:
> $NUTCH_HOME/plugins/urlnormalizer-pass/urlnormalizer-pass.jar:
> $NUTCH_HOME/plugins/urlnormalizer-regex/urlnormalizer-regex.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/Jama-1.0.1-patched.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-filter-lingo.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-local-core.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-snowball-stemmers.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-util-common.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/carrot2-util-tokenizer.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/commons-collections-3.1-patched.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/commons-pool-1.1.jar:
> $NUTCH_HOME/src/plugin/clustering-carrot2/lib/violinstrings-1.0.2.jar:
> $NUTCH_HOME/src/plugin/feed/lib/rome-0.9.jar:
> $NUTCH_HOME/src/plugin/lib-jakarta-poi/lib/poi-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/src/plugin/lib-jakarta-poi/lib/poi-scratchpad-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/src/plugin/lib-lucene-analyzers/lib/lucene-analyzers-2.2.0.jar:
> $NUTCH_HOME/src/plugin/lib-nekohtml/lib/nekohtml-0.9.4.jar:
> $NUTCH_HOME/src/plugin/lib-xml/lib/jaxen-core.jar:
> $NUTCH_HOME/src/plugin/lib-xml/lib/jaxen-jdom.jar:
> $NUTCH_HOME/src/plugin/lib-xml/lib/jdom.jar:
> $NUTCH_HOME/src/plugin/lib-xml/lib/saxpath.jar:
> $NUTCH_HOME/src/plugin/lib-xml/lib/xercesImpl.jar:
> $NUTCH_HOME/src/plugin/ontology/lib/icu4j_2_6_1.jar:
> $NUTCH_HOME/src/plugin/ontology/lib/jena-2.1.jar:
> $NUTCH_HOME/src/plugin/parse-html/lib/tagsoup-1.0rc3.jar:
> $NUTCH_HOME/src/plugin/parse-pdf/lib/PDFBox-0.7.2-log4j.jar:
> $NUTCH_HOME/src/plugin/parse-rss/lib/commons-feedparser-0.6-fork.jar:
> $NUTCH_HOME/src/plugin/parse-rss/lib/xmlrpc-1.2.jar:
> $NUTCH_HOME/src/plugin/parse-swf/lib/javaswf.jar:
> $NUTCH_HOME/src/plugin/protocol-ftp/lib/commons-net-1.2.0-dev.jar:
> $NUTCH_HOME/src/plugin/summary-lucene/lib/lucene-highlighter-2.2.0.jar:
> $NUTCH_HOME/src/plugin/urlfilter-automaton/lib/automaton.jar:
> $NUTCH_HOME/nutch-2007-06-27_06-52-44.jar:
> $NUTCH_HOME/build/clustering-carrot2/clustering-carrot2.jar:
> $NUTCH_HOME/build/lib-nekohtml/nekohtml-0.9.4.jar:
> $NUTCH_HOME/build/plugins/lib-nekohtml/nekohtml-0.9.4.jar:
> $NUTCH_HOME/build/plugins/nutch-extensionpoints/nutch-extensionpoints.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/clustering-carrot2.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/Jama-1.0.1-patched.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/commons-collections-3.1-patched.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-util-common.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/violinstrings-1.0.2.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-util-tokenizer.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-filter-lingo.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-local-core.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/carrot2-snowball-stemmers.jar:
> $NUTCH_HOME/build/plugins/clustering-carrot2/commons-pool-1.1.jar:
> $NUTCH_HOME/build/plugins/parse-html/parse-html.jar:
> $NUTCH_HOME/build/plugins/parse-html/tagsoup-1.0rc3.jar:
> $NUTCH_HOME/build/plugins/creativecommons/creativecommons.jar:
> $NUTCH_HOME/build/plugins/protocol-file/protocol-file.jar:
> $NUTCH_HOME/build/plugins/feed/feed.jar:
> $NUTCH_HOME/build/plugins/feed/rome-0.9.jar:
> $NUTCH_HOME/build/plugins/index-basic/index-basic.jar:
> $NUTCH_HOME/build/plugins/index-more/index-more.jar:
> $NUTCH_HOME/build/plugins/language-identifier/language-identifier.jar:
> $NUTCH_HOME/build/plugins/lib-http/lib-http.jar:
> $NUTCH_HOME/build/plugins/lib-jakarta-poi/poi-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/build/plugins/lib-jakarta-poi/poi-scratchpad-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/build/plugins/lib-lucene-analyzers/lucene-analyzers-2.2.0.jar:
> $NUTCH_HOME/build/plugins/lib-parsems/lib-parsems.jar:
> $NUTCH_HOME/build/plugins/lib-regex-filter/lib-regex-filter.jar:
> $NUTCH_HOME/build/plugins/lib-xml/jaxen-core.jar:
> $NUTCH_HOME/build/plugins/lib-xml/jdom.jar:
> $NUTCH_HOME/build/plugins/lib-xml/xercesImpl.jar:
> $NUTCH_HOME/build/plugins/lib-xml/saxpath.jar:
> $NUTCH_HOME/build/plugins/lib-xml/jaxen-jdom.jar:
> $NUTCH_HOME/build/plugins/microformats-reltag/microformats-reltag.jar:
> $NUTCH_HOME/build/plugins/ontology/ontology.jar:
> $NUTCH_HOME/build/plugins/ontology/jena-2.1.jar:
> $NUTCH_HOME/build/plugins/ontology/icu4j_2_6_1.jar:
> $NUTCH_HOME/build/plugins/protocol-ftp/protocol-ftp.jar:
> $NUTCH_HOME/build/plugins/protocol-ftp/commons-net-1.2.0-dev.jar:
> $NUTCH_HOME/build/plugins/protocol-http/protocol-http.jar:
> $NUTCH_HOME/build/plugins/protocol-httpclient/protocol-httpclient.jar:
> $NUTCH_HOME/build/plugins/parse-ext/parse-ext.jar:
> $NUTCH_HOME/build/plugins/parse-js/parse-js.jar:
> $NUTCH_HOME/build/plugins/parse-msexcel/parse-msexcel.jar:
> $NUTCH_HOME/build/plugins/parse-mspowerpoint/parse-mspowerpoint.jar:
> $NUTCH_HOME/build/plugins/parse-msword/parse-msword.jar:
> $NUTCH_HOME/build/plugins/parse-oo/parse-oo.jar:
> $NUTCH_HOME/build/plugins/parse-pdf/parse-pdf.jar:
> $NUTCH_HOME/build/plugins/parse-pdf/PDFBox-0.7.2-log4j.jar:
> $NUTCH_HOME/build/plugins/parse-rss/parse-rss.jar:
> $NUTCH_HOME/build/plugins/parse-rss/xmlrpc-1.2.jar:
> $NUTCH_HOME/build/plugins/parse-rss/commons-feedparser-0.6-fork.jar:
> $NUTCH_HOME/build/plugins/parse-swf/parse-swf.jar:
> $NUTCH_HOME/build/plugins/parse-swf/javaswf.jar:
> $NUTCH_HOME/build/plugins/parse-text/parse-text.jar:
> $NUTCH_HOME/build/plugins/parse-zip/parse-zip.jar:
> $NUTCH_HOME/build/plugins/query-basic/query-basic.jar:
> $NUTCH_HOME/build/plugins/query-more/query-more.jar:
> $NUTCH_HOME/build/plugins/query-site/query-site.jar:
> $NUTCH_HOME/build/plugins/query-url/query-url.jar:
> $NUTCH_HOME/build/plugins/scoring-opic/scoring-opic.jar:
> $NUTCH_HOME/build/plugins/summary-basic/summary-basic.jar:
> $NUTCH_HOME/build/plugins/subcollection/subcollection.jar:
> $NUTCH_HOME/build/plugins/summary-lucene/summary-lucene.jar:
> $NUTCH_HOME/build/plugins/summary-lucene/lucene-highlighter-2.2.0.jar:
> $NUTCH_HOME/build/plugins/urlfilter-automaton/urlfilter-automaton.jar:
> $NUTCH_HOME/build/plugins/urlfilter-automaton/automaton.jar:
> $NUTCH_HOME/build/plugins/urlfilter-prefix/urlfilter-prefix.jar:
> $NUTCH_HOME/build/plugins/urlfilter-regex/urlfilter-regex.jar:
> $NUTCH_HOME/build/plugins/urlfilter-suffix/urlfilter-suffix.jar:
> $NUTCH_HOME/build/plugins/urlnormalizer-basic/urlnormalizer-basic.jar:
> $NUTCH_HOME/build/plugins/urlnormalizer-pass/urlnormalizer-pass.jar:
> $NUTCH_HOME/build/plugins/urlnormalizer-regex/urlnormalizer-regex.jar:
> $NUTCH_HOME/build/nutch-extensionpoints/nutch-extensionpoints.jar:
> $NUTCH_HOME/build/creativecommons/creativecommons.jar:
> $NUTCH_HOME/build/parse-html/parse-html.jar:
> $NUTCH_HOME/build/feed/feed.jar:
> $NUTCH_HOME/build/lib-xml/jaxen-core.jar:
> $NUTCH_HOME/build/lib-xml/jdom.jar:
> $NUTCH_HOME/build/lib-xml/xercesImpl.jar:
> $NUTCH_HOME/build/lib-xml/saxpath.jar:
> $NUTCH_HOME/build/lib-xml/jaxen-jdom.jar:
> $NUTCH_HOME/build/protocol-file/protocol-file.jar:
> $NUTCH_HOME/build/index-basic/index-basic.jar:
> $NUTCH_HOME/build/index-more/index-more.jar:
> $NUTCH_HOME/build/language-identifier/language-identifier.jar:
> $NUTCH_HOME/build/lib-http/lib-http.jar:
> $NUTCH_HOME/build/lib-jakarta-poi/poi-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/build/lib-jakarta-poi/poi-scratchpad-3.0-alpha1-20050704.jar:
> $NUTCH_HOME/build/lib-lucene-analyzers/lucene-analyzers-2.2.0.jar:
> $NUTCH_HOME/build/lib-parsems/lib-parsems.jar:
> $NUTCH_HOME/build/lib-regex-filter/lib-regex-filter.jar:
> $NUTCH_HOME/build/microformats-reltag/microformats-reltag.jar:
> $NUTCH_HOME/build/ontology/ontology.jar:
> $NUTCH_HOME/build/protocol-ftp/protocol-ftp.jar:
> $NUTCH_HOME/build/protocol-http/protocol-http.jar:
> $NUTCH_HOME/build/protocol-httpclient/protocol-httpclient.jar:
> $NUTCH_HOME/build/parse-ext/parse-ext.jar:
> $NUTCH_HOME/build/parse-js/parse-js.jar:
> $NUTCH_HOME/build/parse-msexcel/parse-msexcel.jar:
> $NUTCH_HOME/build/parse-mspowerpoint/parse-mspowerpoint.jar:
> $NUTCH_HOME/build/parse-msword/parse-msword.jar:
> $NUTCH_HOME/build/parse-oo/parse-oo.jar:
> $NUTCH_HOME/build/parse-pdf/parse-pdf.jar:
> $NUTCH_HOME/build/parse-rss/parse-rss.jar:
> $NUTCH_HOME/build/parse-swf/parse-swf.jar:
> $NUTCH_HOME/build/parse-text/parse-text.jar:
> $NUTCH_HOME/build/parse-zip/parse-zip.jar:
> $NUTCH_HOME/build/query-basic/query-basic.jar:
> $NUTCH_HOME/build/query-more/query-more.jar:
> $NUTCH_HOME/build/query-site/query-site.jar:
> $NUTCH_HOME/build/query-url/query-url.jar:
> $NUTCH_HOME/build/scoring-opic/scoring-opic.jar:
> $NUTCH_HOME/build/summary-basic/summary-basic.jar:
> $NUTCH_HOME/build/subcollection/subcollection.jar:
> $NUTCH_HOME/build/summary-lucene/summary-lucene.jar:
> $NUTCH_HOME/build/urlfilter-automaton/urlfilter-automaton.jar:
> $NUTCH_HOME/build/urlfilter-prefix/urlfilter-prefix.jar:
> $NUTCH_HOME/build/urlfilter-regex/urlfilter-regex.jar:
> $NUTCH_HOME/build/urlfilter-suffix/urlfilter-suffix.jar:
> $NUTCH_HOME/build/urlnormalizer-basic/urlnormalizer-basic.jar:
> $NUTCH_HOME/build/urlnormalizer-pass/urlnormalizer-pass.jar:
> $NUTCH_HOME/build/urlnormalizer-regex/urlnormalizer-regex.jar
> SearchApp.java
>
>
>
>
>
>
> ____________________________________________________________________________________
> Need a vacation? Get great deals
> to amazing places on Yahoo! Travel.
> http://travel.yahoo.com/
--
Doğacan Güney