You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Kai_testing Middleton <ka...@yahoo.com> on 2007/06/26 06:43:41 UTC

NUTCH-505 - cannot find symbol: variable URL_VALIDATOR

I did the following steps to try to apply the patch for NUTCH-505.  Please advise on the ant build error.  

I checked out nutch 0.9 as follows:
svn co http://svn.apache.org/repos/asf/lucene/nutch/branches/branch-0.9/

I downloaded the patch:
wget https://issues.apache.org/jira/secure/attachment/12360411/NUTCH-505_draft_v2.patch --no-check-certificate

I applied the patch as follows.  Note there is an error in hunk 2.

[kai@dev /usr/local/kai/branch-0.9]$ patch < NUTCH-505_draft_v2.patch
Hmm...  Looks like a unified diff to me...
The text leading up to this was:
--------------------------
|Index: src/java/org/apache/nutch/parse/ParseOutputFormat.java
|===================================================================
|--- src/java/org/apache/nutch/parse/ParseOutputFormat.java     (revision 550188)
|+++ src/java/org/apache/nutch/parse/ParseOutputFormat.java     (working copy)
--------------------------
Patching file src/java/org/apache/nutch/parse/ParseOutputFormat.java using Plan A...
Hunk #1 succeeded at 29.
Hunk #2 failed at 49.
Hunk #3 succeeded at 119 (offset -29 lines).
1 out of 3 hunks failed--saving rejects to src/java/org/apache/nutch/parse/ParseOutputFormat.java.rej
Hmm...  The next patch looks like a unified diff to me...
The text leading up to this was:
--------------------------
|Index: src/java/org/apache/nutch/util/UrlValidator.java
|===================================================================
|--- src/java/org/apache/nutch/util/UrlValidator.java   (revision 0)
|+++ src/java/org/apache/nutch/util/UrlValidator.java   (revision 0)
--------------------------
(Creating file src/java/org/apache/nutch/util/UrlValidator.java...)
Patching file src/java/org/apache/nutch/util/UrlValidator.java using Plan A...
Hunk #1 succeeded at 1.
done


I built with ant but got the following:

[kai@dev /usr/local/kai/branch-0.9]$ ant
Buildfile: build.xml

init:
    [mkdir] Created dir: /usr/local/kai/branch-0.9/build
    [mkdir] Created dir: /usr/local/kai/branch-0.9/build/classes
    [mkdir] Created dir: /usr/local/kai/branch-0.9/build/test
    [mkdir] Created dir: /usr/local/kai/branch-0.9/build/test/classes
     [copy] Copying 9 files to /usr/local/kai/branch-0.9/conf
     [copy] Copying /usr/local/kai/branch-0.9/conf/regex-urlfilter.txt.template to /usr/local/kai/branch-0.9/conf/regex-urlfilter.txt
     [copy] Copying /usr/local/kai/branch-0.9/conf/hadoop-env.sh.template to /usr/local/kai/branch-0.9/conf/hadoop-env.sh
     [copy] Copying /usr/local/kai/branch-0.9/conf/automaton-urlfilter.txt.template to /usr/local/kai/branch-0.9/conf/automaton-urlfilter.txt
     [copy] Copying /usr/local/kai/branch-0.9/conf/crawl-urlfilter.txt.template to /usr/local/kai/branch-0.9/conf/crawl-urlfilter.txt
     [copy] Copying /usr/local/kai/branch-0.9/conf/hadoop-site.xml.template to /usr/local/kai/branch-0.9/conf/hadoop-site.xml
     [copy] Copying /usr/local/kai/branch-0.9/conf/slaves.template to /usr/local/kai/branch-0.9/conf/slaves
     [copy] Copying /usr/local/kai/branch-0.9/conf/regex-normalize.xml.template to /usr/local/kai/branch-0.9/conf/regex-normalize.xml
     [copy] Copying /usr/local/kai/branch-0.9/conf/subcollections.xml.template to /usr/local/kai/branch-0.9/conf/subcollections.xml
     [copy] Copying /usr/local/kai/branch-0.9/conf/nutch-site.xml.template to /usr/local/kai/branch-0.9/conf/nutch-site.xml
    [mkdir] Created dir: /usr/local/kai/branch-0.9/build/hadoop
    [unjar] Expanding: /usr/local/kai/branch-0.9/lib/hadoop-0.12.2-core.jar into /usr/local/kai/branch-0.9/build/hadoop
    [untar] Expanding: /usr/local/kai/branch-0.9/build/hadoop/bin.tgz into /usr/local/kai/branch-0.9/bin
    [mkdir] Created dir: /usr/local/kai/branch-0.9/build/webapps
    [unjar] Expanding: /usr/local/kai/branch-0.9/lib/hadoop-0.12.2-core.jar into /usr/local/kai/branch-0.9/build

compile-core:
    [javac] Compiling 166 source files to /usr/local/kai/branch-0.9/build/classes
    [javac] /usr/local/kai/branch-0.9/src/java/org/apache/nutch/parse/ParseOutputFormat.java:122: cannot find symbol
    [javac] symbol: variable URL_VALIDATOR
    [javac]             if (!URL_VALIDATOR.isValid(toUrl)) {
    [javac]                  ^
    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 1 error

BUILD FAILED
/usr/local/kai/branch-0.9/build.xml:106: Compile failed; see the compiler error output for details.

Total time: 4 minutes 39 seconds






 
____________________________________________________________________________________
Bored stiff? Loosen up... 
Download and play hundreds of games for free on Yahoo! Games.
http://games.yahoo.com/games/front

Re: NUTCH-505 - cannot find symbol: variable URL_VALIDATOR

Posted by Doğacan Güney <do...@gmail.com>.
On 6/26/07, Kai_testing Middleton <ka...@yahoo.com> wrote:
> I did the following steps to try to apply the patch for NUTCH-505.  Please advise on the ant build error.
>
> I checked out nutch 0.9 as follows:
> svn co http://svn.apache.org/repos/asf/lucene/nutch/branches/branch-0.9/
>
> I downloaded the patch:
> wget https://issues.apache.org/jira/secure/attachment/12360411/NUTCH-505_draft_v2.patch --no-check-certificate
>
> I applied the patch as follows.  Note there is an error in hunk 2.
>
> [kai@dev /usr/local/kai/branch-0.9]$ patch < NUTCH-505_draft_v2.patch
> Hmm...  Looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |Index: src/java/org/apache/nutch/parse/ParseOutputFormat.java
> |===================================================================
> |--- src/java/org/apache/nutch/parse/ParseOutputFormat.java     (revision 550188)
> |+++ src/java/org/apache/nutch/parse/ParseOutputFormat.java     (working copy)
> --------------------------
> Patching file src/java/org/apache/nutch/parse/ParseOutputFormat.java using Plan A...
> Hunk #1 succeeded at 29.
> Hunk #2 failed at 49.
> Hunk #3 succeeded at 119 (offset -29 lines).
> 1 out of 3 hunks failed--saving rejects to src/java/org/apache/nutch/parse/ParseOutputFormat.java.rej
> Hmm...  The next patch looks like a unified diff to me...
> The text leading up to this was:
> --------------------------
> |Index: src/java/org/apache/nutch/util/UrlValidator.java
> |===================================================================
> |--- src/java/org/apache/nutch/util/UrlValidator.java   (revision 0)
> |+++ src/java/org/apache/nutch/util/UrlValidator.java   (revision 0)
> --------------------------
> (Creating file src/java/org/apache/nutch/util/UrlValidator.java...)
> Patching file src/java/org/apache/nutch/util/UrlValidator.java using Plan A...
> Hunk #1 succeeded at 1.
> done
>
>
> I built with ant but got the following:
>
> [kai@dev /usr/local/kai/branch-0.9]$ ant
> Buildfile: build.xml
>
> init:
>     [mkdir] Created dir: /usr/local/kai/branch-0.9/build
>     [mkdir] Created dir: /usr/local/kai/branch-0.9/build/classes
>     [mkdir] Created dir: /usr/local/kai/branch-0.9/build/test
>     [mkdir] Created dir: /usr/local/kai/branch-0.9/build/test/classes
>      [copy] Copying 9 files to /usr/local/kai/branch-0.9/conf
>      [copy] Copying /usr/local/kai/branch-0.9/conf/regex-urlfilter.txt.template to /usr/local/kai/branch-0.9/conf/regex-urlfilter.txt
>      [copy] Copying /usr/local/kai/branch-0.9/conf/hadoop-env.sh.template to /usr/local/kai/branch-0.9/conf/hadoop-env.sh
>      [copy] Copying /usr/local/kai/branch-0.9/conf/automaton-urlfilter.txt.template to /usr/local/kai/branch-0.9/conf/automaton-urlfilter.txt
>      [copy] Copying /usr/local/kai/branch-0.9/conf/crawl-urlfilter.txt.template to /usr/local/kai/branch-0.9/conf/crawl-urlfilter.txt
>      [copy] Copying /usr/local/kai/branch-0.9/conf/hadoop-site.xml.template to /usr/local/kai/branch-0.9/conf/hadoop-site.xml
>      [copy] Copying /usr/local/kai/branch-0.9/conf/slaves.template to /usr/local/kai/branch-0.9/conf/slaves
>      [copy] Copying /usr/local/kai/branch-0.9/conf/regex-normalize.xml.template to /usr/local/kai/branch-0.9/conf/regex-normalize.xml
>      [copy] Copying /usr/local/kai/branch-0.9/conf/subcollections.xml.template to /usr/local/kai/branch-0.9/conf/subcollections.xml
>      [copy] Copying /usr/local/kai/branch-0.9/conf/nutch-site.xml.template to /usr/local/kai/branch-0.9/conf/nutch-site.xml
>     [mkdir] Created dir: /usr/local/kai/branch-0.9/build/hadoop
>     [unjar] Expanding: /usr/local/kai/branch-0.9/lib/hadoop-0.12.2-core.jar into /usr/local/kai/branch-0.9/build/hadoop
>     [untar] Expanding: /usr/local/kai/branch-0.9/build/hadoop/bin.tgz into /usr/local/kai/branch-0.9/bin
>     [mkdir] Created dir: /usr/local/kai/branch-0.9/build/webapps
>     [unjar] Expanding: /usr/local/kai/branch-0.9/lib/hadoop-0.12.2-core.jar into /usr/local/kai/branch-0.9/build
>
> compile-core:
>     [javac] Compiling 166 source files to /usr/local/kai/branch-0.9/build/classes
>     [javac] /usr/local/kai/branch-0.9/src/java/org/apache/nutch/parse/ParseOutputFormat.java:122: cannot find symbol
>     [javac] symbol: variable URL_VALIDATOR
>     [javac]             if (!URL_VALIDATOR.isValid(toUrl)) {
>     [javac]                  ^
>     [javac] Note: Some input files use or override a deprecated API.
>     [javac] Note: Recompile with -Xlint:deprecation for details.
>     [javac] Note: Some input files use unchecked or unsafe operations.
>     [javac] Note: Recompile with -Xlint:unchecked for details.
>     [javac] 1 error
>
> BUILD FAILED
> /usr/local/kai/branch-0.9/build.xml:106: Compile failed; see the compiler error output for details.
>
> Total time: 4 minutes 39 seconds

This patch won't apply against 0.9 branch, you have to checkout latest trunk:

$ svn co http://svn.apache.org/repos/asf/lucene/nutch/trunk nutch
$ cd nutch
$ wget https://issues.apache.org/jira/secure/attachment/12360411/NUTCH-505_draft_v2.patch
$ patch -p0 < NUTCH-505_draft_v2.patch
$ ant clean && ant


>
>
>
>
>
>
>
> ____________________________________________________________________________________
> Bored stiff? Loosen up...
> Download and play hundreds of games for free on Yahoo! Games.
> http://games.yahoo.com/games/front


-- 
Doğacan Güney