You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Matthew Hall <ma...@gmail.com> on 2015/04/21 16:00:33 UTC

Compiling plugins for Nutch

Hi, I am currently trying to compile a plugin for nutch 2.3.  Unfortunately
the ant task fails when trying to compile the plugin with the following
error



BUILD FAILED

/home/nutchStack/nutch/apache-nutch-2.3/src/plugin/simpleIndexFilter/build.xml:3:
The following error occurred while executing this line:

/home/nutchStack/nutch/apache-nutch-2.3/src/plugin/build-plugin.xml:46:
Could not create task or type of type: antlib:org.apache.ivy.ant:settings.



Ant could not find the task or a class this task relies upon.



This is common and has a number of causes; the usual

solutions are to read the manual pages then download and

install needed JAR files, or fix the build file:

 - You have misspelt 'antlib:org.apache.ivy.ant:settings'.

   Fix: check your spelling.

 - The task needs an external JAR file to execute

     and this is not found at the right place in the classpath.

   Fix: check the documentation for dependencies.

   Fix: declare the task.

 - The task is an Ant optional task and the JAR file and/or libraries

     implementing the functionality were not found at the time you

     yourself built your installation of Ant from the Ant sources.

   Fix: Look in the ANT_HOME/lib for the 'ant-' JAR corresponding to the

     task and make sure it contains more than merely a META-INF/MANIFEST.MF.

     If all it contains is the manifest, then rebuild Ant with the needed

     libraries present in ${ant.home}/lib/optional/ , or alternatively,

     download a pre-built release version from apache.org

 - The build file was written for a later version of Ant

   Fix: upgrade to at least the latest release version of Ant

 - The task is not an Ant core or optional task

     and needs to be declared using <taskdef>.

 - You are attempting to use a task defined using

    <presetdef> or <macrodef> but have spelt wrong or not

   defined it at the point of use



Remember that for JAR files to be visible to Ant tasks implemented

in ANT_HOME/lib, the files must be in the same directory or on the

classpath



I tried to compile other plugins within the src directory but I get the
same error.  Could you advise please (new to ant and ivy)



Thanks.

Kind regards,



*Matt Hall*

Re: [MASSMAIL]Compiling plugins for Nutch

Posted by Jorge Luis Betancourt González <jl...@uci.cu>.
How are you building/compiling the plugin? which command are you executing and in which directory?

----- Original Message -----
From: "Matthew Hall" <ma...@gmail.com>
To: user@nutch.apache.org
Sent: Tuesday, April 21, 2015 10:00:33 AM
Subject: [MASSMAIL]Compiling plugins for Nutch

Hi, I am currently trying to compile a plugin for nutch 2.3.  Unfortunately
the ant task fails when trying to compile the plugin with the following
error



BUILD FAILED

/home/nutchStack/nutch/apache-nutch-2.3/src/plugin/simpleIndexFilter/build.xml:3:
The following error occurred while executing this line:

/home/nutchStack/nutch/apache-nutch-2.3/src/plugin/build-plugin.xml:46:
Could not create task or type of type: antlib:org.apache.ivy.ant:settings.



Ant could not find the task or a class this task relies upon.



This is common and has a number of causes; the usual

solutions are to read the manual pages then download and

install needed JAR files, or fix the build file:

 - You have misspelt 'antlib:org.apache.ivy.ant:settings'.

   Fix: check your spelling.

 - The task needs an external JAR file to execute

     and this is not found at the right place in the classpath.

   Fix: check the documentation for dependencies.

   Fix: declare the task.

 - The task is an Ant optional task and the JAR file and/or libraries

     implementing the functionality were not found at the time you

     yourself built your installation of Ant from the Ant sources.

   Fix: Look in the ANT_HOME/lib for the 'ant-' JAR corresponding to the

     task and make sure it contains more than merely a META-INF/MANIFEST.MF.

     If all it contains is the manifest, then rebuild Ant with the needed

     libraries present in ${ant.home}/lib/optional/ , or alternatively,

     download a pre-built release version from apache.org

 - The build file was written for a later version of Ant

   Fix: upgrade to at least the latest release version of Ant

 - The task is not an Ant core or optional task

     and needs to be declared using <taskdef>.

 - You are attempting to use a task defined using

    <presetdef> or <macrodef> but have spelt wrong or not

   defined it at the point of use



Remember that for JAR files to be visible to Ant tasks implemented

in ANT_HOME/lib, the files must be in the same directory or on the

classpath



I tried to compile other plugins within the src directory but I get the
same error.  Could you advise please (new to ant and ivy)



Thanks.

Kind regards,



*Matt Hall*

Re: Help. Nutch not crawling site.

Posted by Michael Joyce <jo...@apache.org>.
What is your config? What happens when you run the crawl? What is in your
crawldb? What are your seed urls? What is the output of parsechecker on
that sight? If you can throw some info our way I'm sure we can help you
figure out why you're having problems.


-- Jimmy

On Tue, Apr 21, 2015 at 7:19 PM, Shane Wood <sh...@cbm8bit.com> wrote:

> Is there any reason why Nutch would not crawl this site ?
> http://www.bitfixer.com
>
> I have checked and can not find a robots.txt file.
>
> Cheers
> Shane.
>

Help. Nutch not crawling site.

Posted by Shane Wood <sh...@cbm8bit.com>.
Is there any reason why Nutch would not crawl this site ? 
http://www.bitfixer.com

I have checked and can not find a robots.txt file.

Cheers
Shane.