You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Alaak <al...@gmx.de> on 2012/08/12 21:54:12 UTC
Custom plugin successfully registered but not executed.
Hi,
I am trying to create a very simple Nutch plugin that simply prints
something to the command line or hadoop.log during execution. I followed
the tutorial on setting up Nutch in Eclipse from the Wiki and also the
Tutorial on creating a simple Plugin. I also found another Tutorial
here: http://florianhartl.com/nutch-plugin-tutorial.html#comment-41 and
followed that as well.
After some problems I finally managed to get Nutch up and running and my
Plugin to be registered according to hadoop.log
2012-08-12 21:36:48,578 INFO plugin.PluginRepository - Add Field to
Index (myPlugin)
However, regardless of what I am attempting I seem to be unable to make
the plugin actually run. It seems to not be executed. There was a guy
having the same problem in the comments of the second tutorial I
followed and since I am developing under Linux it might be possible that
my problem is related to the following:
http://lucene.472066.n3.nabble.com/Nutch-plugin-ignored-in-linux-works-on-windows-td3191884.html
However none of these questions got an answer up to now? So has there
been some new insight on running custom plugins under Linux (actually
Ubuntu 12.04) or could it be something completely different? Any ideas?
I would absolutely willing to provide you with additional information if
you could tell me what you need.
Regards
Re: Custom plugin successfully registered but not executed.
Posted by Alaak <al...@gmx.de>.
Ah. *headdesk* So this means the Solr Server is required for the Plugin
to be called. Ok. That was not the case when I tried Nutch the last time
(probably one year or more ago). At that time a Lucene Index was used
and I assumed this would still be the case if no Solr Server is
configured. I'll try this. Thanks for the answer to both of you.
Am So 12 Aug 2012 22:08:50 CEST schrieb Sebastian Nagel:
>
> Hi Klemens,
>
> as Lewis stated:
>>
>> Unless you are indexing nothing will happen. You specify an indexing
>> filter so you actually need to index something before the filter is
>> run.
>> Although it is loaded this doesn't mean that anything is being indexed.
>
>
> If you run the indexer and there are documents to index you should see
> something like this:
>
> 2012-07-06 23:26:12,917 INFO solr.SolrIndexer - SolrIndexer: starting
> at 2012-07-06 23:26:12
> ...
> 2012-07-06 23:26:55,075 INFO indexer.IndexingFilters - Adding myPlugin
> ...
> <myPlugin log messages>
> ...
> 2012-07-06 23:26:55,176 INFO solr.SolrWriter - Indexing 12 documents
> 2012-07-06 23:27:00,798 INFO solr.SolrIndexer - SolrIndexer: finished
> at 2012-07-06 23:27:00,
> elapsed: 00:00:47
>
> Alternatively, to be faster, try
> nutch indexchecker <url>
> and watch the hadoop.log
>
> Sebastian
>
>
> On 08/12/2012 09:54 PM, Alaak wrote:
>>
>> Hi,
>>
>> I am trying to create a very simple Nutch plugin that simply prints
>> something to the command line or
>> hadoop.log during execution. I followed the tutorial on setting up
>> Nutch in Eclipse from the Wiki
>> and also the Tutorial on creating a simple Plugin. I also found
>> another Tutorial here:
>> http://florianhartl.com/nutch-plugin-tutorial.html#comment-41 and
>> followed that as well.
>>
>> After some problems I finally managed to get Nutch up and running and
>> my Plugin to be registered
>> according to hadoop.log
>>
>> 2012-08-12 21:36:48,578 INFO plugin.PluginRepository - Add Field to
>> Index (myPlugin)
>>
>> However, regardless of what I am attempting I seem to be unable to
>> make the plugin actually run. It
>> seems to not be executed. There was a guy having the same problem in
>> the comments of the second
>> tutorial I followed and since I am developing under Linux it might be
>> possible that my problem is
>> related to the following:
>> http://lucene.472066.n3.nabble.com/Nutch-plugin-ignored-in-linux-works-on-windows-td3191884.html
>>
>> However none of these questions got an answer up to now? So has there
>> been some new insight on
>> running custom plugins under Linux (actually Ubuntu 12.04) or could
>> it be something completely
>> different? Any ideas?
>>
>> I would absolutely willing to provide you with additional information
>> if you could tell me what you
>> need.
>>
>> Regards
>>
>>
>
Re: Custom plugin successfully registered but not executed.
Posted by Sebastian Nagel <wa...@googlemail.com>.
Hi Klemens,
as Lewis stated:
> Unless you are indexing nothing will happen. You specify an indexing
> filter so you actually need to index something before the filter is
> run.
> Although it is loaded this doesn't mean that anything is being indexed.
If you run the indexer and there are documents to index you should see
something like this:
2012-07-06 23:26:12,917 INFO solr.SolrIndexer - SolrIndexer: starting at 2012-07-06 23:26:12
...
2012-07-06 23:26:55,075 INFO indexer.IndexingFilters - Adding myPlugin
...
<myPlugin log messages>
...
2012-07-06 23:26:55,176 INFO solr.SolrWriter - Indexing 12 documents
2012-07-06 23:27:00,798 INFO solr.SolrIndexer - SolrIndexer: finished at 2012-07-06 23:27:00,
elapsed: 00:00:47
Alternatively, to be faster, try
nutch indexchecker <url>
and watch the hadoop.log
Sebastian
On 08/12/2012 09:54 PM, Alaak wrote:
> Hi,
>
> I am trying to create a very simple Nutch plugin that simply prints something to the command line or
> hadoop.log during execution. I followed the tutorial on setting up Nutch in Eclipse from the Wiki
> and also the Tutorial on creating a simple Plugin. I also found another Tutorial here:
> http://florianhartl.com/nutch-plugin-tutorial.html#comment-41 and followed that as well.
>
> After some problems I finally managed to get Nutch up and running and my Plugin to be registered
> according to hadoop.log
>
> 2012-08-12 21:36:48,578 INFO plugin.PluginRepository - Add Field to Index (myPlugin)
>
> However, regardless of what I am attempting I seem to be unable to make the plugin actually run. It
> seems to not be executed. There was a guy having the same problem in the comments of the second
> tutorial I followed and since I am developing under Linux it might be possible that my problem is
> related to the following:
> http://lucene.472066.n3.nabble.com/Nutch-plugin-ignored-in-linux-works-on-windows-td3191884.html
>
> However none of these questions got an answer up to now? So has there been some new insight on
> running custom plugins under Linux (actually Ubuntu 12.04) or could it be something completely
> different? Any ideas?
>
> I would absolutely willing to provide you with additional information if you could tell me what you
> need.
>
> Regards
>
>