You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by Silvio Heuberger <si...@hsr.ch> on 2008/12/01 14:51:04 UTC

Re: Nutch ignoring plugin....

Another update: I've got nutch to run inside Eclipse and now the 
log-level has been bounced.

That's part of the output:

2008-12-01 14:44:36,052 WARN  parse.ParserFactory 
(ParserFactory.java:matchExtensions(322)) - ParserFactory: Plugin: 
info.geometa.parse.wms.WMSParser mapped to contentType 
application/vnd.ogc.wms_xml via parse-plugins.xml, but not enabled via 
plugin.includes in nutch-default.xml
2008-12-01 14:44:36,053 WARN  parse.ParseUtil (ParseUtil.java:parse(73)) 
- No suitable parser found when trying to parse content 
http://isk.geobasis-bb.de/ows/dnm025.php?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.2.0 
of type application/vnd.ogc.wms_xml
2008-12-01 14:44:36,053 WARN  fetcher.Fetcher (Fetcher.java:output(315)) 
- Error parsing: 
http://isk.geobasis-bb.de/ows/dnm025.php?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.2.0: 
failed(2,200): org.apache.nutch.parse.ParseException: parser not found 
for contentType=application/vnd.ogc.wms_xml 
url=http://isk.geobasis-bb.de/ows/dnm025.php?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.2.0

anyone?

Silvio Heuberger wrote:
> Here's the relevant part of my plugin.xml:
>
> <implementation id="info.geometa.parse.wms.WMSParser"
>                       class="info.geometa.parse.wms.WMSParser">
>         <parameter name="contentType" value="application/vnd.ogc.wms_xml"/>
>         <parameter name="pathSuffix"  value=""/>
>       </implementation>
>
> I think that should nail it, right?
>
> Doğacan Güney wrote:
>   
>> Hi,
>>
>> On Thu, Nov 27, 2008 at 6:30 PM, Silvio Heuberger
>> <si...@hsr.ch> wrote:
>>   
>>     
>>> I have built a plugin for rudimentary parsing of WMS service descriptors.
>>>
>>> The content type for that is:
>>> application/vnd.ogc.wms_xml
>>>
>>> I have the plgin built by ant, tested by ant and all. Now I add the plugin
>>> to my registered extension points and hadoo.log shows the plugin is being
>>> loaded:
>>>
>>> Registered Plugins:
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     the nutch core
>>> extension points (nutch-extensionpoints)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Basic Query
>>> Filter (query-basic)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Html Parse
>>> Plug-in (parse-html)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Basic Indexing
>>> Filter (index-basic)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Basic Summarizer
>>> Plug-in (summary-basic)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Site Query
>>> Filter (query-site)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     HTTP Framework
>>> (lib-http)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Text Parse
>>> Plug-in (parse-text)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Regex URL Filter
>>> (urlfilter-regex)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Http Protocol
>>> Plug-in (protocol-http)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     OPIC Scoring
>>> Plug-in (scoring-opic)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     CyberNeko HTML
>>> Parser (lib-nekohtml)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Log4j
>>> (lib-log4j)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     URL Query Filter
>>> (query-url)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     WMS Parse
>>> Plug-in (parse-wms)
>>> 2008-11-27 17:23:08,928 INFO  plugin.PluginRepository -     Regex URL Filter
>>> Framework (lib-regex-filter)
>>>
>>> However, nutch seems to ignore the plugin.
>>>
>>> 2008-11-27 17:23:01,350 WARN  parse.ParseUtil - No suitable parser found
>>> when trying to parse content
>>> http://isk.geobasis-bb.de/ows/dnm025.php?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.2.0
>>> of type application/vnd.ogc.wms_xml
>>>
>>> I added the plugin to the parse-plugins.xml file:
>>>
>>> <!-- types for wms stuff -->
>>>   <mimeType name="application/vnd.ogc.wms_xml">
>>>     <plugin id="parse-wms" />
>>>   </mimeType>
>>> [...]
>>> <alias name="parse-wms" extension="info.geometa.parse.wms.WMSParser" />
>>>
>>> What gives??
>>>
>>>     
>>>       
>> I am not sure but can you check if you modified your plugin's
>> plugin.xml to include desired content-type?
>>
>>   
>>     
>>> Greets
>>> Silvio
>>>       

Re: Nutch ignoring plugin....

Posted by Doğacan Güney <do...@gmail.com>.
On Mon, Dec 1, 2008 at 3:51 PM, Silvio Heuberger
<si...@hsr.ch> wrote:
> Another update: I've got nutch to run inside Eclipse and now the log-level
> has been bounced.
>
> That's part of the output:
>
> 2008-12-01 14:44:36,052 WARN  parse.ParserFactory
> (ParserFactory.java:matchExtensions(322)) - ParserFactory: Plugin:
> info.geometa.parse.wms.WMSParser mapped to contentType
> application/vnd.ogc.wms_xml via parse-plugins.xml, but not enabled via
> plugin.includes in nutch-default.xml
> 2008-12-01 14:44:36,053 WARN  parse.ParseUtil (ParseUtil.java:parse(73)) -
> No suitable parser found when trying to parse content
> http://isk.geobasis-bb.de/ows/dnm025.php?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.2.0
> of type application/vnd.ogc.wms_xml
> 2008-12-01 14:44:36,053 WARN  fetcher.Fetcher (Fetcher.java:output(315)) -
> Error parsing:
> http://isk.geobasis-bb.de/ows/dnm025.php?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.2.0:
> failed(2,200): org.apache.nutch.parse.ParseException: parser not found for
> contentType=application/vnd.ogc.wms_xml
> url=http://isk.geobasis-bb.de/ows/dnm025.php?SERVICE=WMS&REQUEST=GetCapabilities&VERSION=1.2.0
>
> anyone?


Strange.... May seem like a stupid question, but did you enable the
plugin in nutch-site.xml? (in plugin.includes property)

>
> Silvio Heuberger wrote:
[...snip...]


-- 
Doğacan Güney