NoClassDefFoundError: org/cyberneko/html/parsers/DOMFragmentParser when using HtmlParser

[d_k <ma...@gmail.com>]

Hello,

I'm using Nutch 2.2.1 with parse-plugins.xml configured to handle text/html
with parse-html that is org.apache.nutch.parse.html.HtmlParser and unless
i'm adding the full path to the nekohtml-0.9.5.jar in the plugins directory
to the classpath in the nutch.sh script i'm getting the error
"NoClassDefFoundError: org/cyberneko/html/parsers/DOMFragmentParser" when
the DOMFragmentParser instance is created at the HtmlParser.parseNeko
method.

I was wondering if there is a way to avoid the above error without editing
the nutch script, or perhaps what is the correct way to enable nutch to
find and load its plugin jars?

I already added the 'plugin.folders' property to the nutch-site.xml file
with the path to the plugins dir but it didn't help.

Re: load plugin from jar file

[Tejas Patil <te...@gmail.com>]

I am not familiar with Clojure at all. Nutch plugin loading code is tricky
and hacking it to straight away invoke Clojure code should be a significant
work. My feeling is that if you cook up with a plugin in java and then
call Clojure
code through this java wrapper, this might work.

Thanks,
Tejas


On Mon, Dec 9, 2013 at 5:03 PM, Olle Romo <ol...@metasound.ch> wrote:

> Hi All,
>
> According to NUTCH-609 there were some talk about allowing plugins to load
> from jar files. Looks like that was from a few years ago. Can I write a
> plugin in Clojure and have it load ok?
>
> Best,
> Olle
>
>

load plugin from jar file

[Olle Romo <ol...@metasound.ch>]

Hi All,

According to NUTCH-609 there were some talk about allowing plugins to load from jar files. Looks like that was from a few years ago. Can I write a plugin in Clojure and have it load ok?

Best,
Olle