[jira] [Updated] (NUTCH-2191) Add protocol-htmlunit

["Markus Jelsma (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/NUTCH-2191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Markus Jelsma updated NUTCH-2191:
---------------------------------
    Attachment: NUTCH-2191.patch

Patch for trunk! Although all dependencies are correctly listed in plugin.xml, Nutch still takes the incorrect versions from its own lib directory. To get indexchecker and parsechecker to work you must delete a couple of jars from Nutch' lib directory.

I removed all http* and (jetty* or jersey*) jars and got it to work. I haven't found a way yet for Nutch to load the dependencies from the plugin itself.

> Add protocol-htmlunit
> ---------------------
>
>                 Key: NUTCH-2191
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2191
>             Project: Nutch
>          Issue Type: New Feature
>          Components: protocol
>    Affects Versions: 1.11
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>             Fix For: 1.12
>
>         Attachments: NUTCH-2191.patch
>
>
> HtmlUnit is, opposed to other Javascript enabled headless browsers, a portable library and should therefore be better suited for very large scale crawls. This issue is an attempt to implement protocol-htmlunit.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)