You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Chris A. Mattmann (JIRA)" <ji...@apache.org> on 2015/08/30 01:35:45 UTC
[jira] [Updated] (NUTCH-2088) Add Optional Execution to Interactive
Selenium Handlers
[ https://issues.apache.org/jira/browse/NUTCH-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris A. Mattmann updated NUTCH-2088:
-------------------------------------
Fix Version/s: 1.11
> Add Optional Execution to Interactive Selenium Handlers
> -------------------------------------------------------
>
> Key: NUTCH-2088
> URL: https://issues.apache.org/jira/browse/NUTCH-2088
> Project: Nutch
> Issue Type: Improvement
> Components: plugin
> Affects Versions: 1.10
> Reporter: Michael Joyce
> Fix For: 1.11
>
>
> At the moment, all the Handlers run for every URL when using the interactive-selenium plugin. Often times when trying to do a deep crawl of a site you'll want to handle various subdomains and paths/files differently. You can effectively filter in the handlers at the moment, but only once you've loaded the WebDriver and incurred the associated overhead. It would be much nicer if the handler interface allowed for this check to occur prior to the request to retrieve page content.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)