You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Sourajit Basak (JIRA)" <ji...@apache.org> on 2012/12/17 18:40:14 UTC

[jira] [Updated] (NUTCH-1504) Pluggable url partitioner

     [ https://issues.apache.org/jira/browse/NUTCH-1504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sourajit Basak updated NUTCH-1504:
----------------------------------

    Attachment: custom.partitioner.patch
    
> Pluggable url partitioner
> -------------------------
>
>                 Key: NUTCH-1504
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1504
>             Project: Nutch
>          Issue Type: Improvement
>          Components: generator
>    Affects Versions: 1.6
>            Reporter: Sourajit Basak
>         Attachments: custom.partitioner.patch
>
>
> At present, the url partition logic is hard wired inside nutch core. It should be pluggable like FetchSchedule customized via nutch-site.xml.
> There might be use cases where a single domain needs to be partioned on some custom logic. The existing UrlPartitioner cannot handle such cases. 
> Hence the requirement.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira