[jira] [Commented] (NUTCH-1403) Add default ScoringFilter for manipulating metadata

["Ameer Tawfik Albaham (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NUTCH-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150747#comment-14150747 ] 

Ameer Tawfik Albaham commented on NUTCH-1403:
---------------------------------------------

I would like to contribute to this issue. However, I am a bit not sure what else is required in addition to what *urlmeta* is doing. Does this plugin have a different list of meta data for each case:

- a list of meta data to pass from crawl datum to content.
- a list of meta data to pass from content to parse data.
- a list of meta data to pass from parse data to outlinks.
- a list of meta data to pass from crawl datum to content to parse data.


> Add default ScoringFilter for manipulating metadata 
> ----------------------------------------------------
>
>                 Key: NUTCH-1403
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1403
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Julien Nioche
>
> This is currently done by the urlmeta plugin, which has too vague a name and a redundant indexing filter now that we have the index-metadata plugin. This scoring filter would help defining which metadata to pass from : 
> - the crawl metadata to the content metadata
> - the content metadata to the parse metadata
> - the parse metadata to the crawldatum for the outlinks
> I'd make this scoring filter available by default i.e. not in a separate plugin as its functionalities are commonly used.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)