You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Ameer Tawfik Albaham (JIRA)" <ji...@apache.org> on 2014/09/29 11:52:33 UTC

[jira] [Comment Edited] (NUTCH-1403) Add default ScoringFilter for manipulating metadata

    [ https://issues.apache.org/jira/browse/NUTCH-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14151545#comment-14151545 ] 

Ameer Tawfik Albaham edited comment on NUTCH-1403 at 9/29/14 9:51 AM:
----------------------------------------------------------------------

Good. I also discarded the fourth one as I reached the same conclusion you just mentioned. As I said, I have already implemented the plugin. I will be able to finish the whole thing and prepare a patch by this weekend.



was (Author: ameertawfik):
Good. I also discarded the fourth one as I reached the same conclusion you just mentioned. As I said, I have already implemented. I will be able to finish the whole thing and prepare a patch by this weekend.


> Add default ScoringFilter for manipulating metadata 
> ----------------------------------------------------
>
>                 Key: NUTCH-1403
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1403
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Julien Nioche
>
> This is currently done by the urlmeta plugin, which has too vague a name and a redundant indexing filter now that we have the index-metadata plugin. This scoring filter would help defining which metadata to pass from : 
> - the crawl metadata to the content metadata
> - the content metadata to the parse metadata
> - the parse metadata to the crawldatum for the outlinks
> I'd make this scoring filter available by default i.e. not in a separate plugin as its functionalities are commonly used.   



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)