You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Furkan KAMACI (JIRA)" <ji...@apache.org> on 2017/01/09 16:45:58 UTC

[jira] [Commented] (NUTCH-2275) MD5Signature by default doesn't take in account parse

    [ https://issues.apache.org/jira/browse/NUTCH-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15812209#comment-15812209 ] 

Furkan KAMACI commented on NUTCH-2275:
--------------------------------------

[~fre93] does that problem still exist?

> MD5Signature by default doesn't take in account parse
> -----------------------------------------------------
>
>                 Key: NUTCH-2275
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2275
>             Project: Nutch
>          Issue Type: Bug
>          Components: parser
>    Affects Versions: 1.11
>            Reporter: Francesco Capponi
>
> I'm testing Apache Nutch with the feed's plugin. I've noticed that for each page it generates the same digest/signature, therefore the dedup cleans everything up from the database.
> I'm wondering why the class MD5Signature is the default one instead of TextMD5Signature.
> Anyhow now I've modified a little bit the MD5Signature to let it work with the feed plugin



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)