You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Markus Jelsma (Updated) (JIRA)" <ji...@apache.org> on 2011/11/10 13:59:52 UTC

[jira] [Updated] (NUTCH-1153) LinkRank must not log all hyperlinks

     [ https://issues.apache.org/jira/browse/NUTCH-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Markus Jelsma updated NUTCH-1153:
---------------------------------

    Attachment: NUTCH-1153-1.5-2.patch

Final patch also disabled writing of _SUCCESS files by recent Hadoop versions.
                
> LinkRank must not log all hyperlinks
> ------------------------------------
>
>                 Key: NUTCH-1153
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1153
>             Project: Nutch
>          Issue Type: Improvement
>            Reporter: Markus Jelsma
>            Assignee: Markus Jelsma
>             Fix For: 1.5
>
>         Attachments: NUTCH-1153-1.5-1.patch, NUTCH-1153-1.5-2.patch
>
>
> The LinkRank reducer log's all hyperlinks with the associated statistics at INFO level. This results in much increased I/O-wait. Level should be reduced to DEBUG.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira