You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Marek Bachmann (JIRA)" <ji...@apache.org> on 2011/08/24 16:28:29 UTC

[jira] [Updated] (NUTCH-1090) LinkDb (invertlinks) should inform the user when it ignores internal links

     [ https://issues.apache.org/jira/browse/NUTCH-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marek Bachmann updated NUTCH-1090:
----------------------------------

    Attachment: LinkDb.patch

I inserted a {{LOG.info}} message in the {{configure}} method.
I Don't think that this is the best place but the {{ignoreInternalLinks}} variable isn't set before this method was called

Hope the format of the patch file is correct. I never posted one before :)

> LinkDb (invertlinks) should inform the user when it ignores internal links
> --------------------------------------------------------------------------
>
>                 Key: NUTCH-1090
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1090
>             Project: Nutch
>          Issue Type: Improvement
>          Components: linkdb
>    Affects Versions: 1.3
>            Reporter: Marek Bachmann
>            Priority: Trivial
>              Labels: configuration, information, log
>             Fix For: 1.3
>
>         Attachments: LinkDb.patch
>
>
> I used nutch to crawl sites on a single domain. After the crawl was complete I tried to build a LinkDb. The LinkDb was empty. 
> It comes up that this happens because the invertlinks command ignores internal links to the same domain by default. 
> Unfortunately the LinkDb class doesn't tell anything about that. So it was hard to find out why the LinkDb was empty. 
> I suggest to add an information for the user when the invertlinks command is ignoring internal links.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira