You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Stefan Groschupf (JIRA)" <ji...@apache.org> on 2006/07/20 01:48:13 UTC
[jira] Created: (NUTCH-324) db.score.link.internal and
db.score.link.external are ignored
db.score.link.internal and db.score.link.external are ignored
-------------------------------------------------------------
Key: NUTCH-324
URL: http://issues.apache.org/jira/browse/NUTCH-324
Project: Nutch
Issue Type: Improvement
Components: fetcher
Reporter: Stefan Groschupf
Priority: Critical
Configuration properties db.score.link.external and db.score.link.internal are ignored.
In case of e.g. message board webpages or pages that have larger navigation menus on each page having a lower impact of internal links makes a lot of sense for scoring.
Also for web spam this is a serious problem, since now spammers can setup just one domain with dynamically generated pages and this highly manipulate the nutch scores.
So I also suggest that we give db.score.link.internal by default a value of something like 0.25.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Closed: (NUTCH-324) db.score.link.internal and
db.score.link.external are ignored
Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/NUTCH-324?page=all ]
Andrzej Bialecki closed NUTCH-324.
-----------------------------------
Fix Version/s: 0.8-dev
Resolution: Fixed
Patch applied, with minor whitespace diffs and doc. clarifications. Thank you!
> db.score.link.internal and db.score.link.external are ignored
> -------------------------------------------------------------
>
> Key: NUTCH-324
> URL: http://issues.apache.org/jira/browse/NUTCH-324
> Project: Nutch
> Issue Type: Improvement
> Components: fetcher
> Reporter: Stefan Groschupf
> Priority: Critical
> Fix For: 0.8-dev
>
> Attachments: InternalAndExternalLinkScoreFactor.patch
>
>
> Configuration properties db.score.link.external and db.score.link.internal are ignored.
> In case of e.g. message board webpages or pages that have larger navigation menus on each page having a lower impact of internal links makes a lot of sense for scoring.
> Also for web spam this is a serious problem, since now spammers can setup just one domain with dynamically generated pages and this highly manipulate the nutch scores.
> So I also suggest that we give db.score.link.internal by default a value of something like 0.25.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (NUTCH-324) db.score.link.internal and
db.score.link.external are ignored
Posted by "Stefan Groschupf (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/NUTCH-324?page=all ]
Stefan Groschupf updated NUTCH-324:
-----------------------------------
Attachment: InternalAndExternalLinkScoreFactor.patch
Multiply the score of a page during distributeScoreToOutlink with db.score.link.internal or db.score.link.external.
> db.score.link.internal and db.score.link.external are ignored
> -------------------------------------------------------------
>
> Key: NUTCH-324
> URL: http://issues.apache.org/jira/browse/NUTCH-324
> Project: Nutch
> Issue Type: Improvement
> Components: fetcher
> Reporter: Stefan Groschupf
> Priority: Critical
> Attachments: InternalAndExternalLinkScoreFactor.patch
>
>
> Configuration properties db.score.link.external and db.score.link.internal are ignored.
> In case of e.g. message board webpages or pages that have larger navigation menus on each page having a lower impact of internal links makes a lot of sense for scoring.
> Also for web spam this is a serious problem, since now spammers can setup just one domain with dynamically generated pages and this highly manipulate the nutch scores.
> So I also suggest that we give db.score.link.internal by default a value of something like 0.25.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira