You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Stefan GRroschupf (JIRA)" <ji...@apache.org> on 2005/02/20 23:06:48 UTC
[jira] Created: (NUTCH-2) UpdateDatabaseTool ignores url-filters
UpdateDatabaseTool ignores url-filters
--------------------------------------
Key: NUTCH-2
URL: http://issues.apache.org/jira/browse/NUTCH-2
Project: Nutch
Type: Bug
Reporter: Stefan GRroschupf
UpdateDatabaseTool ignores url-filters
Under some constraints the updatedatase-tool does not
check the url-filters. So the webdb can grow with
unwanted urls which can get part of the next fetchlist.
The patch below changes the process so that before
anything else the filters are checked. the unwanted
urls do not get part of the webdb anymore.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira
[jira] Updated: (NUTCH-2) UpdateDatabaseTool ignores url-filters
Posted by "Stefan Grroschupf (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/NUTCH-2?page=history ]
Stefan Grroschupf updated NUTCH-2:
----------------------------------
Attachment: updateDatabaseTool-regex.patch
by mijonebel
> UpdateDatabaseTool ignores url-filters
> --------------------------------------
>
> Key: NUTCH-2
> URL: http://issues.apache.org/jira/browse/NUTCH-2
> Project: Nutch
> Type: Bug
> Reporter: Stefan Grroschupf
> Attachments: updateDatabaseTool-regex.patch
>
> UpdateDatabaseTool ignores url-filters
> Under some constraints the updatedatase-tool does not
> check the url-filters. So the webdb can grow with
> unwanted urls which can get part of the next fetchlist.
> The patch below changes the process so that before
> anything else the filters are checked. the unwanted
> urls do not get part of the webdb anymore.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
If you want more information on JIRA, or have a bug to report see:
http://www.atlassian.com/software/jira
[jira] Closed: (NUTCH-2) UpdateDatabaseTool ignores url-filters
Posted by "Stefan Grroschupf (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/NUTCH-2?page=all ]
Stefan Grroschupf closed NUTCH-2:
---------------------------------
Resolution: Invalid
There is a new plugin based url filter functionality, so this patch is obsolete.
> UpdateDatabaseTool ignores url-filters
> --------------------------------------
>
> Key: NUTCH-2
> URL: http://issues.apache.org/jira/browse/NUTCH-2
> Project: Nutch
> Type: Bug
> Reporter: Stefan Grroschupf
> Attachments: updateDatabaseTool-regex.patch
>
> UpdateDatabaseTool ignores url-filters
> Under some constraints the updatedatase-tool does not
> check the url-filters. So the webdb can grow with
> unwanted urls which can get part of the next fetchlist.
> The patch below changes the process so that before
> anything else the filters are checked. the unwanted
> urls do not get part of the webdb anymore.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira