You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Dennis Kubes (JIRA)" <ji...@apache.org> on 2006/04/24 23:00:09 UTC
[jira] Created: (NUTCH-254) Fetcher throws NullPointer if redirect
URL is filtered
Fetcher throws NullPointer if redirect URL is filtered
------------------------------------------------------
Key: NUTCH-254
URL: http://issues.apache.org/jira/browse/NUTCH-254
Project: Nutch
Type: Bug
Components: fetcher
Versions: 0.8-dev
Environment: Tested on Windows XP Media Center 2005, 2Gigs RAM, 3.0 Ghz Pentium 4 Hyperthreaded. Should be on any platform.
Reporter: Dennis Kubes
Priority: Minor
Inside the Fetcher class if a redirect URL is filtered, for example jessionid pages are filtered with the default URL filter, then a NullPointerException is thrown when Fetcher trys to print out that the url was skipped for being an identical url. It is not an identical URL but a filtered url. So what we really need is two different checks. One for null url and one for identical url. I have included a patch that handles this.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Commented: (NUTCH-254) Fetcher throws NullPointer if
redirect URL is filtered
Posted by "Stefan Neufeind (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/NUTCH-254?page=comments#action_12412684 ]
Stefan Neufeind commented on NUTCH-254:
---------------------------------------
looks fine and applies fine for me - could this be merged in the dev-trunk?
> Fetcher throws NullPointer if redirect URL is filtered
> ------------------------------------------------------
>
> Key: NUTCH-254
> URL: http://issues.apache.org/jira/browse/NUTCH-254
> Project: Nutch
> Type: Bug
> Components: fetcher
> Versions: 0.8-dev
> Environment: Tested on Windows XP Media Center 2005, 2Gigs RAM, 3.0 Ghz Pentium 4 Hyperthreaded. Should be on any platform.
> Reporter: Dennis Kubes
> Priority: Minor
> Attachments: fetcher_filter_url_patch.txt
>
> Inside the Fetcher class if a redirect URL is filtered, for example jessionid pages are filtered with the default URL filter, then a NullPointerException is thrown when Fetcher trys to print out that the url was skipped for being an identical url. It is not an identical URL but a filtered url. So what we really need is two different checks. One for null url and one for identical url. I have included a patch that handles this.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Updated: (NUTCH-254) Fetcher throws NullPointer if redirect
URL is filtered
Posted by "Dennis Kubes (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/NUTCH-254?page=all ]
Dennis Kubes updated NUTCH-254:
-------------------------------
Attachment: fetcher_filter_url_patch.txt
patch to fix null pointer in fetcher for filtered urls
> Fetcher throws NullPointer if redirect URL is filtered
> ------------------------------------------------------
>
> Key: NUTCH-254
> URL: http://issues.apache.org/jira/browse/NUTCH-254
> Project: Nutch
> Type: Bug
> Components: fetcher
> Versions: 0.8-dev
> Environment: Tested on Windows XP Media Center 2005, 2Gigs RAM, 3.0 Ghz Pentium 4 Hyperthreaded. Should be on any platform.
> Reporter: Dennis Kubes
> Priority: Minor
> Attachments: fetcher_filter_url_patch.txt
>
> Inside the Fetcher class if a redirect URL is filtered, for example jessionid pages are filtered with the default URL filter, then a NullPointerException is thrown when Fetcher trys to print out that the url was skipped for being an identical url. It is not an identical URL but a filtered url. So what we really need is two different checks. One for null url and one for identical url. I have included a patch that handles this.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira
[jira] Closed: (NUTCH-254) Fetcher throws NullPointer if redirect
URL is filtered
Posted by "Andrzej Bialecki (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/NUTCH-254?page=all ]
Andrzej Bialecki closed NUTCH-254:
-----------------------------------
Resolution: Fixed
Fixed - actually there were two places which needed fixing, I also somewhat simplified the logic Thank you!
> Fetcher throws NullPointer if redirect URL is filtered
> ------------------------------------------------------
>
> Key: NUTCH-254
> URL: http://issues.apache.org/jira/browse/NUTCH-254
> Project: Nutch
> Type: Bug
> Components: fetcher
> Versions: 0.8-dev
> Environment: Tested on Windows XP Media Center 2005, 2Gigs RAM, 3.0 Ghz Pentium 4 Hyperthreaded. Should be on any platform.
> Reporter: Dennis Kubes
> Priority: Minor
> Attachments: fetcher_filter_url_patch.txt
>
> Inside the Fetcher class if a redirect URL is filtered, for example jessionid pages are filtered with the default URL filter, then a NullPointerException is thrown when Fetcher trys to print out that the url was skipped for being an identical url. It is not an identical URL but a filtered url. So what we really need is two different checks. One for null url and one for identical url. I have included a patch that handles this.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira