You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Mike Baranczak (JIRA)" <ji...@apache.org> on 2009/12/29 23:31:30 UTC

[jira] Updated: (NUTCH-755) DomainURLFilter crashes on malformed URL

     [ https://issues.apache.org/jira/browse/NUTCH-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mike Baranczak updated NUTCH-755:
---------------------------------

    Attachment: DomainURLFilter.java

> DomainURLFilter crashes on malformed URL
> ----------------------------------------
>
>                 Key: NUTCH-755
>                 URL: https://issues.apache.org/jira/browse/NUTCH-755
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher
>    Affects Versions: 1.0.0
>         Environment: Tomcat 6.0.14
> Java 1.6.0_14
> Linux
>            Reporter: Mike Baranczak
>            Assignee: Andrzej Bialecki 
>         Attachments: DomainURLFilter.java
>
>
> 2009-09-16 21:54:17,001 ERROR [Thread-156] DomainURLFilter - Could not apply filter on url: http:/comments.php
> java.lang.NullPointerException
>         at org.apache.nutch.urlfilter.domain.DomainURLFilter.filter(DomainURLFilter.java:173)
>         at org.apache.nutch.net.URLFilters.filter(URLFilters.java:88)
>         at org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:200)
>         at org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:113)
>         at org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:96)
>         at org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:70)
>         at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:410)
>         at org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:436)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:170)
> Expected behavior would be to recognize the URL as malformed, and reject it.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Re: [jira] Updated: (NUTCH-755) DomainURLFilter crashes on malformed URL

Posted by Futebol DotInfo <fu...@yahoo.com>.
unsubscribe

--- On Tue, 12/29/09, Mike Baranczak (JIRA) <ji...@apache.org> wrote:

From: Mike Baranczak (JIRA) <ji...@apache.org>
Subject: [jira] Updated: (NUTCH-755) DomainURLFilter crashes on malformed URL
To: nutch-dev@lucene.apache.org
Date: Tuesday, December 29, 2009, 2:31 PM


     [ https://issues.apache.org/jira/browse/NUTCH-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mike Baranczak updated NUTCH-755:
---------------------------------

    Attachment: DomainURLFilter.java

> DomainURLFilter crashes on malformed URL
> ----------------------------------------
>
>                 Key: NUTCH-755
>                 URL: https://issues.apache.org/jira/browse/NUTCH-755
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher
>    Affects Versions: 1.0.0
>         Environment: Tomcat 6.0.14
> Java 1.6.0_14
> Linux
>            Reporter: Mike Baranczak
>            Assignee: Andrzej Bialecki 
>         Attachments: DomainURLFilter.java
>
>
> 2009-09-16 21:54:17,001 ERROR [Thread-156] DomainURLFilter - Could not apply filter on url: http:/comments.php
> java.lang.NullPointerException
>         at org.apache.nutch.urlfilter.domain.DomainURLFilter.filter(DomainURLFilter.java:173)
>         at org.apache.nutch.net.URLFilters.filter(URLFilters.java:88)
>         at org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:200)
>         at org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:113)
>         at org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:96)
>         at org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:70)
>         at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:410)
>         at org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:436)
>         at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:170)
> Expected behavior would be to recognize the URL as malformed, and reject it.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.