You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by Tom Davidson <td...@covario.com> on 2011/08/02 23:46:57 UTC

Getting this exception when running Nutch2 updatedb after fetch

java.lang.ArrayIndexOutOfBoundsException: 0
        at org.apache.nutch.util.TableUtil.reverseAppendSplits(TableUtil.java:126)
        at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:66)
        at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:43)
        at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:70)
        at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:36)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.Child.main(Child.java:264)


It looks like TableUtil.reverseAppendSplits is not well behaved for malformed urls?

Re: Getting this exception when running Nutch2 updatedb after fetch

Posted by Julien Nioche <li...@gmail.com>.
Tom,

Please file a JIRA and tag it with version 2.0, it will  be easier to track
than emails.

Thanks

Julien

On 2 August 2011 22:46, Tom Davidson <td...@covario.com> wrote:

>  java.lang.ArrayIndexOutOfBoundsException: 0****
>
>         at
> org.apache.nutch.util.TableUtil.reverseAppendSplits(TableUtil.java:126)***
> *
>
>         at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:66)**
> **
>
>         at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:43)**
> **
>
>         at
> org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:70)****
>
>         at
> org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:36)****
>
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)****
>
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
> ****
>
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)****
>
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)****
>
>         at java.security.AccessController.doPrivileged(Native Method)****
>
>         at javax.security.auth.Subject.doAs(Subject.java:396)****
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
> ****
>
>         at org.apache.hadoop.mapred.Child.main(Child.java:264)****
>
> ** **
>
> ** **
>
> It looks like TableUtil.reverseAppendSplits is not well behaved for
> malformed urls? ****
>



-- 
*
*Open Source Solutions for Text Engineering

http://digitalpebble.blogspot.com/
http://www.digitalpebble.com