You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "Tom Davidson (JIRA)" <ji...@apache.org> on 2011/08/09 19:19:27 UTC

[jira] [Created] (NUTCH-1077) Nutch 2 DbUpdateMapper throws ArrayOutOfBoundsException when running update

Nutch 2 DbUpdateMapper throws ArrayOutOfBoundsException when running update
---------------------------------------------------------------------------

                 Key: NUTCH-1077
                 URL: https://issues.apache.org/jira/browse/NUTCH-1077
             Project: Nutch
          Issue Type: Bug
          Components: fetcher
    Affects Versions: 2.0
         Environment: CentOS 5 Linux with CDH3 Hadoop.
            Reporter: Tom Davidson


I got this error when running a simple nutch update after doing  a small fetch and parse.


java.lang.ArrayIndexOutOfBoundsException: 0
        at org.apache.nutch.util.TableUtil.reverseAppendSplits(TableUtil.java:126)
        at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:66)
        at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:43)
        at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:70)
        at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:36)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.Child.main(Child.java:264)


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Closed] (NUTCH-1077) Nutch 2 DbUpdateMapper throws ArrayOutOfBoundsException when running update

Posted by "Ferdy Galema (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ferdy Galema closed NUTCH-1077.
-------------------------------

       Resolution: Duplicate
    Fix Version/s:     (was: 2.1)

Will be fixed with NUTCH-1362. (Use attached patch or wait for commit.)

Thanks for reporting.
                
> Nutch 2 DbUpdateMapper throws ArrayOutOfBoundsException when running update
> ---------------------------------------------------------------------------
>
>                 Key: NUTCH-1077
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1077
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher
>    Affects Versions: nutchgora
>         Environment: CentOS 5 Linux with CDH3 Hadoop.
>            Reporter: Tom Davidson
>
> I got this error when running a simple nutch update after doing  a small fetch and parse.
> java.lang.ArrayIndexOutOfBoundsException: 0
>         at org.apache.nutch.util.TableUtil.reverseAppendSplits(TableUtil.java:126)
>         at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:66)
>         at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:43)
>         at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:70)
>         at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:36)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
>         at org.apache.hadoop.mapred.Child.main(Child.java:264)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (NUTCH-1077) Nutch 2 DbUpdateMapper throws ArrayOutOfBoundsException when running update

Posted by "Lewis John McGibbney (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/NUTCH-1077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lewis John McGibbney updated NUTCH-1077:
----------------------------------------

    Fix Version/s: 2.1
    
> Nutch 2 DbUpdateMapper throws ArrayOutOfBoundsException when running update
> ---------------------------------------------------------------------------
>
>                 Key: NUTCH-1077
>                 URL: https://issues.apache.org/jira/browse/NUTCH-1077
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher
>    Affects Versions: nutchgora
>         Environment: CentOS 5 Linux with CDH3 Hadoop.
>            Reporter: Tom Davidson
>             Fix For: 2.1
>
>
> I got this error when running a simple nutch update after doing  a small fetch and parse.
> java.lang.ArrayIndexOutOfBoundsException: 0
>         at org.apache.nutch.util.TableUtil.reverseAppendSplits(TableUtil.java:126)
>         at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:66)
>         at org.apache.nutch.util.TableUtil.reverseUrl(TableUtil.java:43)
>         at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:70)
>         at org.apache.nutch.crawl.DbUpdateMapper.map(DbUpdateMapper.java:36)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
>         at org.apache.hadoop.mapred.Child.main(Child.java:264)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira