You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by "Sebastian Nagel (JIRA)" <ji...@apache.org> on 2018/04/26 10:58:00 UTC

[jira] [Resolved] (NUTCH-2544) Nutch 1.15 no longer compatible with AWS EMR and S3

     [ https://issues.apache.org/jira/browse/NUTCH-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sebastian Nagel resolved NUTCH-2544.
------------------------------------
    Resolution: Fixed

Thanks, [~sjwoodard]! I had no time to finally test the solution on EMR but hope to do so next week as soon all known issues related to the upgrade of the MapReduce API are fixed.

> Nutch 1.15 no longer compatible with AWS EMR and S3
> ---------------------------------------------------
>
>                 Key: NUTCH-2544
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2544
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher, generator
>    Affects Versions: 1.15
>            Reporter: Steven W
>            Assignee: Sebastian Nagel
>            Priority: Critical
>             Fix For: 1.15
>
>
> Nutch 1.14 is working OK with AWS EMR and S3 storage, but NUTCH-2375 appears to have broken this.
> Generator partitioning fails with Error: java.lang.NullPointerException at org.apache.nutch.crawl.URLPartitioner.getPartition(URLPartitioner.java:75)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)