[jira] [Commented] (NUTCH-2544) Nutch 1.15 no longer compatible with AWS EMR and S3

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NUTCH-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16447130#comment-16447130 ] 

ASF GitHub Bot commented on NUTCH-2544:
---------------------------------------

sebastian-nagel opened a new pull request #320: NUTCH-2544 Nutch 1.15 no longer compatible with AWS EMR and S3
URL: https://github.com/apache/nutch/pull/320
 
 
   - use CrawlDb path to get filesystem
   - fix Fetcher and SitemapProcessor

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Nutch 1.15 no longer compatible with AWS EMR and S3
> ---------------------------------------------------
>
>                 Key: NUTCH-2544
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2544
>             Project: Nutch
>          Issue Type: Bug
>          Components: fetcher, generator
>    Affects Versions: 1.15
>            Reporter: Steven W
>            Priority: Critical
>             Fix For: 1.15
>
>
> Nutch 1.14 is working OK with AWS EMR and S3 storage, but NUTCH-2375 appears to have broken this.
> Generator partitioning fails with Error: java.lang.NullPointerException at org.apache.nutch.crawl.URLPartitioner.getPartition(URLPartitioner.java:75)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)