You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@nutch.apache.org by Ned Rockson <nr...@stanford.edu> on 2007/10/08 05:55:36 UTC

Java.lang.OutOfMemoryError: Java Heap space

Hi, I've been running into trouble in the reduce phase of the updatedb
map/reduce.  I'm not sure what else I can do: I'm running 67 reduce
tasks and have given max heap space of 1024MB, but still there is at
least one reduce task that fails.  Is there anything else I can do to
get this thing to run?

This is an update on a crawldb of about 3.5 billion URLs.