You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@nutch.apache.org by Fuad Efendi <fu...@efendi.ca> on 2005/08/31 07:47:27 UTC

Out of Memory?! 1300Mb!!!

050831 013858 Processing linksByMD5: Sorted 129724.11655300682
instructions/second
050831 013904 Processing linksByMD5: Merged to new DB containing 186911
records in 5.508 seconds
050831 013904 Processing linksByMD5: Merged 33934.45896877269
records/second
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space

It happens when I try to execute UpdateDatabaseTool!!! I am using
lucene/nutch/trunk/, two days old, Nutch 0.7, with 871kb of FetchList
(data). I am using -Xms1300M -Xmx1300M, so, for sure, my PC has at least
1300Mb before starting UpdateDatabaseTool. It has total 2Gb. I am
crawling single site only...

Thanks,
Fuad