You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by Wojciech Langiewicz <wl...@gmail.com> on 2011/03/17 10:28:48 UTC

java.lang.OutOfMemoryError when running wikipedia example

Hello,
I'm trying to test classifier for wikipedia example, and I get 
OutOfMemoryError, where can I change setting that will set memory limit 
higher? Is it the same as hadoop child memory limit?

Complete error:
11/03/17 10:19:24 INFO io.SequenceFileModelReader: Read 7150000 feature 
weights
11/03/17 10:19:25 INFO io.SequenceFileModelReader: Read 7200000 feature 
weights
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
	at 
org.apache.mahout.math.map.OpenIntDoubleHashMap.rehash(OpenIntDoubleHashMap.java:434)
	at 
org.apache.mahout.math.map.OpenIntDoubleHashMap.put(OpenIntDoubleHashMap.java:387)
	at 
org.apache.mahout.classifier.bayes.datastore.InMemoryBayesDatastore.setSumFeatureWeight(InMemoryBayesDatastore.java:166)
	at 
org.apache.mahout.classifier.bayes.io.SequenceFileModelReader.loadFeatureWeights(SequenceFileModelReader.java:102)
	at 
org.apache.mahout.classifier.bayes.io.SequenceFileModelReader.loadModel(SequenceFileModelReader.java:52)
	at 
org.apache.mahout.classifier.bayes.datastore.InMemoryBayesDatastore.initialize(InMemoryBayesDatastore.java:81)
	at 
org.apache.mahout.classifier.bayes.model.ClassifierContext.initialize(ClassifierContext.java:47)
	at 
org.apache.mahout.classifier.bayes.TestClassifier.classifySequential(TestClassifier.java:239)
	at 
org.apache.mahout.classifier.bayes.TestClassifier.main(TestClassifier.java:186)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at 
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
	at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
	at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:183)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:186)

Thanks for help.
--
Wojciech Langiewicz