You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Kürşat Kurt <ku...@kursatkurt.com> on 2017/05/19 13:58:23 UTC

java.lang.OutOfMemoryError

Hi;



I am trying multiclass text classification with Randomforest Classifier on
my local computer(16 GB RAM, 4 physical cores ).

When i run with the parameters below, i am getting
"java.lang.OutOfMemoryError: GC overhead limit exceeded" error.

 

spark-submit --driver-memory 1G --driver-memory 2G --executor-memory 1G
--total-executor-cores 8 project-assembly-1.0.

 

My train data has 400.000 line and future(unique word) size is ~50.000.