You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Nan Zhu <zh...@gmail.com> on 2014/07/21 20:46:36 UTC

spark.executor.memory is not applicable when running unit test in Jenkins?

Hi, all  

I’m running some unit tests for my Spark applications in Jenkins

it seems that even I set spark.executor.memory to 5g, the value I got with Runtime.getRuntime.maxMemory is still around 1G

Is it saying that Jenkins limit the process to use no more than 1G (by default)? how to change that?

Thanks,


--  
Nan Zhu