You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Suneel Marthi (JIRA)" <ji...@apache.org> on 2015/11/07 00:16:11 UTC

[jira] [Updated] (MAHOUT-1766) Increase default PermGen size for spark-shell

     [ https://issues.apache.org/jira/browse/MAHOUT-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Suneel Marthi updated MAHOUT-1766:
----------------------------------
    Fix Version/s: 0.12.0

> Increase default PermGen size for spark-shell
> ---------------------------------------------
>
>                 Key: MAHOUT-1766
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1766
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Mahout spark shell
>            Reporter: Sergey Tryuber
>             Fix For: 0.12.0
>
>
> Mahout spark-shell is run with default perm gen size (64MB). Taking into account that it depends on lots of external jars and the whole count of used Java classes is very large, we constantly observe spontaneous corresponding OOM exceptions.
> A hot fix from our side is to modify envelope bash script (added -XX:PermSize=512m):
> {code}
> "$JAVA" $JAVA_HEAP_MAX -XX:PermSize=512m $MAHOUT_OPTS -classpath "$CLASSPATH" "org.apache.mahout.sparkbindings.shell.Main" $@
> {code}
> Of course, more elegant solution is needed. After the applied fix, the errors had gone.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)