You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sudhakar Thota (JIRA)" <ji...@apache.org> on 2016/07/07 19:53:11 UTC
[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases
until gets killed by OS.
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sudhakar Thota updated SPARK-16083:
-----------------------------------
Attachment: (was: spark-spark-org.apache.spark.deploy.history.HistoryServer-1-testbic1on5l.out.4)
> spark HistoryServer memory increases until gets killed by OS.
> -------------------------------------------------------------
>
> Key: SPARK-16083
> URL: https://issues.apache.org/jira/browse/SPARK-16083
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 1.5.1
> Environment: RHEL-6, IOP-4.1.0.0, 10 node cluster
> Reporter: Sudhakar Thota
> Attachments: 27814004000_spark_heap_2016-06-17_12-05.hprof.gz
>
>
> Spark HistoryServer process consuming memory over few days finally getting killed by operating system. Heapdump analysis of jmap dumps with IBM HeapAnalyzer, found that total heap size is 800M and process size is 11G. HistoryServer is started with 1G. ("history-server -Xms1g -Xmx1g org.apache.spark.deploy.history.HistoryServer")
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org