You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/12/15 22:02:00 UTC
[jira] [Resolved] (SPARK-22256) Introduce
spark.mesos.driver.memoryOverhead
[ https://issues.apache.org/jira/browse/SPARK-22256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun resolved SPARK-22256.
-----------------------------------
Fix Version/s: 3.2.0
Resolution: Fixed
Issue resolved by pull request 30739
[https://github.com/apache/spark/pull/30739]
> Introduce spark.mesos.driver.memoryOverhead
> --------------------------------------------
>
> Key: SPARK-22256
> URL: https://issues.apache.org/jira/browse/SPARK-22256
> Project: Spark
> Issue Type: Improvement
> Components: Mesos
> Affects Versions: 2.2.0, 2.3.0
> Reporter: Cosmin Lehene
> Assignee: David McWhorter
> Priority: Minor
> Labels: releasenotes
> Fix For: 3.2.0
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> When running spark driver in a container such as when using the Mesos dispatcher service, we need to apply the same rules as for executors in order to avoid the JVM going over the allotted limit and then killed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org