You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by va...@apache.org on 2017/11/10 00:42:39 UTC
spark git commit: [SPARK-22287][MESOS] SPARK_DAEMON_MEMORY not honored by MesosClusterD…
Repository: spark
Updated Branches:
refs/heads/master 64c989495 -> f5fe63f7b
[SPARK-22287][MESOS] SPARK_DAEMON_MEMORY not honored by MesosClusterD…
…ispatcher
## What changes were proposed in this pull request?
Allow JVM max heap size to be controlled for MesosClusterDispatcher via SPARK_DAEMON_MEMORY environment variable.
## How was this patch tested?
Tested on local Mesos cluster
Author: Paul Mackles <pm...@adobe.com>
Closes #19515 from pmackles/SPARK-22287.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f5fe63f7
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f5fe63f7
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f5fe63f7
Branch: refs/heads/master
Commit: f5fe63f7b8546b0102d7bfaf3dde77379f58a4d1
Parents: 64c9894
Author: Paul Mackles <pm...@adobe.com>
Authored: Thu Nov 9 16:42:33 2017 -0800
Committer: Marcelo Vanzin <va...@cloudera.com>
Committed: Thu Nov 9 16:42:33 2017 -0800
----------------------------------------------------------------------
.../java/org/apache/spark/launcher/SparkClassCommandBuilder.java | 1 +
1 file changed, 1 insertion(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/f5fe63f7/launcher/src/main/java/org/apache/spark/launcher/SparkClassCommandBuilder.java
----------------------------------------------------------------------
diff --git a/launcher/src/main/java/org/apache/spark/launcher/SparkClassCommandBuilder.java b/launcher/src/main/java/org/apache/spark/launcher/SparkClassCommandBuilder.java
index 32724ac..fd056bb 100644
--- a/launcher/src/main/java/org/apache/spark/launcher/SparkClassCommandBuilder.java
+++ b/launcher/src/main/java/org/apache/spark/launcher/SparkClassCommandBuilder.java
@@ -81,6 +81,7 @@ class SparkClassCommandBuilder extends AbstractCommandBuilder {
case "org.apache.spark.deploy.mesos.MesosClusterDispatcher":
javaOptsKeys.add("SPARK_DAEMON_JAVA_OPTS");
extraClassPath = getenv("SPARK_DAEMON_CLASSPATH");
+ memKey = "SPARK_DAEMON_MEMORY";
break;
case "org.apache.spark.deploy.ExternalShuffleService":
case "org.apache.spark.deploy.mesos.MesosExternalShuffleService":
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org