You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andrew Or (JIRA)" <ji...@apache.org> on 2014/08/08 04:51:12 UTC
[jira] [Created] (SPARK-2921) Mesos doesn't handle
spark.executor.extraJavaOptions correctly (among other things)
Andrew Or created SPARK-2921:
--------------------------------
Summary: Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)
Key: SPARK-2921
URL: https://issues.apache.org/jira/browse/SPARK-2921
Project: Spark
Issue Type: Bug
Components: Mesos
Affects Versions: 1.0.2
Reporter: Andrew Or
Priority: Critical
Fix For: 1.1.0
The code path to handle this exists only for the coarse grained mode, and even in this mode the java options aren't passed to the executors properly. We currently pass the entire value of spark.executor.extraJavaOptions to the executors as a string without splitting it. We need to use Utils.splitCommandString as in standalone mode.
I have not confirmed this, but I would assume spark.executor.extraClassPath and spark.executor.extraLibraryPath are also not propagated correctly in either mode.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org