You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Andrew Or (JIRA)" <ji...@apache.org> on 2014/08/08 04:51:12 UTC

[jira] [Created] (SPARK-2921) Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)

Andrew Or created SPARK-2921:
--------------------------------

             Summary: Mesos doesn't handle spark.executor.extraJavaOptions correctly (among other things)
                 Key: SPARK-2921
                 URL: https://issues.apache.org/jira/browse/SPARK-2921
             Project: Spark
          Issue Type: Bug
          Components: Mesos
    Affects Versions: 1.0.2
            Reporter: Andrew Or
            Priority: Critical
             Fix For: 1.1.0


The code path to handle this exists only for the coarse grained mode, and even in this mode the java options aren't passed to the executors properly. We currently pass the entire value of spark.executor.extraJavaOptions to the executors as a string without splitting it. We need to use Utils.splitCommandString as in standalone mode.

I have not confirmed this, but I would assume spark.executor.extraClassPath and spark.executor.extraLibraryPath are also not propagated correctly in either mode.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org