[jira] [Created] (SPARK-24003) Add support to provide spark.executor.extraJavaOptions in terms of App Id and/or Executor Id's

["Devaraj K (JIRA)" <ji...@apache.org>]

Devaraj K created SPARK-24003:
---------------------------------

             Summary: Add support to provide spark.executor.extraJavaOptions in terms of App Id and/or Executor Id's
                 Key: SPARK-24003
                 URL: https://issues.apache.org/jira/browse/SPARK-24003
             Project: Spark
          Issue Type: Improvement
          Components: Mesos, Spark Core, YARN
    Affects Versions: 2.3.0
            Reporter: Devaraj K


Users may want to enable gc logging or heap dump for the executors, but there is a chance of overwriting it by other executors since the paths cannot be expressed dynamically. This improvement would enable to express the spark.executor.extraJavaOptions paths in terms of App Id and Executor Id's to avoid the overwriting by other executors.

There was a discussion about this in SPARK-3767, but it never fixed.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org