You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "ObobjXin (Jira)" <ji...@apache.org> on 2022/07/15 06:12:00 UTC
[jira] [Updated] (SPARK-39791) In Spark 3.0 standalone cluster mode, unable to customize driver JVM path
[ https://issues.apache.org/jira/browse/SPARK-39791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ObobjXin updated SPARK-39791:
-----------------------------
Description:
In Spark 3.0 standalone mode, unable to customize driver JVM path, instead the JAVA_HOME of the spark-submit submission machine is used, but the JVM paths of my submission machine and the cluster machine are different
{code:java}
launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java
List<String> buildJavaCommand(String extraClassPath) throws IOException {
List<String> cmd = new ArrayList<>();
String firstJavaHome = firstNonEmpty(javaHome,
childEnv.get("JAVA_HOME"),
System.getenv("JAVA_HOME"),
System.getProperty("java.home")); {code}
was:
In Spark 3.0 standalone mode, unable to customize driver JVM path, instead the JAVA_HOME of the spark-submit submission machine is used, but the JVM paths of my submission machine and the cluster machine are different
{code:java}
List<String> buildJavaCommand(String extraClassPath) throws IOException {
List<String> cmd = new ArrayList<>();
String firstJavaHome = firstNonEmpty(javaHome,
childEnv.get("JAVA_HOME"),
System.getenv("JAVA_HOME"),
System.getProperty("java.home")); {code}
> In Spark 3.0 standalone cluster mode, unable to customize driver JVM path
> -------------------------------------------------------------------------
>
> Key: SPARK-39791
> URL: https://issues.apache.org/jira/browse/SPARK-39791
> Project: Spark
> Issue Type: Question
> Components: Spark Submit
> Affects Versions: 3.0.0
> Reporter: ObobjXin
> Priority: Minor
> Labels: spark-submit, standalone
> Original Estimate: 0.5h
> Remaining Estimate: 0.5h
>
> In Spark 3.0 standalone mode, unable to customize driver JVM path, instead the JAVA_HOME of the spark-submit submission machine is used, but the JVM paths of my submission machine and the cluster machine are different
> {code:java}
> launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java
> List<String> buildJavaCommand(String extraClassPath) throws IOException {
> List<String> cmd = new ArrayList<>();
> String firstJavaHome = firstNonEmpty(javaHome,
> childEnv.get("JAVA_HOME"),
> System.getenv("JAVA_HOME"),
> System.getProperty("java.home")); {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org