You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Soumasish Goswami (Jira)" <ji...@apache.org> on 2024/11/23 15:03:00 UTC
[jira] [Commented] (SPARK-50240) Command Execution in JavaOptions
[ https://issues.apache.org/jira/browse/SPARK-50240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17900590#comment-17900590 ]
Soumasish Goswami commented on SPARK-50240:
-------------------------------------------
[~srowen] Will you be able to review the PR when you get a moment.
> Command Execution in JavaOptions
> --------------------------------
>
> Key: SPARK-50240
> URL: https://issues.apache.org/jira/browse/SPARK-50240
> Project: Spark
> Issue Type: Improvement
> Components: Spark Submit
> Affects Versions: 3.5.1
> Reporter: Xiaotong
> Priority: Major
> Labels: pull-request-available
>
> We found that Spark allow user to upload jar packet with`extraJavaOptions` ,
>
> When instantiating a JAR package, use the javaOption configuration construct to execute the command if you configure the advanced optional parameters:
> {color:#808080}spark.executor.extraJavaOption:{color}
> {code:java}
> \'touch\$IFS/tmp/zzz123|'{code}
> The instance executes the jar package, uses the Yarn mode, and injects 'touch /tmp/zzz123' into the bash -c execution command.
> Command as:
> {code:java}
> spark-submit --class JavaWordCount --master yarn --deploy-mode client --conf spark.executor.extraJavaOptions="\`touch\$IFS/tmp/zzz123\`" test.jar {code}
> for java:
> {code:java}
> sparkLauncher.setConf("spark.executor.extraJavaOptions", "`touch$IFS/tmp/zzz123`"); {code}
> Spark execution location:
> /yarn/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnable.scala
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org