Re: [PR] [SPARK-46912] Use worker JAVA_HOME and SPARK_HOME instead of from submitter [spark]

["jywjyw (via GitHub)" <gi...@apache.org>]

jywjyw commented on PR #44943:
URL: https://github.com/apache/spark/pull/44943#issuecomment-2521913105

   It's a bug. Try this command on machine A:
   ```
   bin/spark-submit --master spark://{REMOTE}:7077 --deploy-mode cluster  --class org.apache.spark.examples.SparkPi  file:///opt/spark/examples/jars/spark-examples_2.12-3.5.3.jar 
   ```
   it will submit application to standalone cluster(important: deploy-mode=cluster), then error occurs:
   ```
   Exception from cluster was: java.io.IOException: Cannot run program "/usr/java/default//bin/java" (in directory "/opt/bitnami/spark/work/driver-20241206013526-0001"): error=2, No such file or directory
   ```
   Because the worker node searched java from "/usr/java/default//bin/java", but "/usr/java/default//bin/java" is machine A's java path, not worker's java path


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org