[GitHub] [spark] stijndehaes commented on pull request #37417: [SPARK-33782][K8S][CORE]Place spark.files, spark.jars and spark.files under the current working directory on the driver in K8S cluster mode

["stijndehaes (via GitHub)" <gi...@apache.org>]

stijndehaes commented on PR #37417:
URL: https://github.com/apache/spark/pull/37417#issuecomment-1558629449

   Maybe this is not the correct place to ask, but this PR had created some issues for our flow. Maybe our flow was not how things were intended to be used but it goes like this:
   We submit jobs on kubernetes by baking in the jar in the docker image, we copy the jar in the docker image on the workdir location.
   The result of this PR is that our jar is removed, because of the `Utils.deleteRecursively(dest)`.
   Now a quick fix is to copy the jar somewhere else, but if this sounds like unintended behavior to you guys, I am willing to open up a PR to fix it.
   I am however not sure what the intended behavior would be. Just remove this `Utils.deleteRecursively(dest)` sounds a bit too simple :) 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org