You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "DHKold (via GitHub)" <gi...@apache.org> on 2023/03/28 12:45:18 UTC

[GitHub] [spark] DHKold commented on pull request #40491: [SPARK-41006][K8S] Generate new ConfigMap names for each run

DHKold commented on PR #40491:
URL: https://github.com/apache/spark/pull/40491#issuecomment-1486822133

   Hi, thanks for looking at it.
   Our use case: we have an application which is using the `InProcessLauncher` class several times (to launch multiple spark jobs).
   The first one is launched correctly but the next ones fail, trying to use the same configMaps created for the previous job.
   
   I think the call chain is `InProcessLauncher` -> `InProcessSparkSubmit` -> `SparkSubmit` -> `KubernetesClientApplication` -> [Client](https://github.com/apache/spark/blob/ba1badd2adfd175c6680dff90e14b8aaa6cecd78/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/KubernetesClientApplication.scala#L105) -> `KubernetesClientUtils`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org