You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "KarlManong (Jira)" <ji...@apache.org> on 2021/04/12 05:37:00 UTC
[jira] [Comment Edited] (SPARK-35000) Spark App in container will
not exit when exception happen
[ https://issues.apache.org/jira/browse/SPARK-35000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17319031#comment-17319031 ]
KarlManong edited comment on SPARK-35000 at 4/12/21, 5:36 AM:
--------------------------------------------------------------
Got Exception when org.apache.spark.scheduler.cluster.k8s.KubernetesClusterManager#createSchedulerBackend.
https://issues.apache.org/jira/browse/SPARK-34674 is reverted, so I haven't check it.
was (Author: karlmanong):
[#https://issues.apache.org/jira/browse/SPARK-35000?focusedCommentId=17317622&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17317622]
Got Exception when org.apache.spark.scheduler.cluster.k8s.KubernetesClusterManager#createSchedulerBackend.
https://issues.apache.org/jira/browse/SPARK-34674 is reverted, so I haven't check it.
> Spark App in container will not exit when exception happen
> ----------------------------------------------------------
>
> Key: SPARK-35000
> URL: https://issues.apache.org/jira/browse/SPARK-35000
> Project: Spark
> Issue Type: Bug
> Components: Kubernetes, Spark Submit
> Affects Versions: 3.1.1
> Reporter: KarlManong
> Priority: Major
> Attachments: 21664.stack, screenshot-1.png
>
>
> when submitting an app on k8s, someone can using an unauthed account to submit, and exception happened. But the app will not exit until 5 minutes later.
> the log:
> !screenshot-1.png!
> the trace:
> [^21664.stack]
> I have create a PR: https://github.com/apache/spark/pull/32101. Maybe help
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org