You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Nihar Sheth (JIRA)" <ji...@apache.org> on 2018/12/17 19:18:00 UTC
[jira] [Commented] (SPARK-26386) [K8s] Add configuration for
executor OwnerReference when running in client mode
[ https://issues.apache.org/jira/browse/SPARK-26386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723281#comment-16723281 ]
Nihar Sheth commented on SPARK-26386:
-------------------------------------
I'll be working on this
> [K8s] Add configuration for executor OwnerReference when running in client mode
> -------------------------------------------------------------------------------
>
> Key: SPARK-26386
> URL: https://issues.apache.org/jira/browse/SPARK-26386
> Project: Spark
> Issue Type: Improvement
> Components: Kubernetes
> Affects Versions: 3.0.0
> Reporter: Nihar Sheth
> Priority: Major
>
> When running in cluster mode, the executor pods have their owner references set to the driver pod, which should handle cleanup when the driver pod dies. In client mode, though, the driver is not always a pod, so there is no owner reference set at all. It would be useful to offer a configuration to support setting an executor's owner reference in client mode, for situations where we want the executors' lifecycles tied to another pod (for example, if there's a pod on the cluster that wants to run a Spark job in client mode on the same cluster, and we want to clean up the executors if the driver pod here dies).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org