[jira] [Created] (SPARK-26386) [K8s] Add configuration for executor OwnerReference when running in client mode

["Nihar Sheth (JIRA)" <ji...@apache.org>]

Nihar Sheth created SPARK-26386:
-----------------------------------

             Summary: [K8s] Add configuration for executor OwnerReference when running in client mode
                 Key: SPARK-26386
                 URL: https://issues.apache.org/jira/browse/SPARK-26386
             Project: Spark
          Issue Type: Improvement
          Components: Kubernetes
    Affects Versions: 3.0.0
            Reporter: Nihar Sheth


When running in cluster mode, the executor pods have their owner references set to the driver pod, which should handle cleanup when the driver pod dies. In client mode, though, the driver is not always a pod, so there is no owner reference set at all. It would be useful to offer a configuration to support setting an executor's owner reference in client mode, for situations where we want the executors' lifecycles tied to another pod (for example, if there's a pod on the cluster that wants to run a Spark job in client mode on the same cluster, and we want to clean up the executors if the driver pod here dies).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org