You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Remzi Yang (Jira)" <ji...@apache.org> on 2025/05/21 09:06:00 UTC

[jira] [Created] (SPARK-52244) Preserve the driver log after deleting the sparkApp

Remzi Yang created SPARK-52244:
----------------------------------

             Summary: Preserve the driver log after deleting the sparkApp
                 Key: SPARK-52244
                 URL: https://issues.apache.org/jira/browse/SPARK-52244
             Project: Spark
          Issue Type: New Feature
          Components: Connect
    Affects Versions: kubernetes-operator-0.1.0
            Reporter: Remzi Yang


spark-kubernetes-operator now deletes the driver pod directly after calling `kubectl delete sparkApp xxx`. There is no way to check the driver log after the deletion. We'd like to preserve the driver log for checking later, which is especially usefully for a long-running spark app, like spark-connect. I am sure if the driver pod can be turned in Completed status after deleting for instance?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org