[spark] branch branch-3.1 updated: Revert "[SPARK-34674][CORE][K8S] Close SparkContext after the Main method has finished"

[do...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.1
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.1 by this push:
     new 44ee132  Revert "[SPARK-34674][CORE][K8S] Close SparkContext after the Main method has finished"
44ee132 is described below

commit 44ee13271cf8698df268c73a4fa7fd51c562949f
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Thu Apr 8 21:56:29 2021 -0700

    Revert "[SPARK-34674][CORE][K8S] Close SparkContext after the Main method has finished"
    
    This reverts commit c625eb4f9f970108d93bf3342c7ccb7ec873dc27.
---
 core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala | 6 ------
 1 file changed, 6 deletions(-)

diff --git a/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala b/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
index 17950d6..bb3a20d 100644
--- a/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
+++ b/core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
@@ -952,12 +952,6 @@ private[spark] class SparkSubmit extends Logging {
     } catch {
       case t: Throwable =>
         throw findCause(t)
-    } finally {
-      try {
-        SparkContext.getActive.foreach(_.stop())
-      } catch {
-        case e: Throwable => logError(s"Failed to close SparkContext: $e")
-      }
     }
   }
 

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org