You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Lantao Jin (Jira)" <ji...@apache.org> on 2019/11/20 14:11:00 UTC

[jira] [Created] (SPARK-29972) Manage/trace all spark sessions

Lantao Jin created SPARK-29972:
----------------------------------

             Summary: Manage/trace all spark sessions
                 Key: SPARK-29972
                 URL: https://issues.apache.org/jira/browse/SPARK-29972
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Lantao Jin


Current there is no place to trace all live spark sessions in a non-thrift-server application. For example spark session can be stored in thread local variable and be garbage collection when user's thread exit. So it may has some problems like memory leak in an application. Also, seems we don't have such an action called "close session" in Spark SQL. SparkSession.close closes the SparkContext and thus closes all sessions.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org