You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Łukasz Pińkowski (Jira)" <ji...@apache.org> on 2019/08/27 05:44:00 UTC

[jira] [Created] (SPARK-28882) Memory leak when stopping spark session

Łukasz Pińkowski created SPARK-28882:
----------------------------------------

             Summary: Memory leak when stopping spark session
                 Key: SPARK-28882
                 URL: https://issues.apache.org/jira/browse/SPARK-28882
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.4.3
            Reporter: Łukasz Pińkowski


When calling stop() method on spark session underlying SparkContext is being stopped.

It causes also stop of underlying ContextCleaner thread, usually before it is able to clean all context objects (not all of them are returned to ReferenceQueue by GC). It causes memory leak because this ReferenceQueue is never collected by GC.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org