You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Zhan Zhang (JIRA)" <ji...@apache.org> on 2017/07/20 21:35:00 UTC

[jira] [Created] (SPARK-21492) Memory leak in SortMergeJoin

Zhan Zhang created SPARK-21492:
----------------------------------

             Summary: Memory leak in SortMergeJoin
                 Key: SPARK-21492
                 URL: https://issues.apache.org/jira/browse/SPARK-21492
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.0.0
            Reporter: Zhan Zhang


In SortMergeJoin, if the iterator is not exhausted, there will be memory leak caused by the Sort. The memory is not released until the task end, and cannot be used by other operators causing performance drop or OOM.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org