[jira] [Resolved] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

["Xiangrui Meng (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiangrui Meng resolved SPARK-17822.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: 2.2.0
                   2.1.1

Issue resolved by pull request 16154
[https://github.com/apache/spark/pull/16154]

> JVMObjectTracker.objMap may leak JVM objects
> --------------------------------------------
>
>                 Key: SPARK-17822
>                 URL: https://issues.apache.org/jira/browse/SPARK-17822
>             Project: Spark
>          Issue Type: Bug
>          Components: SparkR
>            Reporter: Yin Huai
>            Assignee: Xiangrui Meng
>             Fix For: 2.1.1, 2.2.0
>
>         Attachments: screenshot-1.png
>
>
> JVMObjectTracker.objMap is used to track JVM objects for SparkR. However, we observed that JVM objects that are not used anymore are still trapped in this map, which prevents those object get GCed. 
> Seems it makes sense to use weak reference (like persistentRdds in SparkContext). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org