You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Davis Shepherd (JIRA)" <ji...@apache.org> on 2014/04/07 18:02:16 UTC

[jira] [Created] (SPARK-1432) Potential memory leak in stageIdToExecutorSummaries in JobProgressTracker

Davis Shepherd created SPARK-1432:
-------------------------------------

             Summary: Potential memory leak in stageIdToExecutorSummaries in JobProgressTracker
                 Key: SPARK-1432
                 URL: https://issues.apache.org/jira/browse/SPARK-1432
             Project: Spark
          Issue Type: Bug
          Components: Web UI
    Affects Versions: 0.9.0
            Reporter: Davis Shepherd


JobProgressTracker continuously cleans up old metadata as per the spark.ui.retainedStages configuration parameter. It seems however that not all metadata maps are being cleaned, in particular stageIdToExecutorSummaries could grow in an unbounded manner in a long running application.



--
This message was sent by Atlassian JIRA
(v6.2#6252)