You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "CacheCheck (Jira)" <ji...@apache.org> on 2020/03/22 15:05:00 UTC

[jira] [Created] (SPARK-31216) RDDs in GradientBoostedTress can be unpersisted earlier for saving memory

CacheCheck created SPARK-31216:
----------------------------------

             Summary: RDDs in GradientBoostedTress can be unpersisted earlier for saving memory
                 Key: SPARK-31216
                 URL: https://issues.apache.org/jira/browse/SPARK-31216
             Project: Spark
          Issue Type: Improvement
          Components: ML, MLlib
    Affects Versions: 2.4.5
            Reporter: CacheCheck


In ml.tree.impl.GradientBoostedTrees.boost(), _predErrorCheckpointer_ and _input_ are unpersisted at last. Actually, they can be unpersisted before the if(validate) block, so it can save memory for the computation in if block.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org