You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@singa.apache.org by "wangwei (JIRA)" <ji...@apache.org> on 2017/05/21 15:24:04 UTC

[jira] [Created] (SINGA-315) Reduce memory footprint by Python generator for parameter gradient

wangwei created SINGA-315:
-----------------------------

             Summary: Reduce memory footprint by Python generator for parameter gradient
                 Key: SINGA-315
                 URL: https://issues.apache.org/jira/browse/SINGA-315
             Project: Singa
          Issue Type: New Feature
            Reporter: wangwei


The parameter gradient tensors are stored in memory until BP is finished.
This is not necessary as we can update the parameter once its gradient is ready. Then we free the gradient tensor. 
In this way, we reduce the memory footprint by avoiding store all gradient tensors.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)