[jira] [Created] (SINGA-387) Modified the design of autograd backward engine and correct some mistakes in it

["Xue Wanqi (JIRA)" <ji...@apache.org>]

Xue Wanqi created SINGA-387:
-------------------------------

             Summary: Modified the design of autograd backward engine and correct some mistakes in it
                 Key: SINGA-387
                 URL: https://issues.apache.org/jira/browse/SINGA-387
             Project: Singa
          Issue Type: Improvement
            Reporter: Xue Wanqi


Old design of autograd engine will return intermediate gradients. We should avoid the happen of that. For the parameters(tensors) need to store gradients, they or their creator should know whether the gradients are calculated readily. and only when gradients are prepared then they can be output.

Old design of autograd engine will store some unused gradient in dictionary not_ready. this should be avoid as well in the new design.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)