You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@singa.apache.org by "wangwei (JIRA)" <ji...@apache.org> on 2016/01/11 15:20:39 UTC

[jira] [Created] (SINGA-129) Add new SGD updaters

wangwei created SINGA-129:
-----------------------------

             Summary: Add new SGD updaters
                 Key: SINGA-129
                 URL: https://issues.apache.org/jira/browse/SINGA-129
             Project: Singa
          Issue Type: New Feature
            Reporter: wangwei
            Assignee: Jinyang Gao


Currently, some basic SGD updaters  have been implemented in SINGA, including, SGDUpdater AdaGradUpdater and NesterovUpdater.
RMSPropUpdater will be added in SINGA-123.

This ticket is going to implement some other common updaters, e.g., AdaDelata (http://arxiv.org/abs/1212.5701), Adam (http://arxiv.org/pdf/1412.6980.pdf) . 
ActiveSampler (http://arxiv.org/abs/1512.03880) could be implemented together with this ticket or using a new ticket.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)