[jira] [Created] (SINGA-183) Add the base classes for optimizer, constraint and regularizer

["wangwei (JIRA)" <ji...@apache.org>]

wangwei created SINGA-183:
-----------------------------

             Summary: Add the base classes for optimizer, constraint and regularizer
                 Key: SINGA-183
                 URL: https://issues.apache.org/jira/browse/SINGA-183
             Project: Singa
          Issue Type: New Feature
            Reporter: wangwei


Deep learning models are training via SGD algorithms to optimize the objective loss functions.
This ticket creates the base classes for the SGD algorithms, called Optimizer.
The Constraint class is created, which adds constraints on the gradients of parameters, e.g., the L2 norm should be within a threshold.
The Regularizer class is created, which implements L2 norm regularization for the objective loss function.

A simple vanilla SGD optimizer would be implemented for testing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)