[jira] [Commented] (SINGA-187) Add popular parameter initialization methods

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SINGA-187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335928#comment-15335928 ] 

ASF subversion and git services commented on SINGA-187:
-------------------------------------------------------

Commit 8900543963118b6d2514a09bcebd29432485df04 in incubator-singa's branch refs/heads/dev from [~flytosky]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-singa.git;h=8900543 ]

SINGA-187 Add popular parameter initialization methods

5 initialization methods are added, namely, constant, uniform, gaussian,
Xavier (also called glorot) and MSRA.

We use the same config fields as Caffe, hence we simply rename Caffe's protobuf
message to FillerConf. The base class is singa::init::Initializer. To
avoid name conflicts with Uniform and Gaussian methods, we enclose them
into the namespace init. May consider rename them later.


> Add popular parameter initialization methods
> --------------------------------------------
>
>                 Key: SINGA-187
>                 URL: https://issues.apache.org/jira/browse/SINGA-187
>             Project: Singa
>          Issue Type: New Feature
>            Reporter: wangwei
>
> This ticket is for adding popular parameter initialization methods for V1, including
> 1. setting parameter values with constants,
> 2. filling the parameter tensor following uniform distribution
> 3. filling the parameter tensor following normal distribution
> 4. Xavier method, http://jmlr.org/proceedings/papers/v9/glorot10a/glorot10a.pdf
> 5. MSRA method, http://arxiv.org/pdf/1502.01852v1.pdf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)