You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@horn.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2016/04/26 10:20:12 UTC
[jira] [Created] (HORN-18) Add AdaGrad solver
Edward J. Yoon created HORN-18:
----------------------------------
Summary: Add AdaGrad solver
Key: HORN-18
URL: https://issues.apache.org/jira/browse/HORN-18
Project: Apache Horn
Issue Type: New Feature
Reporter: Edward J. Yoon
https://courses.cs.washington.edu/courses/cse547/15sp/slides/adagrad.pdf
Adagrad provides a featureāspecific adaptive learning rate by incorporating knowledge of the geometry of past observations. Since input of NN are generally have many irrelevant features, this can contribute to speed up convergence I guess.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)