You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2017/12/31 16:31:13 UTC

[GitHub] ZiyueHuang commented on issue #9262: FTML optimizer implementation

ZiyueHuang commented on issue #9262: FTML optimizer implementation
URL: https://github.com/apache/incubator-mxnet/pull/9262#issuecomment-354613005
 
 
   Thanks for your comments.
   - c++ version is added.
   - I think weight decay is for l2 regularization in MXNet. l2 regularizer is now incorporated into the gradients.
   - Right, it is more efficient to update the powers of beta1 and beta 2 iteratively. But `t = self._index_update_count[index]` which is not always strictly increasing from 0.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services