You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by sx...@apache.org on 2020/12/16 07:00:42 UTC
[incubator-mxnet] branch master updated: fix typo in adamw (#19680)
This is an automated email from the ASF dual-hosted git repository.
sxjscience pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-mxnet.git
The following commit(s) were added to refs/heads/master by this push:
new 91503f7 fix typo in adamw (#19680)
91503f7 is described below
commit 91503f71e17fca9151779503fc9f5edefe26f2ef
Author: Zheyu Ye <37...@users.noreply.github.com>
AuthorDate: Wed Dec 16 14:59:20 2020 +0800
fix typo in adamw (#19680)
---
python/mxnet/optimizer/adamW.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/mxnet/optimizer/adamW.py b/python/mxnet/optimizer/adamW.py
index 8e19690..127524a 100644
--- a/python/mxnet/optimizer/adamW.py
+++ b/python/mxnet/optimizer/adamW.py
@@ -44,7 +44,7 @@ class AdamW(Optimizer):
w = w - lr * (m / (sqrt(v) + epsilon) + wd * w)
- Also, we can turn of the bias correction term and the updates are as follows::
+ Also, we can turn off the bias correction term and the updates are as follows::
grad = clip(grad * rescale_grad, clip_gradient) + wd * weight
m = beta1 * m + (1 - beta1) * grad