You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/07/19 07:17:25 UTC

[GitHub] [incubator-mxnet] wkcn commented on issue #18751: gluon.nn.BatchNorm seems to swap updated values of moving_mean and moving_var on GPU.

wkcn commented on issue #18751:
URL: https://github.com/apache/incubator-mxnet/issues/18751#issuecomment-660600872


   The values of moving_mean and moving_var are not consistent between CPU and GPU.
   The values on CPU is population variance (v / n), but that on GPU CUDNN is sample variance (v / (n - 1)).
   
   Refer: https://github.com/apache/incubator-mxnet/pull/18694/files#diff-cb652780258e73a9cd08568f38929aa2R1554
   
   The line 1554 in tests/python/unittest/test_operator.py
   ```# cudnn uses m-1 in the denominator of its sample variance calculation, not m```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org