You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2018/01/05 18:41:45 UTC

[GitHub] cjolivier01 commented on issue #9216: Loss of Precision in BatchNorm and output_var may be wrong

cjolivier01 commented on issue #9216: Loss of Precision in BatchNorm and output_var may be wrong
URL: https://github.com/apache/incubator-mxnet/issues/9216#issuecomment-355632257
 
 
   Just FYI, CUDNN stores invstd for moving_variance rather than actual variance, if I remember correctly.
   This can be seen in the unit test not checking for those being the same when CUDNN is enabled: https://github.com/apache/incubator-mxnet/blob/f9fd88bf178c0005a81ebf909750d5786bb1ec69/tests/cpp/operator/batchnorm_test.cc#L409
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services