[GitHub] [incubator-mxnet] gilbertfrancois commented on issue #18751: gluon.nn.BatchNorm seems to swap updated values of moving_mean and moving_var on GPU.

[GitBox <gi...@apache.org>]

gilbertfrancois commented on issue #18751:
URL: https://github.com/apache/incubator-mxnet/issues/18751#issuecomment-660447079


   @szha I've just tested it against **mxnet-cu102 v2.0.0b20200716** and it has the same problem. See below:
   
   ```
                  gamma on CPU and GPU are (almost) equal:   True, err: 0.00000+-0.00000
                   beta on CPU and GPU are (almost) equal:   True, err: 0.00000+-0.00000
           running_mean on CPU and GPU are (almost) equal:  False, err: 0.90099+-0.20569
            running_var on CPU and GPU are (almost) equal:  False, err: 0.90099+-0.20569
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org