You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2017/12/16 00:55:01 UTC

[GitHub] zhanghang1989 commented on issue #8458: Synchronized Batch normalization in multi GPUs training

zhanghang1989 commented on issue #8458: Synchronized Batch normalization in multi GPUs training
URL: https://github.com/apache/incubator-mxnet/issues/8458#issuecomment-352147230
 
 
   There is no easy way to solve Sync BN. I have implemented it using PyTorch (http://hangzh.com/PyTorch-Encoding/notes/syncbn.html) by rewriting DataParallel and cross-GPU communication. I will implement MXNet Gluon version as well, probably release it early next year.  

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services