You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2019/04/17 03:26:25 UTC
[GitHub] [incubator-mxnet] zhanghang1989 commented on issue #8458:
Synchronized Batch normalization in multi GPUs training
zhanghang1989 commented on issue #8458: Synchronized Batch normalization in multi GPUs training
URL: https://github.com/apache/incubator-mxnet/issues/8458#issuecomment-483922861
The SyncBN does reduce the speed due to synchronization for every BN layer during both forward and backward. Use it only when it is necessary, especially on computation intensive task such as semantic segmentation or object detection where the synchronization is not a huge bottleneck comparing to the computation.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services