[GitHub] [incubator-mxnet] pengwangucla edited a comment on issue #8458: Synchronized Batch normalization in multi GPUs training

[GitBox <gi...@apache.org>]

pengwangucla edited a comment on issue #8458: Synchronized Batch normalization in multi GPUs training
URL: https://github.com/apache/incubator-mxnet/issues/8458#issuecomment-485266722
 
 
   
   > The SyncBN does reduce the speed due to synchronization for every BN layer during both forward and backward. Use it only when it is necessary, especially on computation intensive task such as semantic segmentation or object detection where the synchronization is not a huge bottleneck comparing to the computation.
   
   Thanks for the reply, I understand it reduces the speed as I observed, but it also reduces the accuracy from a pretrained se-net. I wonder whether you have tried it using symbol API ?  Thanks

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services