You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2017/12/18 01:35:00 UTC
[GitHub] chinakook opened a new issue #9115: Feature request for In-Place Activated BatchNorm
chinakook opened a new issue #9115: Feature request for In-Place Activated BatchNorm
URL: https://github.com/apache/incubator-mxnet/issues/9115
In-Place Activated BatchNorm (InPlace-ABN) is a novel approach to reduce the memory required for training deep networks. It allows for up to 50% memory savings in modern architectures such as ResNet, ResNeXt and Wider ResNet by redefining BN + non linear activation as a single in-place operation, while smartly dropping or recomputing intermediate buffers as needed.
https://github.com/mapillary/inplace_abn
https://arxiv.org/pdf/1712.02616.pdf
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services