You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2019/01/15 23:05:13 UTC
[GitHub] ptrendx commented on issue #13890: Improve bulking in Gluon
ptrendx commented on issue #13890: Improve bulking in Gluon
URL: https://github.com/apache/incubator-mxnet/pull/13890#issuecomment-454586193
Perf comparison:
ResNet-50 v1d from GluonCV on synthetic data, using slightly modified script to enable synthetic data, DGX1-V 32G.
- Default parameters from GluonCV script (128 per GPU, 8 GPUs, NAG optimizer)
- Without this PR: 5700 imgs/s
- With this PR: 5910 imgs/s
- Small batch (32 per GPU), 1 GPU, NAG optimizer changed to SGD (as at such small batch lack of true mixed precision version of NAG optimizer skews results a lot):
- Without this PR: 570 imgs/s
- Without this PR (static_shape=False): 550 imgs/s
- With this PR: 620 imgs/s
- With this PR (static_shape=False): 600 imgs/s
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services