[GitHub] roywei commented on issue #13825: Dropout is Slow

[GitBox <gi...@apache.org>]

roywei commented on issue #13825: Dropout is Slow
URL: https://github.com/apache/incubator-mxnet/issues/13825#issuecomment-468139928
 
 
   after #13896, seems only `mx.gluon.nn.Dropout(0.5)` has performance improvements, but not  mx.nd.Dropout(data, 0.5, mode='always')
   
   following the above code sample:
   ### Using `mx.nd.Dropout`
   1.43 s ± 293 µs per loop (mean ± std. dev. of 7 runs, 1 loop each)
   ### Using Custom Dropout
   331 ms ± 411 µs per loop (mean ± std. dev. of 7 runs, 1 loop each)
   
   ### Network using `mx.gluon.nn.Dropout`
   128 ms ± 39.4 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)
   
   ### Network without `mx.gluon.nn.Dropout`
   128 ms ± 30.2 µs per loop (mean ± std. dev. of 7 runs, 10 loops each)
   
   tested with both `pip install mxnet-cu92 --pre` and build from source on p3.2x 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services