You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2017/11/15 06:22:44 UTC

[GitHub] BiranLi opened a new issue #8659: Some problems about support for Volta GPU architecture(V100 and CUDA9/CUDNNV7).

BiranLi opened a new issue #8659: Some problems about support for Volta GPU architecture(V100 and CUDA9/CUDNNV7).
URL: https://github.com/apache/incubator-mxnet/issues/8659
 
 
   
   ### 1 Not support all features in Volta GPU.
   I found Mxnet used SgemmEX API when the I/O is FP16 type. The input is FP16, and computing with FP32. So is cudnn_convolution. 
   
   ### 2 How can we get 3.5x faster than Pascal
   After I check in the real Hgemm API and fix the cudnn convolution compute type to FP16, the speed up to 2x faster than Pascal in VGG network. So which net mxnet team to train to achive 3.5x speedup?
   
   ### 3 Tensor mode
   In convolution, mxnet enables tensor op only through set math mode, but in API documentation, using tensor op requires setting the corresponding forward-backward algorithm, such as CUDNN_CONVOLUTION_FWD_ALGO_IMPLICIT_PRECOMP_GEMM,  and the need for correct input and output data.
   
   ### Environment 
   > Hardware: V100-PCIE-16G
   > Software: Mxnet-0.12 CUDA-9.0 CUDNN-7
   > Network: VGG

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services