[GitHub] [incubator-mxnet] kpuatamazon commented on issue #17980: When compiled with MKL, fully_connected calls DNNL while dot and batch_dot call MKL

[GitBox <gi...@apache.org>]

kpuatamazon commented on issue #17980:
URL: https://github.com/apache/incubator-mxnet/issues/17980#issuecomment-674946425


   Mostly fixed by the v1.6.x release of oneDNN.  There is still a speed discrepancy but it's not as bad.  
   
   `git checkout 6b568fd2c10e8cc14c21d6150ba71933a2af2a41` (current v1.x branch of MXNet including oneDNN 1.6.1)
   ```
   Shape (5, 512, 512)
   0.0000471 seconds for fullyconnected (DNNL)
   0.0000413 seconds for dot (MKL)
   Shape (5, 512, 1536)
   0.0000691 seconds for fullyconnected (DNNL)
   0.0000639 seconds for dot (MKL)
   Shape (5, 512, 2048)
   0.0000936 seconds for fullyconnected (DNNL)
   0.0000868 seconds for dot (MKL)
   Shape (5, 2048, 512)
   0.0000949 seconds for fullyconnected (DNNL)
   0.0000870 seconds for dot (MKL)
   Shape (4, 512, 512)
   0.0000446 seconds for fullyconnected (DNNL)
   0.0000392 seconds for dot (MKL)
   ```
   
   Revert to oneDNN v1.3.  
   `git checkout 6b568fd2c10e8cc14c21d6150ba71933a2af2a41 && git revert 17111037176294d86b7dc6f719347aa24c96b317 && git revert eae6171cb56190cf06f5b11597380c082745991b`
   ```
   Shape (5, 512, 512)
   0.0000842 seconds for fullyconnected (DNNL)
   0.0000407 seconds for dot (MKL)
   Shape (5, 512, 1536)
   0.0001908 seconds for fullyconnected (DNNL)
   0.0000606 seconds for dot (MKL)
   Shape (5, 512, 2048)
   0.0002421 seconds for fullyconnected (DNNL)
   0.0000880 seconds for dot (MKL)
   Shape (5, 2048, 512)
   0.0003462 seconds for fullyconnected (DNNL)
   0.0000912 seconds for dot (MKL)
   Shape (4, 512, 512)
   0.0000841 seconds for fullyconnected (DNNL)
   0.0000395 seconds for dot (MKL)
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org