[GitHub] [incubator-mxnet] zixuanweeei commented on issue #15464: MKL-DNN gives wrong convolution bias gradient if weights gradient is not requested

[GitBox <gi...@apache.org>]

zixuanweeei commented on issue #15464: MKL-DNN gives wrong convolution bias gradient if weights gradient is not requested
URL: https://github.com/apache/incubator-mxnet/issues/15464#issuecomment-508634883
 
 
   @matteosal I think this is perhaps caused by the fact that the forward convolution operator supports calculation either with or without bias. And both cases require weights in the convolutional operator. So in the backward process, the gradient of bias could be either calculated or not. This leads to only two backward APIs supported by MKL-DNN corresponding to the cases of the forward operations. Actually, we can just take the gradients of the weights away. And we have located the problem. Further verification is required before taking a PR.
   BTW, could you provide some examples that only requires the gradients of bias? We will very appreciate it. Thanks. 😃 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services