You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2021/07/30 13:59:28 UTC
[GitHub] [tvm] tqchen opened a new issue #8601: [TEST] Improve CheckGrad Numerical Gradient checking
tqchen opened a new issue #8601:
URL: https://github.com/apache/tvm/issues/8601
Followup of https://github.com/apache/tvm/issues/8579
Right now our numerical r numerical gradient checker trying to do numerical gradient for all directions which scales linearly to the number of entries.
We can instead sample a few random directions to check so that the time complexity won't grow linearly to the number of entries. see page 8 of this [slide](https://catalyst.cs.cmu.edu/15-884-mlsys-sp21/slides/2-MLSys-AutomaticDifferentiation.pdf)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] tqchen commented on issue #8601: [TEST] Improve CheckGrad Numerical Gradient checking
Posted by GitBox <gi...@apache.org>.
tqchen commented on issue #8601:
URL: https://github.com/apache/tvm/issues/8601#issuecomment-889912017
cc @altanh
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org