[GitHub] [tvm] jcf94 edited a comment on pull request #8402: [CUDA] dense_tensorcore/batch_matmul_tensorcore support int8/int4

[GitBox <gi...@apache.org>]

jcf94 edited a comment on pull request #8402:
URL: https://github.com/apache/tvm/pull/8402#issuecomment-873863347


   Thanks for your continue contribution on the tensor core schedule! @wyc-ruiker I'll help reivew when I have time.
   
   p.s. Recently I added a new op `nn.matmul` which extend the `nn.dense` to support data tensor and weight tensor to be in transposed or non-transposed format. For a model from frameworks like TensorFlow, TVM will insert an extra transpose for `nn.dense` while use `nn.matmul` can get rid of that.
   I'm not sure but maybe it will be beneficial to use it if your model suffered from some performance issue on the inserted transpose.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org