[GitHub] [tvm] hypercubestart edited a comment on pull request #7831: [AutoTVM] [TOPI] Support AutoTVM for int4 tensorcore

[GitBox <gi...@apache.org>]

hypercubestart edited a comment on pull request #7831:
URL: https://github.com/apache/tvm/pull/7831#issuecomment-915627466


   > @hypercubestart Hello, I'd like to reproduce your table on T4+int4, but it seems that the current AutoTVM tutorial code [(link)](https://tvm.apache.org/docs/tutorials/autotvm/tune_relay_cuda.html#sphx-glr-tutorials-autotvm-tune-relay-cuda-py) cannot utilize the int4+tensorcore template. It would be appreciated if you could share a sample code. Thank you.
   
   hi @jlimmm! Unfortunately I don't have the code anymore but the PR has an example of creating a network consisting of a single int4 conv2d https://github.com/apache/tvm/blob/f8b1df4d297e19a20914700e7519543f6f3ac233/tests/python/topi/python/test_topi_conv2d_hwnc_tensorcore.py#L149-L167 using the utilities from https://github.com/apache/tvm/pull/6748, so you could reuse most of the AutoTVM tutorial code, but simply replace the network with the network shown above
   
   AutoTVM will then be able to automatically infer the int4+tensorcore template


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org