You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2022/09/05 05:14:07 UTC
[GitHub] [tvm] ramanps05 opened a new issue, #12701: [Feature Request] Support for quantized matmul for > 2d inputs for ONNX models.
ramanps05 opened a new issue, #12701:
URL: https://github.com/apache/tvm/issues/12701
I am getting the following error while compiling a quantized Onnx model -
File "python/tvm/relay/frontend/onnx.py" -
in _impl_v10
```assert (a_rank == 2) and (b_rank == 2), (AssertionError: QLinearMatMul importer currently requires both 'a' and 'b' tensors to be 2D, but ran(a)=3, rank(b)=3```
It looks like this is occurring due to quantized matmul operation not being supported for >2d inputs.
In the ToDo comments, it is mentioned that this limitation would be removed in future updates.
Is there any plan to enable this feature currently ?
We need this to deploy a model, and if it's not in priority, is there a workaround to this problem? Or something we can do to resolve it .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi commented on issue #12701: [Feature Request] Support for quantized matmul for > 2d inputs for ONNX models.
Posted by GitBox <gi...@apache.org>.
masahi commented on issue #12701:
URL: https://github.com/apache/tvm/issues/12701#issuecomment-1342290802
See https://github.com/apache/tvm/pull/13322
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi closed issue #12701: [Feature Request] Support for quantized matmul for > 2d inputs for ONNX models.
Posted by GitBox <gi...@apache.org>.
masahi closed issue #12701: [Feature Request] Support for quantized matmul for > 2d inputs for ONNX models.
URL: https://github.com/apache/tvm/issues/12701
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] cery999 commented on issue #12701: [Feature Request] Support for quantized matmul for > 2d inputs for ONNX models.
Posted by GitBox <gi...@apache.org>.
cery999 commented on issue #12701:
URL: https://github.com/apache/tvm/issues/12701#issuecomment-1237593257
in onnx the matmul should be (N,M) * (M,K) .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org