You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2022/04/14 05:54:40 UTC

[GitHub] [tvm] milad1378yz opened a new issue, #11008: Can TVM also be used for dynamic models?

milad1378yz opened a new issue, #11008:
URL: https://github.com/apache/tvm/issues/11008

   I used two ways to use TVM on the BERT model
   The first is to use the provider in onnxruntime and the second is to use the following link:
   [https://tvm.apache.org/docs/how_to/deploy_models/deploy_sparse.html](url)
   In the first method, I encountered the following error:
   Incompatible broadcast type TensorType([-1, -1, 768], float32) and TensorType([1, 511, 768], float32)
   This means that dynamic input cannot be given to the model.
   In the second method, in the Configure Settings section, the batch_size and len_size values must be specified, which contradicts the dynamic input.
   My question is, is there a way to use TVM for dynamic models like BERT?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] masahi commented on issue #11008: Can TVM also be used for dynamic models?

Posted by GitBox <gi...@apache.org>.

masahi commented on issue #11008:
URL: https://github.com/apache/tvm/issues/11008#issuecomment-1101044634

   Please post a question like this to https://discuss.tvm.apache.org/
   
   Models with dynamic input can be compiled, but performance on dynamic shape is terrible since we cannot tune such workload currently. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] masahi closed issue #11008: Can TVM also be used for dynamic models?

Posted by GitBox <gi...@apache.org>.

masahi closed issue #11008: Can TVM also be used for dynamic models?
URL: https://github.com/apache/tvm/issues/11008


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org