You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tvm.apache.org by Chao Liu via Apache TVM Discuss <no...@discuss.tvm.ai> on 2021/02/18 12:53:34 UTC

[Apache TVM Discuss] [Development/RFC] [Guideline] Relay AOT


Hi, @tqchen Is there any plan on the "**Fully Featured Relay AOT**" Compiler? 

We have a dynamic-shaped model, which is memory-intensive (the execution time of a single operator is short), the vm's approach is hard to meet our performance requirements, the overhead is too large compared to the operators execution time. 

So, we want a solution to minimize the overhead introduced by the extra code related to shape calculation and memory management.

AOT solution sounds like a good choice, since we can inline the computation related to shape calculation and eliminate the overhead related to interact with the VM.





---
[Visit Topic](https://discuss.tvm.apache.org/t/guideline-relay-aot/5977/12) to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/dd5902f55b572044c0d1ad0ac6393bbf08e67c77a56e5229b8fd0a07dc9509b6).