[Apache TVM Discuss] [Questions] Qualcomm SNPE and TVM

[Joel Winarske via Apache TVM Discuss <no...@discuss.tvm.ai>]

Qualcomm SNPE is effectively a ML hardware runtime scheduler that provides a user space API that enables many applications to share compute resources: https://developer.qualcomm.com/sites/default/files/docs/snpe/overview.html.  Not all OP codes are supported, and the SDK provides a hybrid model for OP codes not supported; CPU callback on specific OP codes which get implemented in Apps Proc native code.  It's complicated for the standard ML engineers who know little about hardware (most), but it is mandatory for a heavily loaded system.

I like the vendor neutral approach of TVM, and it could make sense to replace SNPE.  I'm trying to understand the gaps.

Questions:
1. Does TVM implement construct of a hardware resource scheduler that handles context switching of hardware resource?  If it exists is there a working example?

2. How does power management tie into TVM, if at all?

Thanks,
Joel





---
[Visit Topic](https://discuss.tvm.apache.org/t/qualcomm-snpe-and-tvm/11286/1) to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/b0f43a4e3b9738fe4cd0a3820c5e25f67f7b26ca467762d711af7c5afb632492).