You are viewing a plain text version of this content. The canonical link for it is here.
Posted to discuss-archive@tvm.apache.org by shiy10 via Apache TVM Discuss <no...@discuss.tvm.ai> on 2021/11/25 07:23:21 UTC

[Apache TVM Discuss] [Questions] Confused about kMaxNumGPUs in runtime


Any help ? 
Besides this, I am also confused about the multi-thread runtime. Obviously the runtime uses C++ threads, but [how cuda kernel launches](https://discuss.tvm.apache.org/t/how-cuda-kernel-is-launched-in-tvm-stack/6167/7?u=shiy10) says tvm supports no runtime concurrency.





---
[Visit Topic](https://discuss.tvm.apache.org/t/confused-about-kmaxnumgpus-in-runtime/11536/2) to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/ed1919cae00a62b7328e9705a71953d5a605b21648111527bcb98f9c64cece8d).

[Apache TVM Discuss] [Questions] Confused about kMaxNumGPUs in runtime

Posted by shiy10 via Apache TVM Discuss <no...@discuss.tvm.ai>.

Now I understand. Thank you.





---
[Visit Topic](https://discuss.tvm.apache.org/t/confused-about-kmaxnumgpus-in-runtime/11536/4) to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/239d0670a1b9faa568b0b7caf47a76cbef74f82f1b93154e4c27546bf1e14700).

[Apache TVM Discuss] [Questions] Confused about kMaxNumGPUs in runtime

Posted by masahi via Apache TVM Discuss <no...@discuss.tvm.ai>.

We use threads for parallelism within an operator. By "concurrency" I meant something like asynchronous execution among operators (also called inter-operator parallelism).





---
[Visit Topic](https://discuss.tvm.apache.org/t/confused-about-kmaxnumgpus-in-runtime/11536/3) to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/c4a3f8e568efb08c87994b4a890e2cd9ec2ad1e8a990a3c0fe5396b1003b0b75).