You are viewing a plain text version of this content. The canonical link for it is here.
Posted to discuss-archive@tvm.apache.org by shiy10 via Apache TVM Discuss <no...@discuss.tvm.ai> on 2021/11/23 13:49:57 UTC
[Apache TVM Discuss] [Questions] Confussed about kMaxNumGPUs in runtime
I am studying the source code of TVM, and I am confused about the constant kMaxNumGPUs (=32) in /src/runtime/cuda/cuda_module.h.
To my mind, when we run the compiled model, we can only choose 1 GPU card.
If this is true, why TVM runtime set the kMaxNumGPUs to 32 and keeps the memory allocation status of kMaxNumGPUs GPU cards ?
---
[Visit Topic](https://discuss.tvm.apache.org/t/confussed-about-kmaxnumgpus-in-runtime/11536/1) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/fb34c5aabf744bdffc8e730528899e50627cb0bbe973042e696e52077858e94e).
[Apache TVM Discuss] [Questions] Confused about kMaxNumGPUs in runtime
Posted by shiy10 via Apache TVM Discuss <no...@discuss.tvm.ai>.
Now I understand. Thank you.
---
[Visit Topic](https://discuss.tvm.apache.org/t/confused-about-kmaxnumgpus-in-runtime/11536/4) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/239d0670a1b9faa568b0b7caf47a76cbef74f82f1b93154e4c27546bf1e14700).
[Apache TVM Discuss] [Questions] Confused about kMaxNumGPUs in runtime
Posted by masahi via Apache TVM Discuss <no...@discuss.tvm.ai>.
We use threads for parallelism within an operator. By "concurrency" I meant something like asynchronous execution among operators (also called inter-operator parallelism).
---
[Visit Topic](https://discuss.tvm.apache.org/t/confused-about-kmaxnumgpus-in-runtime/11536/3) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/c4a3f8e568efb08c87994b4a890e2cd9ec2ad1e8a990a3c0fe5396b1003b0b75).
[Apache TVM Discuss] [Questions] Confused about kMaxNumGPUs in runtime
Posted by shiy10 via Apache TVM Discuss <no...@discuss.tvm.ai>.
Any help ?
Besides this, I am also confused about the multi-thread runtime. Obviously the runtime uses C++ threads, but [how cuda kernel launches](https://discuss.tvm.apache.org/t/how-cuda-kernel-is-launched-in-tvm-stack/6167/7?u=shiy10) says tvm supports no runtime concurrency.
---
[Visit Topic](https://discuss.tvm.apache.org/t/confused-about-kmaxnumgpus-in-runtime/11536/2) to respond.
You are receiving this because you enabled mailing list mode.
To unsubscribe from these emails, [click here](https://discuss.tvm.apache.org/email/unsubscribe/ed1919cae00a62b7328e9705a71953d5a605b21648111527bcb98f9c64cece8d).