You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2021/03/05 03:29:05 UTC

[GitHub] [tvm] zhuochenKIDD commented on pull request #7573: [Runtime] Extend Graph Runtime To Support Cuda Graph Launch

zhuochenKIDD commented on pull request #7573:
URL: https://github.com/apache/tvm/pull/7573#issuecomment-791124864


   > @zhuochenKIDD Do you have a guess as to why this is faster than the for-loop launch approach?
   
   @tkonolige not sure why it's faster，it's based on test，and depends on workloads. 
   I guest for my model, it has many tiny kernels which is more kernel-launch bound, and cuda-graph might reduce kernel-launch overhead, I will do more profiling & analysis，do you have some suggestion?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org