You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by "MasterJH5574 (via GitHub)" <gi...@apache.org> on 2025/02/02 02:46:42 UTC
[PR] [KVCache] TIR attention kernel support for MLA [tvm]
MasterJH5574 opened a new pull request, #17618:
URL: https://github.com/apache/tvm/pull/17618
This PR introduces the MLA attention kernels written in TIR. It also implements the KV cache MLA computation logic.
A new unit test file is added to ensure the correctness of the TIR kernels.
This PR also fixes a few TIR prefill kernel tile size initialization.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [KVCache] TIR attention kernel support for MLA [tvm]
Posted by "MasterJH5574 (via GitHub)" <gi...@apache.org>.
MasterJH5574 commented on PR #17618:
URL: https://github.com/apache/tvm/pull/17618#issuecomment-2634281088
@tvm-bot rerun
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [KVCache] TIR attention kernel support for MLA [tvm]
Posted by "jinhongyii (via GitHub)" <gi...@apache.org>.
jinhongyii merged PR #17618:
URL: https://github.com/apache/tvm/pull/17618
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org