You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by "masahi (via GitHub)" <gi...@apache.org> on 2023/08/03 11:54:12 UTC
[GitHub] [tvm] masahi opened a new pull request, #15467: [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC
masahi opened a new pull request, #15467:
URL: https://github.com/apache/tvm/pull/15467
(no comment)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] cyx-6 merged pull request #15467: [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC
Posted by "cyx-6 (via GitHub)" <gi...@apache.org>.
cyx-6 merged PR #15467:
URL: https://github.com/apache/tvm/pull/15467
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi commented on pull request #15467: [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC
Posted by "masahi (via GitHub)" <gi...@apache.org>.
masahi commented on PR #15467:
URL: https://github.com/apache/tvm/pull/15467#issuecomment-1665210735
> Are we deprecating v1?
We didn't have support for flash v1 before, so we are not deprecating it. The one we have used is so-called "xformer kernel" available in the cutlass example https://github.com/NVIDIA/cutlass/tree/main/examples/41_fused_multi_head_attention
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] Hzfengsy commented on pull request #15467: [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC
Posted by "Hzfengsy (via GitHub)" <gi...@apache.org>.
Hzfengsy commented on PR #15467:
URL: https://github.com/apache/tvm/pull/15467#issuecomment-1664352661
Is it possible to push cutlass parts to the `main` branch and remain only relax part to unity branch? it would be easier for us to sync branches later
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] tvm-bot commented on pull request #15467: [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC
Posted by "tvm-bot (via GitHub)" <gi...@apache.org>.
tvm-bot commented on PR #15467:
URL: https://github.com/apache/tvm/pull/15467#issuecomment-1663847536
<!---bot-comment-->
Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from [Reviewers](https://github.com/apache/incubator-tvm/blob/master/CONTRIBUTORS.md#reviewers) by @-ing them in a comment.
<sub>Generated by [tvm-bot](https://github.com/apache/tvm/blob/main/ci/README.md#github-actions)</sub>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi commented on pull request #15467: [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC
Posted by "masahi (via GitHub)" <gi...@apache.org>.
masahi commented on PR #15467:
URL: https://github.com/apache/tvm/pull/15467#issuecomment-1668641628
Hi can somebody merge this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] masahi commented on pull request #15467: [Unity][BYOC] Integrate Flash attention v2 kernel into CUTLASS BYOC
Posted by "masahi (via GitHub)" <gi...@apache.org>.
masahi commented on PR #15467:
URL: https://github.com/apache/tvm/pull/15467#issuecomment-1664508206
`main` doesn't have an `attention` op, so this is unity specific.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org