You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by "jinhongyii (via GitHub)" <gi...@apache.org> on 2023/12/04 22:51:07 UTC
[PR] [Unity] Support cutlass pattern: relax.nn.rms_norm [tvm]
jinhongyii opened a new pull request, #16201:
URL: https://github.com/apache/tvm/pull/16201
add a cutlass dispatch pattern: relax.nn.rms_norm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Unity] Support cutlass pattern: relax.nn.rms_norm [tvm]
Posted by "jinhongyii (via GitHub)" <gi...@apache.org>.
jinhongyii commented on PR #16201:
URL: https://github.com/apache/tvm/pull/16201#issuecomment-1839825861
https://github.com/apache/tvm/pull/16203 aligns f16 kernel perf with cutlass, while existing f32 kernel already outperforms cutlass.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Unity] Support cutlass pattern: relax.nn.rms_norm [tvm]
Posted by "junrushao (via GitHub)" <gi...@apache.org>.
junrushao commented on PR #16201:
URL: https://github.com/apache/tvm/pull/16201#issuecomment-1839824926
@masahi Hongyi mentioned this one to me: https://github.com/apache/tvm/pull/16203
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Unity] Support cutlass pattern: relax.nn.rms_norm [tvm]
Posted by "jinhongyii (via GitHub)" <gi...@apache.org>.
jinhongyii commented on PR #16201:
URL: https://github.com/apache/tvm/pull/16201#issuecomment-1839811208
After discussion with @junrushao, we decide to remove cutlass rms_norm dispatch because dlight has better performance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Unity] Support cutlass pattern: relax.nn.rms_norm [tvm]
Posted by "jinhongyii (via GitHub)" <gi...@apache.org>.
jinhongyii commented on PR #16201:
URL: https://github.com/apache/tvm/pull/16201#issuecomment-1839664274
cc: @junrushao @masahi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Unity] Support cutlass pattern: relax.nn.rms_norm [tvm]
Posted by "masahi (via GitHub)" <gi...@apache.org>.
masahi commented on PR #16201:
URL: https://github.com/apache/tvm/pull/16201#issuecomment-1839824003
> because dlight has better performance
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [Unity] Support cutlass pattern: relax.nn.rms_norm [tvm]
Posted by "jinhongyii (via GitHub)" <gi...@apache.org>.
jinhongyii closed pull request #16201: [Unity] Support cutlass pattern: relax.nn.rms_norm
URL: https://github.com/apache/tvm/pull/16201
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org