You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2022/08/10 08:34:54 UTC

[GitHub] [tvm] ibsidorenko opened a new pull request, #12358: [QNN][Hexagon] Disable QNN canonicalization pass

ibsidorenko opened a new pull request, #12358:
URL: https://github.com/apache/tvm/pull/12358

   Main goals for this PR are the following:
   
   1. E2E compilation should work without QNN canonicalization on the Hexagon target.
   2. Enable int8 -> int8 computation for dense/conv2d operation.
   
   What was done:
   1. Disabled qnn::Legalize for Hexagon target. For other targets QNN passes keep working.
   2. Implemented new strategies (compute and schedules) for QNN ops. This is POC code. There was no goal to implement high performance compute/schedule functions. This will be done in future.
   3. To enable int8 -> int8 computation for dense/conv2d operation we need to merge dense|conv2d + [bias]! + requantize.
   There are two ways how to implement this:
   A) Implement new IRModule -> IRModule pass that will pattern match combination conv2d+requantize/conv2d+bias+requantize and etc.
   B) Change TECompiler and lower sequence of QNN operation into one TOPI op.
   Possibly, A) is more natural but A) implies adding dozens of new Relay ops which only make sense for Hexagon target, not genetic and overloaded with a huge number of arguments (inputs, quantization parameters, bias, requantization parameters etc.)
   That's why B) approach was implemented in this PR.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [tvm] ibsidorenko closed pull request #12358: [QNN][Hexagon] Disable QNN canonicalization pass

Posted by GitBox <gi...@apache.org>.
ibsidorenko closed pull request #12358: [QNN][Hexagon] Disable QNN canonicalization pass
URL: https://github.com/apache/tvm/pull/12358


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org