You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2022/02/25 23:48:43 UTC
[GitHub] [tvm] hogepodge opened a new pull request #10393: [WIP] Onnx scorecard
hogepodge opened a new pull request #10393:
URL: https://github.com/apache/tvm/pull/10393
Adds an ONNX backend and and ONNX backend test to generate an ONNX backend scorecard result.
http://onnx.ai/backend-scoreboard/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] hogepodge commented on pull request #10393: [WIP] Onnx scorecard
Posted by GitBox <gi...@apache.org>.
hogepodge commented on pull request #10393:
URL: https://github.com/apache/tvm/pull/10393#issuecomment-1051456740
It's worth noting that with the current skipped test set the max possible score is 85%.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] hogepodge commented on pull request #10393: [WIP] Onnx scorecard
Posted by GitBox <gi...@apache.org>.
hogepodge commented on pull request #10393:
URL: https://github.com/apache/tvm/pull/10393#issuecomment-1051427941
Latest patch brings pass rate up to 77.4%
```
Ran 1992 tests in 628.021s
FAILED (failures=9, errors=143, skipped=298)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] hogepodge commented on pull request #10393: [WIP] Onnx scorecard
Posted by GitBox <gi...@apache.org>.
hogepodge commented on pull request #10393:
URL: https://github.com/apache/tvm/pull/10393#issuecomment-1051381303
Currently this backend runs with about a 71.5% pass percentage.
```
Ran 1992 tests in 638.776s
FAILED (failures=9, errors=261, skipped=298)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [tvm] mbrookhart commented on a change in pull request #10393: [WIP] Onnx scorecard
Posted by GitBox <gi...@apache.org>.
mbrookhart commented on a change in pull request #10393:
URL: https://github.com/apache/tvm/pull/10393#discussion_r826461831
##########
File path: tests/python/driver/onnx/onnx_backend.py
##########
@@ -0,0 +1,164 @@
+import onnx.backend.test
+from tvm.driver.onnx.backend import TVMBackend
+
+import unittest
+import warnings
+
+pytest_plugins = 'onnx.backend.test.report',
+
+backend_test = onnx.backend.test.runner.Runner(TVMBackend, __name__)
+
+unsupported_onnx_tests = [
Review comment:
Would it make sense to store this common to both the onnx frontend tests and this driver test? I would hate to update the frontend tests and fail to see improvements here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org