You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2020/09/28 11:57:21 UTC

[GitHub] [incubator-tvm] zotanika opened a new issue #6576: how to evaluate inference's accuracy

zotanika opened a new issue #6576:
URL: https://github.com/apache/incubator-tvm/issues/6576


   Dear TVM team,
   
   I'm struggling to figure out the reason why the models hosted at [https://www.tensorflow.org/lite/guide/hosted_models](url) experience huge accuracy drop after converting with relay.frontend.from_tflite(). For instance, mobilenet_v1_1.0_224 claimed to hit top1 72%, top5 91% accuracy becomes top1 61%, top5 87%.
   
   First, I would like to reproduce the result accuracy given at [https://tvm.apache.org/docs/dev/benchmark.html](url) for resnet18 and reuse these benchmark infrastructures to debug the problem efficiently, but I cannot find the source codes matching to schema v0.1 log format described in the page.
   
   Do I miss something, or is there any other reference to do this job?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] tqchen closed issue #6576: how to evaluate inference's accuracy

Posted by GitBox <gi...@apache.org>.
tqchen closed issue #6576:
URL: https://github.com/apache/incubator-tvm/issues/6576


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-tvm] tqchen commented on issue #6576: how to evaluate inference's accuracy

Posted by GitBox <gi...@apache.org>.
tqchen commented on issue #6576:
URL: https://github.com/apache/incubator-tvm/issues/6576#issuecomment-700100024


   Thanks for asking the question, it would be great to use https://discuss.tvm.apache.org/ for general trouble shooting. In this particular case, it might due to relates to things like pre-processing and other issues. It would be great if you can dig deeper into the problem


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org