You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@tvm.apache.org by GitBox <gi...@apache.org> on 2021/12/16 08:11:50 UTC

[GitHub] [tvm] driazati opened a new pull request #9753: Add skip to flaky MacOS RPC test

driazati opened a new pull request #9753:
URL: https://github.com/apache/tvm/pull/9753


   Thanks for contributing to TVM!   Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from [Reviewers](https://github.com/apache/incubator-tvm/blob/master/CONTRIBUTORS.md#reviewers) by @ them in the pull request thread.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [tvm] KJlaccHoeUM9l commented on pull request #9753: Add skip to flaky MacOS RPC test

Posted by GitBox <gi...@apache.org>.
KJlaccHoeUM9l commented on pull request #9753:
URL: https://github.com/apache/tvm/pull/9753#issuecomment-1002989035


   Hello @driazati!
   We have only been able to reproduce this issue in the azure cloud. 
   To do this, we slightly modified `main.yaml` as follows:
   ```
   for ((i=1; i < 100; i++)); do python -m pytest -vrP tests/python/contrib/test_rpc_server_device.py; done
   ```
   It looks like this line has fallen off: 
   ```
   func = remote.load_module (os.path.split (build_res.filename) [1])
   ```
   The problem requires further investigation.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [tvm] areusch merged pull request #9753: Add skip to flaky MacOS RPC test

Posted by GitBox <gi...@apache.org>.
areusch merged pull request #9753:
URL: https://github.com/apache/tvm/pull/9753


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [tvm] areusch commented on pull request #9753: Add skip to flaky MacOS RPC test

Posted by GitBox <gi...@apache.org>.
areusch commented on pull request #9753:
URL: https://github.com/apache/tvm/pull/9753#issuecomment-1004412047


   thanks @driazati can you create a GH issue for this test or mention it in this PR?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [tvm] KJlaccHoeUM9l commented on pull request #9753: Add skip to flaky MacOS RPC test

Posted by GitBox <gi...@apache.org>.
KJlaccHoeUM9l commented on pull request #9753:
URL: https://github.com/apache/tvm/pull/9753#issuecomment-997989719


   Hello @driazati!
   
   Thank you for your comment! Our team also noticed this problem.
   It looks like the first time this error occurred when running [this action](https://github.com/apache/tvm/runs/4302575250?check_suite_focus=true) in [PR#9483](https://github.com/apache/tvm/pull/9483).
   
   Failure occurs in a test that seeks to verify that the auto scheduler can be used with an RPC Session. The error occurs due to checking the tuning log after a tuning session. The test says that at this stage, an error code was found inside the log, which says the following:
   ```
   Errors happen when compiling code on device
   (e.g. OpenCL JIT on the device)
   ```
   It doesn't look like the problem is in the whole test or in the iOS RPC application.
   
   At the moment, it has not been possible to reproduce the problem locally to find out more details about this failure. If you have any additional information about this or can reproduce this problem yourself, then we would be very grateful for any additional observations.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [tvm] areusch commented on pull request #9753: Add skip to flaky MacOS RPC test

Posted by GitBox <gi...@apache.org>.
areusch commented on pull request #9753:
URL: https://github.com/apache/tvm/pull/9753#issuecomment-1006195496


   sorry one q: has anyone repro'd this on linux? if it hasn't failed there, i'd lean towards disabling it only on windows/os x for now. the GH actions can be retriggered and don't necessarily block commit.
   
   @KJlaccHoeUM9l could you let us know which os you were using in azure?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [tvm] areusch commented on pull request #9753: Add skip to flaky MacOS RPC test

Posted by GitBox <gi...@apache.org>.
areusch commented on pull request #9753:
URL: https://github.com/apache/tvm/pull/9753#issuecomment-1006204473


   oh sorry--ignore. i misread the test decorators.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [tvm] driazati commented on pull request #9753: Add skip to flaky MacOS RPC test

Posted by GitBox <gi...@apache.org>.
driazati commented on pull request #9753:
URL: https://github.com/apache/tvm/pull/9753#issuecomment-998292147


   I wasn't able to reproduce it locally either (and it doesn't seem to fail in CI super often either, maybe 1 out of every 20 recent runs on `main`) and I don't really know the autotuning/rpc code well enough to guess where the problem might be, but it still comes up from time to time so I think it should be disabled until a proper repro/fix is found. It makes more sense to mark this as a flaky failure with `xfail` rather than `skip` though so it will still run, but not report as an unexpected error if it fails.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org