[GitHub] [incubator-mxnet] bgawrych commented on issue #19384: Python3: MKLDNN-CPU hangs

[GitBox <gi...@apache.org>]

bgawrych commented on issue #19384:
URL: https://github.com/apache/incubator-mxnet/issues/19384#issuecomment-713600043


   Hi @leezu,
   I couldn't reproduce this issue, so I've investigated logs deeply and here is what I've deduced:
   Log that you provided is not complete, other log from jenkins https://jenkins.mxnet-ci.amazon-ml.com/job/mxnet-validation/job/unix-cpu/view/change-requests/job/PR-19374/2/consoleText
   shows logs from many parallel jobs and it's complete log.
   You can copy this line to find same place in these two files:
   `[2020-10-19T22:36:40.237Z] tests/python/mkl/test_bf16_operator.py::test_bf16_bn PASSED              [  2%]`
   
   Line which caused fail is:
   `[2020-10-19T22:43:56.241Z] Aborted by mxnet-bot`
   what probably means that you rerun CI and mxnet-bot just killed this session.
   In next lines you can find 
   ```
   Failed in branch Python3: MKLDNN-CPU
   Failed in branch Python3: CPU
   ```
   and if you will search for more 'Failed in branch Python3:'
   you will get `[2020-10-19T21:31:54.420Z] Failed in branch Python3: CPU TVM_OP OFF`
   meaning that TVM_OP job 1 hour before failing MKLDNN-CPU and CPU branches
   
   So summarizing the above it's some mxnet-bot issue rather than MKLDNN, caused by rerunning tests


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org