You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/08/04 06:11:14 UTC
[GitHub] [incubator-mxnet] ptrendx opened a new issue #18809: test_gluon_dirichlet intermittently fails on CPU
ptrendx opened a new issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809
## Description
test_gluon_probability_v2.py::test_gluon_dirichlet fails with some seeds
## Occurrences
http://jenkins.mxnet-ci.amazon-ml.com/job/mxnet-validation/job/windows-gpu/job/PR-18622/23/display/redirect
## What have you tried to solve it?
1. Tried the nightly build (to eliminate the impact of the PR which showed the failure in CI) with the same seed:
```
MXNET_TEST_SEED=553606704 pytest -v -s test_gluon_probability_v2.py::test_gluon_dirichlet
```
Results in error:
```
E AssertionError:
E Items are not equal:
E Error nan exceeds tolerance rtol=1.000000e-03, atol=1.000000e-04.
E
E ACTUAL: array(nan, dtype=float32)
E DESIRED: 142.17020331099576
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] xidulu commented on issue #18809: test_gluon_dirichlet intermittently fails on CPU
Posted by GitBox <gi...@apache.org>.
xidulu commented on issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809#issuecomment-668400362
The
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] pengzhao-intel commented on issue #18809: test_gluon_dirichlet intermittently fails on CPU
Posted by GitBox <gi...@apache.org>.
pengzhao-intel commented on issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809#issuecomment-666012944
> @pengzhao-intel
> The flakiness is not related to MKLDNN, however the patch fails on the MKL build:
> https://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-18817/1/pipeline/284
maybe re-run can resolve the issue since I didn't see related problem till now.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] szha closed issue #18809: test_gluon_dirichlet intermittently fails on CPU
Posted by GitBox <gi...@apache.org>.
szha closed issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] xidulu commented on issue #18809: test_gluon_dirichlet intermittently fails on CPU
Posted by GitBox <gi...@apache.org>.
xidulu commented on issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809#issuecomment-665512729
@pengzhao-intel
The flakiness is not related to MKLDNN, however the patch fails on the MKL build:
https://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-18817/1/pipeline/284
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] xidulu edited a comment on issue #18809: Gluon probability flaky tests
Posted by GitBox <gi...@apache.org>.
xidulu edited a comment on issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809#issuecomment-668400362
@ptrendx
Thanks for the comment, I believe the cause lies in the computation of NB's variance: p * r / (1 - p) ^ 2, which could extremely large when p -> 1. I will create a patch to restrict the range of p.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] ptrendx commented on issue #18809: test_gluon_dirichlet intermittently fails on CPU
Posted by GitBox <gi...@apache.org>.
ptrendx commented on issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809#issuecomment-665152367
@xidulu FYI
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-mxnet] xidulu commented on issue #18809: test_gluon_dirichlet intermittently fails on CPU
Posted by GitBox <gi...@apache.org>.
xidulu commented on issue #18809:
URL: https://github.com/apache/incubator-mxnet/issues/18809#issuecomment-665375471
@ptrendx
Thanks for pointing out, looking into it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org