You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/09/17 18:19:17 UTC
[GitHub] [incubator-mxnet] DickJC123 opened a new issue #19169: Flakey cpu R test?
DickJC123 opened a new issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169
## Description
I think it's important to document non-deterministic CI failures we've run into during our PR polishing. Along that vein, I saw the following error in pipline https://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-19148/runs/2/nodes/303/steps/771/log/?start=0
```
[2020-09-17T07:57:51.701Z] Loading required package: testthat
[2020-09-17T07:57:51.956Z] v | OK F W S | Context
[2020-09-17T07:57:56.111Z] trying URL 'https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/R/data/ISBI.zip'
[2020-09-17T07:57:56.111Z] Content type 'application/zip' length 25275513 bytes (24.1 MB)
[2020-09-17T07:57:56.111Z] ==================================================
[2020-09-17T07:57:56.111Z] downloaded 24.1 MB
[2020-09-17T07:57:56.111Z]
[2020-09-17T07:57:58.622Z]
/ | 0 | Image segmentation
- | 0 1 | Image segmentation
x | 0 1 | Image segmentation [3.2 s]
[2020-09-17T07:57:58.622Z] --------------------------------------------------------------------------------
[2020-09-17T07:57:58.622Z] test_img_seg.R:157: error: UNET
[2020-09-17T07:57:58.622Z] could not find function "mx.ctx.default"
[2020-09-17T07:57:58.622Z] --------------------------------------------------------------------------------
```
A retry of the pipeline passed without this error.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-695142383
Resurfacing of error from years ago: https://github.com/apache/incubator-mxnet/issues/13439
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] kpuatamazon commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
kpuatamazon commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-696117295
I'm seeing it too in #19201 https://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-19201/runs/1/nodes/303/steps/764/log/?start=0 ironically trying to fix my flakey test.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] kpuatamazon commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
kpuatamazon commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-696117295
I'm seeing it too in #19201 https://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-19201/runs/1/nodes/303/steps/764/log/?start=0 ironically trying to fix my flakey test.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-695348105
Hitting another PR: https://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-19184/runs/3/nodes/303/steps/781/log/?start=0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 closed issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 closed issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 removed a comment on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 removed a comment on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-696183592
@thirdwing Reaching out to you as an "R Ninja" on issue https://github.com/apache/incubator-mxnet/issues/19169.
The PR here makes a (theoretically) non-functional change to the failing test UNET of test_img_seg.R. The modified test has passed CI 7 times with no error (not sure if this is enough times to draw a conclusion). Can you think of an explanation why this change might fix the problem? Could there be multiple threads or race conditions present?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-695128312
Similar failure hitting another PR:
https://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-19142/runs/7/nodes/303/steps/697/log/?start=0
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 removed a comment on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 removed a comment on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-696183592
@thirdwing Reaching out to you as an "R Ninja" on issue https://github.com/apache/incubator-mxnet/issues/19169.
The PR here makes a (theoretically) non-functional change to the failing test UNET of test_img_seg.R. The modified test has passed CI 7 times with no error (not sure if this is enough times to draw a conclusion). Can you think of an explanation why this change might fix the problem? Could there be multiple threads or race conditions present?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-696183592
@thirdwing Reaching out to you as an "R Ninja" on issue https://github.com/apache/incubator-mxnet/issues/19169.
The PR here makes a (theoretically) non-functional change to the failing test UNET of test_img_seg.R. The modified test has passed CI 7 times with no error (not sure if this is enough times to draw a conclusion). Can you think of an explanation why this change might fix the problem? Could there be multiple threads or race conditions present?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-704515521
I believe now-merged PR https://github.com/apache/incubator-mxnet/pull/19186 fixes this issue.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org
[GitHub] [incubator-mxnet] DickJC123 commented on issue #19169: Flakey cpu R test?
Posted by GitBox <gi...@apache.org>.
DickJC123 commented on issue #19169:
URL: https://github.com/apache/incubator-mxnet/issues/19169#issuecomment-696183592
@thirdwing Reaching out to you as an "R Ninja" on issue https://github.com/apache/incubator-mxnet/issues/19169.
The PR here makes a (theoretically) non-functional change to the failing test UNET of test_img_seg.R. The modified test has passed CI 7 times with no error (not sure if this is enough times to draw a conclusion). Can you think of an explanation why this change might fix the problem? Could there be multiple threads or race conditions present?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@mxnet.apache.org
For additional commands, e-mail: issues-help@mxnet.apache.org