You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/07/23 04:54:15 UTC

[GitHub] [incubator-mxnet] leezu edited a comment on issue #10988: Flaky test: test_operator_gpu.test_countsketch

leezu edited a comment on issue #10988:
URL: https://github.com/apache/incubator-mxnet/issues/10988#issuecomment-662817730


   ```
   [2020-07-23T03:30:14.821Z] tests/python/gpu/test_numpy_fallback.py::test_np_fallback_decorator PASSED [ 19%]
   [2020-07-23T03:30:16.176Z] tests/python/gpu/test_operator_gpu.py::test_countsketch FAILED           [ 20%]
   [2020-07-23T03:30:16.733Z] tests/python/gpu/test_operator_gpu.py::test_multi_sum_sq FAILED          [ 20%]
   [2020-07-23T03:30:17.657Z] tests/python/gpu/test_operator_gpu.py::test_fast_lars FAILED             [ 21%]
   [2020-07-23T03:30:18.214Z] tests/python/gpu/test_operator_gpu.py::test_batchnorm_with_type FAILED   [ 21%]
   [2020-07-23T03:30:18.770Z] tests/python/gpu/test_operator_gpu.py::test_batchnorm_versions FAILED    [ 22%]
   [2020-07-23T03:30:19.327Z] tests/python/gpu/test_operator_gpu.py::test_convolution_with_type FAILED [ 22%]
   [2020-07-23T03:30:19.327Z] tests/python/gpu/test_operator_gpu.py::test_convolution_options SKIPPED  [ 23%]
   [2020-07-23T03:30:20.248Z] tests/python/gpu/test_operator_gpu.py::test_conv_deconv_guards FAILED    [ 23%]
   [2020-07-23T03:30:20.501Z] tests/python/gpu/test_operator_gpu.py::test_convolution_large_c FAILED   [ 24%]
   [2020-07-23T03:30:21.058Z] tests/python/gpu/test_operator_gpu.py::test_deconvolution_large_c FAILED [ 24%]
   [2020-07-23T03:30:21.615Z] tests/python/gpu/test_operator_gpu.py::test_convolution_versions FAILED  [ 25%]
   [2020-07-23T03:30:21.869Z] tests/python/gpu/test_operator_gpu.py::test_pooling_nhwc_with_convention FAILED [ 25%]
   [2020-07-23T03:30:22.425Z] tests/python/gpu/test_operator_gpu.py::test_pooling_with_type FAILED     [ 26%]
   [2020-07-23T03:30:22.679Z] tests/python/gpu/test_operator_gpu.py::test_deconvolution_with_type FAILED [ 26%]
   [2020-07-23T03:30:23.236Z] tests/python/gpu/test_operator_gpu.py::test_deconvolution_options FAILED [ 27%]
   [2020-07-23T03:30:23.793Z] tests/python/gpu/test_operator_gpu.py::test_pooling_versions FAILED      [ 27%]
   [2020-07-23T03:30:24.350Z] tests/python/gpu/test_operator_gpu.py::test_flatten_slice_after_conv FAILED [ 28%]
   [2020-07-23T03:30:24.604Z] tests/python/gpu/test_operator_gpu.py::test_global_pooling FAILED        [ 28%]
   [2020-07-23T03:30:25.160Z] tests/python/gpu/test_operator_gpu.py::test_psroipooling_with_type FAILED [ 29%]
   [2020-07-23T03:30:25.717Z] tests/python/gpu/test_operator_gpu.py::test_deformable_psroipooling_with_type FAILED [ 29%]
   [2020-07-23T03:30:26.274Z] tests/python/gpu/test_operator_gpu.py::test_deformable_convolution_with_type FAILED [ 30%]
   [2020-07-23T03:30:27.195Z] tests/python/gpu/test_operator_gpu.py::test_sequence_reverse FAILED      [ 30%]
   [2020-07-23T03:30:27.195Z] tests/python/gpu/test_operator_gpu.py::test_autograd_save_memory FAILED  [ 31%]
   [2020-07-23T03:30:27.752Z] tests/python/gpu/test_operator_gpu.py::test_cuda_rtc FAILED              [ 31%]
   [2020-07-23T03:30:28.005Z] tests/python/gpu/test_operator_gpu.py::test_cross_device_autograd FAILED [ 32%]
   [2020-07-23T03:30:28.562Z] tests/python/gpu/test_operator_gpu.py::test_multi_proposal_op FAILED     [ 32%]
   [2020-07-23T03:30:28.562Z] Fatal Python error: Aborted
   [2020-07-23T03:30:28.562Z] 
   [2020-07-23T03:30:28.562Z] Current thread 0x00007f7922445740 (most recent call first):
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/util.py", line 417 in spawnv_passfds
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/semaphore_tracker.py", line 71 in ensure_running
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/semaphore_tracker.py", line 35 in getfd
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/popen_spawn_posix.py", line 40 in _launch
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/popen_fork.py", line 19 in __init__
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/popen_spawn_posix.py", line 32 in __init__
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/context.py", line 284 in _Popen
   [2020-07-23T03:30:28.562Z]   File "/usr/lib/python3.6/multiprocessing/process.py", line 105 in start
   [2020-07-23T03:30:28.562Z]   File "/work/mxnet/tests/python/gpu/test_operator_gpu.py", line 2042 in test_kernel_error_checking
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/python.py", line 167 in pytest_pyfunc_call
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in _multicall
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/python.py", line 1445 in runtest
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 134 in pytest_runtest_call
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in _multicall
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 210 in <lambda>
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 237 in from_call
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 210 in call_runtest_hook
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/flaky/flaky_pytest_plugin.py", line 129 in call_and_report
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 99 in runtestprotocol
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/runner.py", line 84 in pytest_runtest_protocol
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/flaky/flaky_pytest_plugin.py", line 92 in pytest_runtest_protocol
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in _multicall
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/main.py", line 271 in pytest_runtestloop
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in _multicall
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/main.py", line 247 in _main
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/main.py", line 197 in wrap_session
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/main.py", line 240 in pytest_cmdline_main
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/callers.py", line 187 in _multicall
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 87 in <lambda>
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/manager.py", line 93 in _hookexec
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/pluggy/hooks.py", line 286 in __call__
   [2020-07-23T03:30:28.562Z]   File "/usr/local/lib/python3.6/dist-packages/_pytest/config/__init__.py", line 93 in main
   [2020-07-23T03:30:28.562Z]   File "/usr/local/bin/pytest", line 11 in <module>
   [2020-07-23T03:30:29.483Z] /work/runtime_functions.sh: line 886:  8947 Aborted                 (core dumped) pytest -m 'serial' --durations=50 --cov-report xml:tests_gpu.xml --cov-append --verbose tests/python/gpu
   ```
   
   http://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-gpu/branches/PR-18771/runs/2/nodes/310/steps/340/log/?start=0


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org