You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/06/01 22:58:26 UTC

[GitHub] [incubator-mxnet] leezu opened a new issue #18460: CI: flaky compilation

leezu opened a new issue #18460:
URL: https://github.com/apache/incubator-mxnet/issues/18460


   ## Description
   Sometimes compilation on CI fails due to compiler bugs. 
   
   ```
   [2020-06-01T20:07:22.772Z] /usr/local/bin/ccache /usr/bin/g++-7  -DDMLC_CORE_USE_CMAKE -DDMLC_LOG_FATAL_THROW=1 -DDMLC_LOG_STACK_TRACE_SIZE=0 -DDMLC_MODERN_THREAD_LOCAL=0 -DDMLC_STRICT_CXX11 -DDMLC_USE_CXX11 -DDMLC_USE_CXX11=1 -DDMLC_USE_CXX14 -DMSHADOW_INT64_TENSOR_SIZE=0 -DMSHADOW_IN_CXX11 -DMSHADOW_USE_CBLAS=0 -DMSHADOW_USE_CUDA=0 -DMSHADOW_USE_MKL=1 -DMSHADOW_USE_SSE -DMXNET_USE_BLAS_MKL=1 -DMXNET_USE_LAPACK=1 -DMXNET_USE_LIBJPEG_TURBO=0 -DMXNET_USE_OPENCV=1 -DMXNET_USE_OPENMP=1 -DMXNET_USE_OPERATOR_TUNING=1 -DMXNET_USE_SIGNAL_HANDLER=1 -DMXNET_USE_TVM_OP=1 -D__USE_XOPEN2K8 -Dmxnet_EXPORTS -I/work/mxnet/include -I/work/mxnet/src -I/work/mxnet/3rdparty/nvidia_cub -I/work/mxnet/3rdparty/tvm/nnvm/include -I/work/mxnet/3rdparty/tvm/include -I/work/mxnet/3rdparty/dmlc-core/include -I/work/mxnet/3rdparty/dlpack/include -I/work/mxnet/3rdparty/mshadow -I3rdparty/dmlc-core/include -isystem /opt/intel/mkl/include -isystem /usr/include/opencv -D_GLIBCXX_ASSERTIONS  -Wall -Wno-sign-compare -O3 -g -fopenmp -O2 -g -DNDEBUG -fPIC   -Werror -Wno-error=unused-variable --coverage -Wno-unused-parameter -Wno-unknown-pragmas -Wno-unused-local-typedefs -msse3 -mf16c -std=gnu++1z -MD -MT CMakeFiles/mxnet.dir/src/operator/instance_norm.cc.o -MF CMakeFiles/mxnet.dir/src/operator/instance_norm.cc.o.d -o CMakeFiles/mxnet.dir/src/operator/instance_norm.cc.o -c /work/mxnet/src/operator/instance_norm.cc
   
   [2020-06-01T20:07:22.772Z] /tmp/ccT4hWrG.s: Assembler messages:
   
   [2020-06-01T20:07:22.772Z] /tmp/ccT4hWrG.s:566393: Internal error in stringer at ../../gas/read.c:5521.
   
   [2020-06-01T20:07:22.772Z] Please report this bug.
   
   ```
   
   http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/mxnet-validation%2Funix-cpu/detail/PR-18455/1/pipeline/
   
   
   We may reduce the number of occurrences by switching to a compiler version with stable c++17 support on the unix tests (and only test gcc7 on centos tests)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-mxnet] leezu commented on issue #18460: CI: flaky compilation

Posted by GitBox <gi...@apache.org>.
leezu commented on issue #18460:
URL: https://github.com/apache/incubator-mxnet/issues/18460#issuecomment-657820400


   There was no change in the compilers, but possibly change in mxnet code avoids the problem. The problem wasn't frequent before, so it's hard to tell.
   
   @ChaiBapchya can you help add the `Internal error in` regex to the CI Lambda Check? Or do we have another easy way to filter all CI logs for the prevalence of this issue?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-mxnet] szha closed issue #18460: CI: flaky compilation

Posted by GitBox <gi...@apache.org>.
szha closed issue #18460:
URL: https://github.com/apache/incubator-mxnet/issues/18460


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [incubator-mxnet] szha commented on issue #18460: CI: flaky compilation

Posted by GitBox <gi...@apache.org>.
szha commented on issue #18460:
URL: https://github.com/apache/incubator-mxnet/issues/18460#issuecomment-657261339


   Is this still occurring?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org