You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/04/10 18:55:56 UTC
[GitHub] [incubator-mxnet] access2rohit opened a new pull request #18021:
fix nightly imagenet_inference
access2rohit opened a new pull request #18021: fix nightly imagenet_inference
URL: https://github.com/apache/incubator-mxnet/pull/18021
## Description ##
updating stash regex and copy command to fix nightly imagenet_inference.
currently failing
http://jenkins.mxnet-ci.amazon-ml.com/blue/organizations/jenkins/NightlyTestsForBinaries/detail/master/653/pipeline
## Checklist ##
### Essentials ###
Please feel free to remove inapplicable items for your PR.
- [x] Changes are complete (i.e. I finished coding on this PR)
- [x] To the best of my knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change
### testing ###
Test Script for checking stashing regex
```
#!/bin/bash
set +e
libs="build/libmxnet.so, build/3rdparty/tvm/libtvm_runtime.so, build/libtvmop.so, build/tvmop.conf, build/libcustomop_lib.so, build/libcustomop_gpu_lib.so, build/libsubgraph_lib.so, build/3rdparty/openmp/runtime/src/libomp.so, build/cpp-package/example/**"
name=gpu
echo "Packing ${libs} into ${name}"
for i in $(echo ${libs} | sed -e 's/,/ /g');
do md5sum $i;
ls -lh $i;
done
```
output:
```
Packing build/libmxnet.so, build/3rdparty/tvm/libtvm_runtime.so, build/libtvmop.so, build/tvmop.conf, build/libcustomop_lib.so, build/libcustomop_gpu_lib.so, build/libsubgraph_lib.so, build/3rdparty/openmp/runtime/src/libomp.so, build/cpp-package/example/** into gpu
0f4b8057183f835fafb7f4d9f4cf4af4 build/libmxnet.so
-rwxr-xr-x 1 ubuntu ubuntu 3.3G Apr 10 17:27 build/libmxnet.so
b723b02fb186faa30b0e81135df91207 build/3rdparty/tvm/libtvm_runtime.so
-rwxr-xr-x 1 ubuntu ubuntu 17M Apr 10 17:14 build/3rdparty/tvm/libtvm_runtime.so
4bce4ebd6a677302ac5f4dd159b9a4a7 build/libtvmop.so
-rwxr-xr-x 1 ubuntu ubuntu 3.4M Apr 10 17:29 build/libtvmop.so
d148f8aa3671549dddbc1a45eb42d386 build/tvmop.conf
-rw-r--r-- 1 ubuntu ubuntu 111 Apr 10 17:29 build/tvmop.conf
5692c86029a195d884ef7ceeeeeb74c7 build/libcustomop_lib.so
-rwxr-xr-x 1 ubuntu ubuntu 2.0M Apr 10 17:06 build/libcustomop_lib.so
e7be10c39f82abb3cbed2167ad941704 build/libcustomop_gpu_lib.so
-rwxr-xr-x 1 ubuntu ubuntu 2.9M Apr 10 17:14 build/libcustomop_gpu_lib.so
17e0775e94666649564be59a1a9b6aca build/libsubgraph_lib.so
-rwxr-xr-x 1 ubuntu ubuntu 2.1M Apr 10 17:06 build/libsubgraph_lib.so
ca90464b511b1327f1627282e5c5787c build/3rdparty/openmp/runtime/src/libomp.so
-rwxr-xr-x 1 ubuntu ubuntu 4.8M Apr 10 17:14 build/3rdparty/openmp/runtime/src/libomp.so
393fb9698fbc7026f50fd9ffede4e478 build/cpp-package/example/alexnet
-rwxr-xr-x 1 ubuntu ubuntu 2.6M Apr 10 17:29 build/cpp-package/example/alexnet
7e9c8cb37d06530e33393241defed47d build/cpp-package/example/alexnet.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/alexnet.d
f95398ec2a76b9ab8a8667bbef109e8a build/cpp-package/example/charRNN
-rwxr-xr-x 1 ubuntu ubuntu 3.3M Apr 10 17:29 build/cpp-package/example/charRNN
3691fb373f10adc4962cadd8aff63bfb build/cpp-package/example/charRNN.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/charRNN.d
md5sum: build/cpp-package/example/CMakeFiles: Is a directory
total 44K
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 alexnet.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 charRNN.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 googlenet.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 inception_bn.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 lenet.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 lenet_with_mxdataiter.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 mlp_cpu.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 mlp.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 mlp_gpu.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 resnet.dir
drwxr-xr-x 2 ubuntu ubuntu 4.0K Apr 10 17:29 test_regress_label.dir
8758f8e56acc5af39d915a599171a6c6 build/cpp-package/example/cmake_install.cmake
-rw-r--r-- 1 ubuntu ubuntu 1.2K Apr 10 17:06 build/cpp-package/example/cmake_install.cmake
e4a473241f428defa8d66a961c5057d3 build/cpp-package/example/CTestTestfile.cmake
-rw-r--r-- 1 ubuntu ubuntu 275 Apr 10 17:06 build/cpp-package/example/CTestTestfile.cmake
565a6711b2b9a2801bae576b3c29b2ec build/cpp-package/example/googlenet
-rwxr-xr-x 1 ubuntu ubuntu 2.4M Apr 10 17:29 build/cpp-package/example/googlenet
f00234321ef8c68a65bcd71f795778fb build/cpp-package/example/googlenet.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/googlenet.d
100a4613d6d962b20c0ab95961e21d8d build/cpp-package/example/imagenet_inference.d
-rw-r--r-- 1 ubuntu ubuntu 4.2K Apr 10 16:55 build/cpp-package/example/imagenet_inference.d
b656e233f145e49292dd17ad77c80512 build/cpp-package/example/inception_bn
-rwxr-xr-x 1 ubuntu ubuntu 2.6M Apr 10 17:29 build/cpp-package/example/inception_bn
2b752442d77874241d707494fa5f3b07 build/cpp-package/example/inception_bn.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/inception_bn.d
md5sum: build/cpp-package/example/inference: Is a directory
total 2.6M
drwxr-xr-x 3 ubuntu ubuntu 4.0K Apr 10 17:06 CMakeFiles
-rw-r--r-- 1 ubuntu ubuntu 1.2K Apr 10 17:06 cmake_install.cmake
-rw-r--r-- 1 ubuntu ubuntu 295 Apr 10 17:06 CTestTestfile.cmake
-rwxr-xr-x 1 ubuntu ubuntu 2.6M Apr 10 17:29 imagenet_inference
bf39e693437e912f0676bb07c99cce0b build/cpp-package/example/lenet
-rwxr-xr-x 1 ubuntu ubuntu 2.3M Apr 10 17:29 build/cpp-package/example/lenet
f77677d6ec1f94d3824aeab17b8b1f0a build/cpp-package/example/lenet.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/lenet.d
712d042e6b02a4cc11b448537932f02b build/cpp-package/example/lenet_with_mxdataiter
-rwxr-xr-x 1 ubuntu ubuntu 2.3M Apr 10 17:29 build/cpp-package/example/lenet_with_mxdataiter
bf943ba2304e1f8632ce55e9b00d650a build/cpp-package/example/lenet_with_mxdataiter.d
-rw-r--r-- 1 ubuntu ubuntu 3.0K Apr 10 16:55 build/cpp-package/example/lenet_with_mxdataiter.d
2c4d488522a5261d62f0ac8c8f85c8b5 build/cpp-package/example/mlp
-rwxr-xr-x 1 ubuntu ubuntu 1.8M Apr 10 17:29 build/cpp-package/example/mlp
a5982459a5aa367aca468d72a93f3269 build/cpp-package/example/mlp_cpu
-rwxr-xr-x 1 ubuntu ubuntu 2.2M Apr 10 17:29 build/cpp-package/example/mlp_cpu
15c56903c06bbe2e5ab60a10d26503e1 build/cpp-package/example/mlp_cpu.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp_cpu.d
801544f53affda6b5ede76629433843a build/cpp-package/example/mlp_csv.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp_csv.d
b476a4ad0e8b41d200305aedf444a426 build/cpp-package/example/mlp.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp.d
3c4950101957e5464ecfe8201c59758d build/cpp-package/example/mlp_gpu
-rwxr-xr-x 1 ubuntu ubuntu 2.3M Apr 10 17:29 build/cpp-package/example/mlp_gpu
1590eb64d73d37e538d466823c14a608 build/cpp-package/example/mlp_gpu.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/mlp_gpu.d
7ebe135e0c9e2336f5c651d19016888e build/cpp-package/example/resnet
-rwxr-xr-x 1 ubuntu ubuntu 2.5M Apr 10 17:29 build/cpp-package/example/resnet
f8e9e35c6c409ee23125d3229816747e build/cpp-package/example/resnet.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/resnet.d
b6e28ed451d6cc451aac3b4e59ca7a1c build/cpp-package/example/sentiment_analysis_rnn.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/sentiment_analysis_rnn.d
2c1aec26bebabab95b3d0f191c711185 build/cpp-package/example/test_kvstore.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_kvstore.d
2a96e01d8584c2270bb4ac0e1d3c3c96 build/cpp-package/example/test_ndarray_copy.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_ndarray_copy.d
a3bdd1047ad73bb2cf00a90c6a22b9f3 build/cpp-package/example/test_optimizer.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_optimizer.d
2b20348372f5a9547e3a8e3dfe7c89b3 build/cpp-package/example/test_regress_label
-rwxr-xr-x 1 ubuntu ubuntu 1.7M Apr 10 17:29 build/cpp-package/example/test_regress_label
f5843ec9eec8f3f8e808c04be528309b build/cpp-package/example/test_regress_label.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_regress_label.d
261c65f19ab1a232f391f00ec8defdbf build/cpp-package/example/test_score.d
-rw-r--r-- 1 ubuntu ubuntu 2.9K Apr 10 16:55 build/cpp-package/example/test_score.d
```
build command:
```
ci/build.py --docker-registry mxnetci --platform ubuntu_build_cuda --docker-build-retries 3 --shm-size 500m /work/runtime_functions.sh build_ubuntu_gpu_mkldnn
```
test command:
```
ci/build.py --docker-registry mxnetci --nvidiadocker --platform ubuntu_nightly_gpu --docker-build-retries 3 --shm-size 500m /work/runtime_functions.sh nightly_test_imagenet_inference
```
output:
```
+ echo 'Skipped INT8 test because mkldnn was not found which is required for running inference with quantized models.'
2020-04-10 18:51:19,371 - root - INFO - Waiting for status of container a0118a731b5e for 600 s.
2020-04-10 18:51:19,553 - root - INFO - Container exit status: {'Error': None, 'StatusCode': 0}
2020-04-10 18:51:19,554 - root - INFO - Container exited with success 👍
2020-04-10 18:51:19,554 - root - INFO - Executed command for reproduction:
ci/build.py --docker-registry mxnetci --nvidiadocker --platform ubuntu_nightly_gpu --docker-build-retries 3 --shm-size 500m /work/runtime_functions.sh nightly_test_imagenet_inference
2020-04-10 18:51:19,554 - root - INFO - Stopping container: a0118a731b5e
2020-04-10 18:51:19,558 - root - INFO - Removing container: a0118a731b5e
```
## Comments ##
- If this change is a backward incompatible change, why must this change be made.
- Interesting edge cases to note here
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] access2rohit commented on issue #18021: fix
nightly imagenet_inference
Posted by GitBox <gi...@apache.org>.
access2rohit commented on issue #18021: fix nightly imagenet_inference
URL: https://github.com/apache/incubator-mxnet/pull/18021#issuecomment-612257854
@mxnet-label-bot update [pr-awaiting-merge]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] leezu merged pull request #18021: fix nightly
imagenet_inference
Posted by GitBox <gi...@apache.org>.
leezu merged pull request #18021: fix nightly imagenet_inference
URL: https://github.com/apache/incubator-mxnet/pull/18021
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] access2rohit commented on issue #18021: fix
nightly imagenet_inference
Posted by GitBox <gi...@apache.org>.
access2rohit commented on issue #18021: fix nightly imagenet_inference
URL: https://github.com/apache/incubator-mxnet/pull/18021#issuecomment-612170964
@leezu PR is ready for review
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] access2rohit commented on issue #18021: fix
nightly imagenet_inference
Posted by GitBox <gi...@apache.org>.
access2rohit commented on issue #18021: fix nightly imagenet_inference
URL: https://github.com/apache/incubator-mxnet/pull/18021#issuecomment-612170814
@mxnet-label-bot add [pr-awaiting-review]
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [incubator-mxnet] mxnet-bot commented on issue #18021: fix nightly
imagenet_inference
Posted by GitBox <gi...@apache.org>.
mxnet-bot commented on issue #18021: fix nightly imagenet_inference
URL: https://github.com/apache/incubator-mxnet/pull/18021#issuecomment-612169780
Hey @access2rohit , Thanks for submitting the PR
All tests are already queued to run once. If tests fail, you can trigger one or more tests again with the following commands:
- To trigger all jobs: @mxnet-bot run ci [all]
- To trigger specific jobs: @mxnet-bot run ci [job1, job2]
***
**CI supported jobs**: [edge, sanity, miscellaneous, website, windows-cpu, clang, centos-cpu, centos-gpu, unix-cpu, windows-gpu, unix-gpu]
***
_Note_:
Only following 3 categories can trigger CI :PR Author, MXNet Committer, Jenkins Admin.
All CI tests must pass before the PR can be merged.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services