You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by GitBox <gi...@apache.org> on 2020/01/17 01:07:18 UTC
[GitHub] [incubator-mxnet] ChaokunChang opened a new issue #17299: Error
when building mxnet with USE_DIST_KVSTORE
ChaokunChang opened a new issue #17299: Error when building mxnet with USE_DIST_KVSTORE
URL: https://github.com/apache/incubator-mxnet/issues/17299
## Description
(A clear and concise description of what the bug is.)
I am building MxNet from source code, following the steps:
1. git clone --recursive https://github.com/ChaokunChang/incubator-mxnet byteps-backend
2. cd byteps-backend; mkdir build; cd build;
3. cmake -DUSE_CUDA=1 -DUSE_MKLDNN=1 -DCMAKE_EXPORT_COMPILE_COMMANDS=1 -DBUILD_CYTHON_MODULES=1 -DUSE_DIST_KVSTORE=1 ..
4. DEBUG=1 make -j48
Then I met an error like this:
### Error Message
[ 1%] Built target libomp-needed-headers [5/1878]
[ 2%] Built target dmlc
[ 1%] Built target sample_lib
[ 3%] Performing build step for 'ZMQ'
[ 4%] Built target subgraph_lib
make[3]: *** No targets specified and no makefile found. Stop.
3rdparty/ps-lite/CMakeFiles/ZMQ.dir/build.make:111: recipe for target 'external/ZMQ-prefix/src/ZMQ-stamp/ZMQ-build' failed
make[2]: *** [external/ZMQ-prefix/src/ZMQ-stamp/ZMQ-build] Error 2
Scanning dependencies of target gtest_main
CMakeFiles/Makefile2:2196: recipe for target '3rdparty/ps-lite/CMakeFiles/ZMQ.dir/all' failed
make[1]: *** [3rdparty/ps-lite/CMakeFiles/ZMQ.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 9%] Built target dnnl_common
[ 10%] Building CXX object 3rdparty/googletest/googletest/CMakeFiles/gtest_main.dir/src/gtest_main.cc.o
[ 14%] Built target omp
In file included from /home/ubuntu/byteps-backend/build/3rdparty/ps-lite/src/meta.pb.cc:4:0:
/home/ubuntu/byteps-backend/build/3rdparty/ps-lite/src/meta.pb.h:10:10: fatal error: google/protobuf/port_def.inc: No such file or directory
#include <google/protobuf/port_def.inc>
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
3rdparty/ps-lite/CMakeFiles/pslite.dir/build.make:113: recipe for target '3rdparty/ps-lite/CMakeFiles/pslite.dir/src/meta.pb.cc.o' failed
make[2]: *** [3rdparty/ps-lite/CMakeFiles/pslite.dir/src/meta.pb.cc.o] Error 1
make[2]: *** Waiting for unfinished jobs....
[ 32%] Built target dnnl_cpu
In file included from /home/ubuntu/byteps-backend/3rdparty/ps-lite/src/van.cc:14:0:
/home/ubuntu/byteps-backend/build/3rdparty/ps-lite/src/./meta.pb.h:10:10: fatal error: google/protobuf/port_def.inc: No such file or directory
#include <google/protobuf/port_def.inc>
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
3rdparty/ps-lite/CMakeFiles/pslite.dir/build.make:100: recipe for target '3rdparty/ps-lite/CMakeFiles/pslite.dir/src/van.cc.o' failed
make[2]: *** [3rdparty/ps-lite/CMakeFiles/pslite.dir/src/van.cc.o] Error 1
CMakeFiles/Makefile2:2159: recipe for target '3rdparty/ps-lite/CMakeFiles/pslite.dir/all' failed
make[1]: *** [3rdparty/ps-lite/CMakeFiles/pslite.dir/all] Error 2
[ 32%] Linking CXX static library ../../../lib/libgtest_main.a
[ 32%] Built target gtest_main
[ 95%] Built target mxnet_static
Makefile:140: recipe for target 'all' failed
## To Reproduce
The code is from https://github.com/ChaokunChang/incubator-mxnet; branck byteps-backend. The [code change](https://github.com/apache/incubator-mxnet/compare/master...ChaokunChang:byteps-backend) doesn't include settings related to compile.
### Steps to reproduce
## What have you tried to solve it?
1. I have tried with ninja (add _GNinja when cmake), but with the same error.
2. Everything will be ok if I remove the -DUSE_DIST_KVSTORE in cmake-step.
## Environment
We recommend using our script for collecting the diagnositc information. Run the following command and paste the outputs below:
```
curl --retry 10 -s https://raw.githubusercontent.com/dmlc/gluon-nlp/master/tools/diagnose.py | python
# paste outputs here
----------Python Info----------
Version : 3.6.6
Compiler : GCC 7.2.0
Build : ('default', 'Jun 28 2018 17:14:51')
Arch : ('64bit', '')
------------Pip Info-----------
Version : 19.3.1
Directory : /home/ubuntu/anaconda3/lib/python3.6/site-packages/pip
----------MXNet Info-----------
No MXNet installed.
----------System Info----------
Platform : Linux-4.15.0-1054-aws-x86_64-with-debian-buster-sid
system : Linux
node : ip-172-31-39-16
release : 4.15.0-1054-aws
version : #56-Ubuntu SMP Thu Nov 7 16:15:59 UTC 2019
----------Hardware Info----------
machine : x86_64
processor : x86_64
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 8
On-line CPU(s) list: 0-7
Thread(s) per core: 2
Core(s) per socket: 4
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 79
Model name: Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
Stepping: 1
CPU MHz: 2724.723
CPU max MHz: 3000.0000
CPU min MHz: 1200.0000
BogoMIPS: 4600.12
Hypervisor vendor: Xen
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 46080K
NUMA node0 CPU(s): 0-7
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx xsaveopt
----------Network Test----------
Setting timeout: 10
Timing for MXNet: https://github.com/apache/incubator-mxnet, DNS: 0.0028 sec, LOAD: 0.3791 sec.
Timing for GluonNLP GitHub: https://github.com/dmlc/gluon-nlp, DNS: 0.0005 sec, LOAD: 0.3934 sec.
Timing for GluonNLP: http://gluon-nlp.mxnet.io, DNS: 0.0008 sec, LOAD: 0.0229 sec.
Timing for D2L: http://d2l.ai, DNS: 0.0005 sec, LOAD: 0.0032 sec.
Timing for D2L (zh-cn): http://zh.d2l.ai, DNS: 0.0002 sec, LOAD: 0.1704 sec.
Timing for FashionMNIST: https://repo.mxnet.io/gluon/dataset/fashion-mnist/train-labels-idx1-ubyte.gz, DNS: 0.0003 sec, LOAD: 0.0171 sec.
Timing for PYPI: https://pypi.python.org/pypi/pip, DNS: 0.0005 sec, LOAD: 0.0531 sec.
Timing for Conda: https://repo.continuum.io/pkgs/free/, DNS: 0.0002 sec, LOAD: 0.0235 sec.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services