You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@mxnet.apache.org by gi...@git.apache.org on 2017/09/22 20:25:11 UTC
[GitHub] christophebjjani opened a new issue #7998: Failing to build scalapkg with USE_DIST_KVSTORE=1 on ami-a4c7edb2
christophebjjani opened a new issue #7998: Failing to build scalapkg with USE_DIST_KVSTORE=1 on ami-a4c7edb2
URL: https://github.com/apache/incubator-mxnet/issues/7998
For bugs or installation issues, please provide the following information.
The more information you provide, the more likely people will be able to help you.
## Environment info
Operating System: Amazon Linux ami-a4c7edb2
Package used (Python/R/Scala/Julia): Scala
MXNet version: 0.11
## Error Message:
```
[INFO] ------------------------------------------------------------------------
[INFO] Building MXNet Scala Package - Core 0.11.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ mxnet-core_2.11 ---
[INFO]
[INFO] --- maven-resources-plugin:2.7:resources (default-resources) @ mxnet-core_2.11 ---
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered resources, i.e. build is platform dependent!
[INFO] skip non existing resourceDirectory /root/mxnet/scala-package/core/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.3:compile (default-compile) @ mxnet-core_2.11 ---
[INFO] No sources to compile
[INFO]
[INFO] --- maven-scala-plugin:2.15.2:compile (default) @ mxnet-core_2.11 ---
[INFO] Checking for multiple versions of scala
[WARNING] Invalid POM for ml.dmlc.mxnet:mxnet-macros_2.11:jar:0.11.0-SNAPSHOT, transitive dependencies (if any) will not be available, enable debug logging for more details
[WARNING] Expected all dependencies to require Scala version: 2.11.8
[WARNING] ml.dmlc.mxnet:mxnet-init_2.11:0.11.0-SNAPSHOT requires scala version: 2.11.8
[WARNING] ml.dmlc.mxnet:mxnet-init_2.11:0.11.0-SNAPSHOT requires scala version: 2.11.8
[WARNING] ml.dmlc.mxnet:mxnet-core_2.11:0.11.0-SNAPSHOT requires scala version: 2.11.8
[WARNING] org.scala-lang:scala-reflect:2.11.8 requires scala version: 2.11.8
[WARNING] org.scalatest:scalatest_2.11:2.2.4 requires scala version: 2.11.2
[WARNING] Multiple versions of scala libraries detected!
[INFO] includes = [**/*.java,**/*.scala,]
[INFO] excludes = []
[INFO] /root/mxnet/scala-package/core/src/main/scala:-1: info: compiling
[INFO] Compiling 49 source files to /root/mxnet/scala-package/core/target/classes at 1506111412300
[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.11.8,2.1.0)
[ERROR] terminate called after throwing an instance of 'std::length_error'
[INFO] what(): basic_string::append
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] MXNet Scala Package - Parent ....................... SUCCESS [ 3.548 s]
[INFO] MXNet Scala Package - Initializer .................. SUCCESS [ 3.788 s]
[INFO] MXNet Scala Package - Initializer Native Parent .... SUCCESS [ 0.025 s]
[INFO] MXNet Scala Package - Initializer Native Linux-x86_64 SUCCESS [ 2.509 s]
[INFO] MXNet Scala Package - Macros ....................... SUCCESS [ 5.256 s]
[INFO] MXNet Scala Package - Core ......................... FAILURE [ 3.094 s]
[INFO] MXNet Scala Package - Native Parent ................ SKIPPED
[INFO] MXNet Scala Package - Native Linux-x86_64 CPU-only . SKIPPED
[INFO] MXNet Scala Package - Examples ..................... SKIPPED
[INFO] MXNet Scala Package - Spark ML ..................... SKIPPED
[INFO] MXNet Scala Package - Full Parent .................. SKIPPED
[INFO] MXNet Scala Package - Full Linux-x86_64 CPU-only ... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 19.603 s
[INFO] Finished at: 2017-09-22T20:16:55Z
[INFO] Final Memory: 30M/754M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.scala-tools:maven-scala-plugin:2.15.2:compile (default) on project mxnet-core_2.11: wrap: org.apache.commons.exec.ExecuteException: Process exited with an error: 134(Exit value: 134) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :mxnet-core_2.11
make: *** [scalapkg] Error 1
```
## Minimum reproducible example
I am building mxnet from source.
Here's a shell script to reproduce on Amazon Linux ami-a4c7edb2:
```
#!/usr/bin/env bash
sudo su
yum update
#install OpenBLAS
yum groupinstall 'Development Tools'
yum install openblas-devel.x86_64
#install jdk8
yum install java-1.8.0-openjdk-devel.x86_64
unlink /etc/alternatives/java
ln -s /usr/lib/jvm/jre-1.8.0-openjdk.x86_64/bin/java /etc/alternatives/java
unlink /etc/alternatives/jre_openjdk
ln -s /usr/lib/jvm/jre-1.8.0-openjdk.x86_64/ /etc/alternatives/jre_openjdk
unlink /etc/alternatives/jre
ln -s /usr/lib/jvm/jre-1.8.0-openjdk.x86_64 /etc/alternatives/jre
#install OpenCV
yum install cmake git gtk2-devel pkgconfig numpy ffmpeg
git clone https://github.com/opencv/opencv.git
cd opencv && mkdir build && cd build
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/usr -DLIB_SUFFIX=64 ..
make -j $(nproc)
make install
#cp /home/ec2-user/opencv/build/unix-install/opencv.pc /usr/share/pkgconfig
#echo "/usr/lib" >>/etc/ld.so.conf.d/libopencv_dnn.conf
#ldconfig
#install mxnet
cd ~
git clone --recursive https://github.com/apache/incubator-mxnet.git mxnet --branch 0.11.0
cd mxnet && cp make/config.mk .
echo "USE_CUDA=0" >>config.mk
echo "USE_CUDNN=0" >>config.mk
echo "USE_BLAS=openblas" >>config.mk
echo "ADD_CFLAGS += -I/usr/include/openblas" >>config.mk
echo "ADD_LDFLAGS += -lopencv_core -lopencv_imgproc -lopencv_imgcodecs" >>config.mk
echo "USE_OPENCV=1" >>config.mk
echo "USE_DIST_KVSTORE=1" >>config.mk
make -j $(nproc)
#install maven
cd ~
wget http://mirrors.koehn.com/apache/maven/maven-3/3.5.0/binaries/apache-maven-3.5.0-bin.tar.gz
tar xzvf apache-maven-3.5.0-bin.tar.gz
mv apache-maven-3.5.0 /opt/
echo "export PATH=/opt/apache-maven-3.5.0/bin:$PATH" >>/etc/profile.d/mvn.sh
source /etc/profile.d/mvn.sh
mvn -v
#install mxnet scala library
cd ~/mxnet/
make -j $(nproc) scalapkg
```
## What have you tried to solve it?
The error is too generic and has to do with some out of bound index in a string.
If I build mxnet without the USE_DIST_KVSTORE=1 flag however, building scalapkg succeeded without any issues.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services