You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bigtop.apache.org by GitBox <gi...@apache.org> on 2021/09/15 12:04:18 UTC

[GitHub] [bigtop] sekikn commented on pull request #813: Fix zeppelin build on ppc64le - JIRA BIGTOP-3560

sekikn commented on pull request #813:
URL: https://github.com/apache/bigtop/pull/813#issuecomment-919958479


   @afsanjar I've just tried the current PR and found two problems.
   
   1. I tried to create the Debian 10 image, but came across the following error. It seems that we have to ensure installing JDK precedes grpc-java.
   ```
   jenkins@bigtop1slave:~/bigtop/docker/bigtop-slaves$ ./build.sh trunk-debian-10                                      
   
   ...
   
   Step 4/6 : RUN if [ -f ~/.bash_profile ]; then . ~/.bash_profile; fi &&     apt-get clean && apt-get update &&     puppet apply -e "include bigtop_toolchain::installer" || if [ $? -ne 2 ]; then exit 1; fi                           
    ---> Running in 4b9c42c8296a                                                                                      
   Hit:1 http://deb.debian.org/debian buster InRelease                                                                
   
   ...
   
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/Exec[download grpc-java 1.28.0]/returns: executed successfully
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/File[/usr/src/grpc-java-1.28.0/grpc-java-1.28.0-add-support-for-ppc64le.patch]/ensure: defined content as '{md5}a2fb2f8169fd1d1b1c973c2e6fb0bd1d'
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/Exec[build grpc-java 1.28.0]/returns: patching file compiler/build.gradle
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/Exec[build grpc-java 1.28.0]/returns: 
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/Exec[build grpc-java 1.28.0]/returns: ERROR: JAVA_HOME is not set and no 'java' command could be found in your PATH.
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/Exec[build grpc-java 1.28.0]/returns: 
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/Exec[build grpc-java 1.28.0]/returns: Please set the JAVA_HOME variable in your environment to match the
   Notice: /Stage[main]/Bigtop_toolchain::Grpc/Exec[build grpc-java 1.28.0]/returns: location of your Java installation.
   Error: '/usr/bin/patch -p1 < grpc-java-1.28.0-add-support-for-ppc64le.patch && export LDFLAGS=-L//usr/local/protobuf-3.5.1.1/lib && export CXXFLAGS=-I//usr/local/protobuf-3.5.1.1/include && export LD_LIBRARY_PATH=//usr/local/protob
   uf-3.5.1.1/lib && cd compiler && ../gradlew java_pluginExecutable -PskipAndroid=true' returned 1 instead of one of [0]
   Error: /Stage[main]/Bigtop_toolchain::Grpc/Exec[build grpc-java 1.28.0]/returns: change from 'notrun' to ['0'] failed: '/usr/bin/patch -p1 < grpc-java-1.28.0-add-support-for-ppc64le.patch && export LDFLAGS=-L//usr/local/protobuf-3.
   5.1.1/lib && export CXXFLAGS=-I//usr/local/protobuf-3.5.1.1/include && export LD_LIBRARY_PATH=//usr/local/protobuf-3.5.1.1/lib && cd compiler && ../gradlew java_pluginExecutable -PskipAndroid=true' returned 1 instead of one of [0]
   
   ...
   
   Notice: /Stage[main]/Apt/Apt::Setting[conf-update-stamp]/File[/etc/apt/apt.conf.d/15update-stamp]/ensure: defined content as '{md5}0962d70c4ec78bbfa6f3544ae0c41974'
   Notice: /Stage[main]/Bigtop_toolchain::Jdk/Apt::Source[adoptopenjdk]/Apt::Key[Add key: 8ED17AF5D7E675EB3EE3BCE98AC3B29174885C03 from Apt::Source adoptopenjdk]/Apt_key[Add key: 8ED17AF5D7E675EB3EE3BCE98AC3B29174885C03 from Apt::Source adoptopenjdk]/ensure: created
   Notice: /Stage[main]/Bigtop_toolchain::Jdk/Apt::Source[adoptopenjdk]/Apt::Setting[list-adoptopenjdk]/File[/etc/apt/sources.list.d/adoptopenjdk.list]/ensure: defined content as '{md5}838e14e546e87e023031dc31717d86e9'
   Notice: /Stage[main]/Apt::Update/Exec[apt_update]: Triggered 'refresh' from 1 event
   Notice: /Stage[main]/Bigtop_toolchain::Jdk/Package[adoptopenjdk-8-hotspot]/ensure: created
   Notice: /Stage[last]/Bigtop_toolchain::Cleanup/Exec[remove archives]: Dependency Exec[build grpc-java 1.28.0] has failures: true
   Warning: /Stage[last]/Bigtop_toolchain::Cleanup/Exec[remove archives]: Skipping because of failed dependencies
   Warning: /Stage[last]/Bigtop_toolchain::Cleanup/Exec[clean packages]: Skipping because of failed dependencies
   Notice: Applied catalog in 5591.91 seconds
   ```
   
   2. The CentOS 7 image was successfully built, but I got the following error when building Zeppelin with it. This should be fixed by upgrading node and npm as I mentioned above.
   ```
   jenkins@bigtop1slave:~/bigtop$ docker run -it -v $PWD:/bigtop bigtop/slaves:trunk-centos-7-ppc64le 
   [root@23fed65f4b12 /]# cd bigtop
   [root@23fed65f4b12 bigtop]# ./gradlew allclean zeppelin-pkg repo
   
   ...
   
   [INFO] --- frontend-maven-plugin:1.6:npm (npm install) @ zeppelin-web ---                                                                                                                                                     [61/1976]
   [INFO] Running 'npm install --no-lockfile' in /bigtop/build/zeppelin/rpm/BUILD/zeppelin-0.9.0/zeppelin-web
   [ERROR] /bigtop/build/zeppelin/rpm/BUILD/zeppelin-0.9.0/zeppelin-web/node/node: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.20' not found (required by /bigtop/build/zeppelin/rpm/BUILD/zeppelin-0.9.0/zeppelin-web/node/node)
   [ERROR] /bigtop/build/zeppelin/rpm/BUILD/zeppelin-0.9.0/zeppelin-web/node/node: /lib64/libstdc++.so.6: version `CXXABI_1.3.9' not found (required by /bigtop/build/zeppelin/rpm/BUILD/zeppelin-0.9.0/zeppelin-web/node/node)
   [INFO] ------------------------------------------------------------------------
   [INFO] Reactor Summary for Zeppelin 0.9.0:                                                                         
   [INFO]                                                                                                             
   [INFO] Zeppelin ........................................... SUCCESS [ 18.555 s]
   
   ...
   
   [INFO] Zeppelin: Client Examples .......................... SUCCESS [  1.790 s]
   [INFO] Zeppelin: web Application .......................... FAILURE [  7.872 s]
   
   ...
   
   [INFO] ------------------------------------------------------------------------
   [INFO] BUILD FAILURE
   [INFO] ------------------------------------------------------------------------
   [INFO] Total time:  09:58 min
   [INFO] Finished at: 2021-09-15T08:54:42Z
   [INFO] ------------------------------------------------------------------------
   [ERROR] Failed to execute goal com.github.eirslett:frontend-maven-plugin:1.6:npm (npm install) on project zeppelin-web: Failed to run task: 'npm install --no-lockfile' failed. org.apache.commons.exec.ExecuteException: Process exite
   d with an error: 1 (Exit value: 1) -> [Help 1]
   ```
   
   Without the problems above, I succeeded in building Zeppelin on CentOS 8. Would you update the PR?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@bigtop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org