You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Yuqi Gu (Jira)" <ji...@apache.org> on 2022/12/15 07:50:00 UTC
[jira] [Updated] (BIGTOP-3893) Fix Hadoop3.3.4 build issues on ppc64le
[ https://issues.apache.org/jira/browse/BIGTOP-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuqi Gu updated BIGTOP-3893:
----------------------------
Description:
In Haddop YARN CSI, it depends on protobuf-3.6.1 and grpc-java 1.26.0.
But there is no pre-built binary of protobuf-3.6.1 and grpc-java-1.26.0 for ppc64le.
It's needed to build protobuf-3.6.1 and grpc-java Binaries in Bigtop toolchain:
{code:java}
[INFO] Apache Hadoop YARN CSI ............................. FAILURE [ 0.552 s
[ERROR] Failed to execute goal org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.1:compile (default) on project hadoop-yarn-csi: Missing:
[ERROR] ----------
[ERROR] 1) com.google.protobuf:protoc:exe:linux-ppcle_64:3.6.1
[ERROR]
[ERROR] Try downloading the file manually from the project website.
[ERROR]
[ERROR] Then, install it using the command:
[ERROR] mvn install:install-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=3.6.1 -Dclassifier=linux-ppcle_64 -Dpackagin g=exe -Dfile=/path/to/file
[ERROR]
[ERROR] Alternatively, if you host your own repository you can deploy the file there:
[ERROR] mvn deploy:deploy-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=3.6.1 -Dclassifier=linux-ppcle_64 -Dpackaging= exe -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR] Path to dependency:
[ERROR] 1) org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4
[ERROR] 2) com.google.protobuf:protoc:exe:linux-ppcle_64:3.6.1
[ERROR]
[ERROR] ----------
[ERROR] 1 required artifact is missing.
[ERROR]
[ERROR] for artifact:
[ERROR] org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4
[ERROR]
[ERROR] from the specified remote repositories:
[ERROR] apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots, releases=true, snapshots=true),
[ERROR] repository.jboss.org (https://repository.jboss.org/nexus/content/groups/public/, releases=true, snapshots=false),
[ERROR] central (https://repo.maven.apache.org/maven2, releases=true, snapshots=false)
[ERROR]
############################################################################################################################################################################################################################################################
[ERROR] ----------
[ERROR] 1) io.grpc:protoc-gen-grpc-java:exe:linux-ppcle_64:1.26.0
[ERROR]
[ERROR] Try downloading the file manually from the project website.
[ERROR]
[ERROR] Then, install it using the command:
[ERROR] mvn install:install-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.26.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file
[ERROR]
[ERROR] Alternatively, if you host your own repository you can deploy the file there:
[ERROR] mvn deploy:deploy-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.26.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR] Path to dependency:
[ERROR] 1) org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4
[ERROR] 2) io.grpc:protoc-gen-grpc-java:exe:linux-ppcle_64:1.26.0
{code}
was:
In Haddop YARN CSI, it depends on protobuf-3.6.1 and grpc-java 1.26.0.
But there is no pre-built binary of protobuf-3.6.1 and grpc-java-1.26.0 for ppc64le.
It's needed to build protobuf-3.6.1 and grpc-java Binaries in Bigtop toolchain.
> Fix Hadoop3.3.4 build issues on ppc64le
> ---------------------------------------
>
> Key: BIGTOP-3893
> URL: https://issues.apache.org/jira/browse/BIGTOP-3893
> Project: Bigtop
> Issue Type: Sub-task
> Reporter: Yuqi Gu
> Assignee: Yuqi Gu
> Priority: Major
>
> In Haddop YARN CSI, it depends on protobuf-3.6.1 and grpc-java 1.26.0.
> But there is no pre-built binary of protobuf-3.6.1 and grpc-java-1.26.0 for ppc64le.
> It's needed to build protobuf-3.6.1 and grpc-java Binaries in Bigtop toolchain:
> {code:java}
> [INFO] Apache Hadoop YARN CSI ............................. FAILURE [ 0.552 s
> [ERROR] Failed to execute goal org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.1:compile (default) on project hadoop-yarn-csi: Missing:
> [ERROR] ----------
> [ERROR] 1) com.google.protobuf:protoc:exe:linux-ppcle_64:3.6.1
> [ERROR]
> [ERROR] Try downloading the file manually from the project website.
> [ERROR]
> [ERROR] Then, install it using the command:
> [ERROR] mvn install:install-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=3.6.1 -Dclassifier=linux-ppcle_64 -Dpackagin g=exe -Dfile=/path/to/file
> [ERROR]
> [ERROR] Alternatively, if you host your own repository you can deploy the file there:
> [ERROR] mvn deploy:deploy-file -DgroupId=com.google.protobuf -DartifactId=protoc -Dversion=3.6.1 -Dclassifier=linux-ppcle_64 -Dpackaging= exe -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> [ERROR]
> [ERROR] Path to dependency:
> [ERROR] 1) org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4
> [ERROR] 2) com.google.protobuf:protoc:exe:linux-ppcle_64:3.6.1
> [ERROR]
> [ERROR] ----------
> [ERROR] 1 required artifact is missing.
> [ERROR]
> [ERROR] for artifact:
> [ERROR] org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4
> [ERROR]
> [ERROR] from the specified remote repositories:
> [ERROR] apache.snapshots.https (https://repository.apache.org/content/repositories/snapshots, releases=true, snapshots=true),
> [ERROR] repository.jboss.org (https://repository.jboss.org/nexus/content/groups/public/, releases=true, snapshots=false),
> [ERROR] central (https://repo.maven.apache.org/maven2, releases=true, snapshots=false)
> [ERROR]
> ############################################################################################################################################################################################################################################################
> [ERROR] ----------
> [ERROR] 1) io.grpc:protoc-gen-grpc-java:exe:linux-ppcle_64:1.26.0
> [ERROR]
> [ERROR] Try downloading the file manually from the project website.
> [ERROR]
> [ERROR] Then, install it using the command:
> [ERROR] mvn install:install-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.26.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file
> [ERROR]
> [ERROR] Alternatively, if you host your own repository you can deploy the file there:
> [ERROR] mvn deploy:deploy-file -DgroupId=io.grpc -DartifactId=protoc-gen-grpc-java -Dversion=1.26.0 -Dclassifier=linux-ppcle_64 -Dpackaging=exe -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
> [ERROR]
> [ERROR] Path to dependency:
> [ERROR] 1) org.apache.hadoop:hadoop-yarn-csi:jar:3.3.4
> [ERROR] 2) io.grpc:protoc-gen-grpc-java:exe:linux-ppcle_64:1.26.0
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)