You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "wangxiaopeng0329 (Jira)" <ji...@apache.org> on 2025/06/18 00:59:00 UTC
[jira] [Updated] (HUDI-9522) The build is interrupted due to jars conflict on hudi 0.15.0 and spark3.5
[ https://issues.apache.org/jira/browse/HUDI-9522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
wangxiaopeng0329 updated HUDI-9522:
-----------------------------------
Summary: The build is interrupted due to jars conflict on hudi 0.15.0 and spark3.5 (was: The grpc-api versions conflict is reported based on hudi 0.15.0 and spark3.5 build task)
> The build is interrupted due to jars conflict on hudi 0.15.0 and spark3.5
> -------------------------------------------------------------------------
>
> Key: HUDI-9522
> URL: https://issues.apache.org/jira/browse/HUDI-9522
> Project: Apache Hudi
> Issue Type: Bug
> Components: compile
> Reporter: wangxiaopeng0329
> Priority: Blocker
> Fix For: 0.15.0
>
>
>
> The grpc-api versions conflict is reported when build task is executed using{color:#FF0000} hudi 0.15.0 and spark3.5{color}. The following modules report error messages with the same cause:
> {code:java}
> hudi-cli/pom.xml
> hudi-examples/hudi-examples-spark/pom.xml
> hudi-kafka-connect/pom.xml
> packaging/hudi-cli-bundle/pom.xml
> packaging/hudi-kafka-connect-bundle/pom.xml
> packaging/hudi-utilities-bundle/pom.xml {code}
> The command and error information is as follows:
>
> {code:java}
> mvn clean install -DskipTests=true -P spark3.5,scala-2.12 {code}
>
> {code:java}
> [INFO] Reactor Summary for Hudi 0.15.0:
> [INFO]
> [INFO] Hudi ............................................... SUCCESS [ 1.063 s]
> [INFO] hudi-tests-common .................................. SUCCESS [ 1.906 s]
> [INFO] hudi-io ............................................ SUCCESS [ 3.299 s]
> [INFO] hudi-common ........................................ SUCCESS [ 11.121 s]
> [INFO] hudi-hadoop-common ................................. SUCCESS [ 4.640 s]
> [INFO] hudi-hadoop-mr ..................................... SUCCESS [ 3.545 s]
> [INFO] hudi-sync-common ................................... SUCCESS [ 1.379 s]
> [INFO] hudi-hive-sync ..................................... SUCCESS [ 4.065 s]
> [INFO] hudi-aws ........................................... SUCCESS [ 3.459 s]
> [INFO] hudi-timeline-service .............................. SUCCESS [ 1.860 s]
> [INFO] hudi-client ........................................ SUCCESS [ 0.053 s]
> [INFO] hudi-client-common ................................. SUCCESS [ 7.124 s]
> [INFO] hudi-spark-client .................................. SUCCESS [ 19.440 s]
> [INFO] hudi-spark-datasource .............................. SUCCESS [ 0.045 s]
> [INFO] hudi-spark-common_2.12 ............................. SUCCESS [ 16.776 s]
> [INFO] hudi-spark3-common ................................. SUCCESS [ 6.682 s]
> [INFO] hudi-spark3.2plus-common ........................... SUCCESS [ 7.627 s]
> [INFO] hudi-spark3.5.x_2.12 ............................... SUCCESS [ 12.461 s]
> [INFO] hudi-java-client ................................... SUCCESS [ 3.491 s]
> [INFO] hudi-spark_2.12 .................................... SUCCESS [ 28.172 s]
> [INFO] hudi-gcp ........................................... SUCCESS [ 1.798 s]
> [INFO] hudi-utilities_2.12 ................................ SUCCESS [ 9.899 s]
> [INFO] hudi-utilities-bundle_2.12 ......................... FAILURE [ 0.064 s]
> [INFO] hudi-cli ........................................... SKIPPED
> [INFO] hudi-flink-client .................................. SKIPPED
> [INFO] hudi-datahub-sync .................................. SKIPPED
> [INFO] hudi-adb-sync ...................................... SKIPPED
> [INFO] hudi-sync .......................................... SKIPPED
> [INFO] hudi-hadoop-mr-bundle .............................. SKIPPED
> [INFO] hudi-datahub-sync-bundle ........................... SKIPPED
> [INFO] hudi-hive-sync-bundle .............................. SKIPPED
> [INFO] hudi-aws-bundle .................................... SKIPPED
> [INFO] hudi-gcp-bundle .................................... SKIPPED
> [INFO] hudi-spark3.5-bundle_2.12 .......................... SKIPPED
> [INFO] hudi-presto-bundle ................................. SKIPPED
> [INFO] hudi-utilities-slim-bundle_2.12 .................... SKIPPED
> [INFO] hudi-timeline-server-bundle ........................ SKIPPED
> [INFO] hudi-trino-bundle .................................. SKIPPED
> [INFO] hudi-examples ...................................... SKIPPED
> [INFO] hudi-examples-common ............................... SKIPPED
> [INFO] hudi-examples-spark ................................ SKIPPED
> [INFO] hudi-flink-datasource .............................. SKIPPED
> [INFO] hudi-flink1.18.x ................................... SKIPPED
> [INFO] hudi-flink ......................................... SKIPPED
> [INFO] hudi-examples-flink ................................ SKIPPED
> [INFO] hudi-examples-java ................................. SKIPPED
> [INFO] hudi-flink1.14.x ................................... SKIPPED
> [INFO] hudi-flink1.15.x ................................... SKIPPED
> [INFO] hudi-flink1.16.x ................................... SKIPPED
> [INFO] hudi-flink1.17.x ................................... SKIPPED
> [INFO] hudi-kafka-connect ................................. SKIPPED
> [INFO] hudi-flink1.18-bundle .............................. SKIPPED
> [INFO] hudi-kafka-connect-bundle .......................... SKIPPED
> [INFO] hudi-cli-bundle_2.12 ............................... SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 02:30 min
> [INFO] Finished at: 2025-06-13T09:50:13+08:00
> [INFO] ------------------------------------------------------------------------
> [ERROR] Failed to execute goal on project hudi-utilities-bundle_2.12: Could not resolve dependencies for project org.apache.hudi:hudi-utilities-bundle_2.12:jar:0.15.0: Failed to collect dependencies for org.apache.hudi:hudi-utilities-bundle_2.12:
> jar:0.15.0: Could not resolve version conflict among [org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 -> org.apache.hudi:hudi-gcp:jar:0.15.0 -> com.google.cloud:google-cloud-bigquery:jar:2.26.0 -> io.grpc:grpc-api:jar:1.54.0, org.apache.hudi:hudi-
> utilities_2.12:jar:0.15.0 -> org.apache.hudi:hudi-gcp:jar:0.15.0 -> com.google.cloud:google-cloud-pubsub:jar:1.123.12 -> io.grpc:grpc-api:jar:1.54.0, org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 -> org.apache.hudi:hudi-gcp:jar:0.15.0 -> com.goo
> gle.cloud.bigdataoss:gcs-connector:jar:hadoop2-2.2.7 -> com.google.cloud.bigdataoss:gcsio:jar:2.2.7 -> io.grpc:grpc-api:jar:1.43.2, org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 -> org.apache.hudi:hudi-gcp:jar:0.15.0 -> com.google.cloud.bigdatao
> ss:gcs-connector:jar:hadoop2-2.2.7 -> com.google.cloud.bigdataoss:gcsio:jar:2.2.7 -> io.grpc:grpc-census:jar:1.43.2 -> io.grpc:grpc-api:jar:[1.43.2,1.43.2], org.apache.hudi:hudi-utilities_2.12:jar:0.15.0 -> org.apache.hudi:hudi-gcp:jar:0.15.0 ->
> com.google.cloud.bigdataoss:gcs-connector:jar:hadoop2-2.2.7 -> com.google.cloud.bigdataoss:gcsio:jar:2.2.7 -> com.google.api.grpc:grpc-google-cloud-storage-v2:jar:2.2.2-alpha -> io.grpc:grpc-api:jar:1.42.1, org.apache.parquet:parquet-avro:jar:1.1
> 3.1 -> org.apache.parquet:parquet-hadoop:jar:1.13.1 -> io.grpc:grpc-netty-shaded:jar:1.31.1 -> io.grpc:grpc-core:jar:[1.31.1,1.31.1] -> io.grpc:grpc-api:jar:[1.31.1,1.31.1], org.apache.parquet:parquet-avro:jar:1.13.1 -> org.apache.parquet:parquet
> -hadoop:jar:1.13.1 -> io.grpc:grpc-protobuf:jar:1.31.1 -> io.grpc:grpc-api:jar:1.31.1, org.apache.parquet:parquet-avro:jar:1.13.1 -> org.apache.parquet:parquet-hadoop:jar:1.13.1 -> io.grpc:grpc-stub:jar:1.31.1 -> io.grpc:grpc-api:jar:1.31.1] -> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the command
> [ERROR] mvn <args> -rf :hudi-utilities-bundle_2.12
> {code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)