You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/07/12 07:36:00 UTC
[jira] [Updated] (HUDI-4383) Make hudi-flink-bundle module compile with the correct flink version
[ https://issues.apache.org/jira/browse/HUDI-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HUDI-4383:
---------------------------------
Labels: pull-request-available (was: )
> Make hudi-flink-bundle module compile with the correct flink version
> --------------------------------------------------------------------
>
> Key: HUDI-4383
> URL: https://issues.apache.org/jira/browse/HUDI-4383
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: xiaozhongcheng
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.12.0
>
>
> At present, If I compile hudi withe the compile command of
> {code:java}
> mvn clean package -DskipTests -Dhive.version=3.1.2 -Dscala.version=2.12.12 -Dscala.binary.version=2.12 -Pflink-bundle-shade-hive3 -Pflink1.15 -Dcheckstyle.skip=true -Dspark3.2 -Dscala-2.12 {code}
> the flink version of hudi-flink-bundle is still 1.14.
> Compile output:
> {code:java}
> [root@hadoop3 hudi-master]# mvn clean package -DskipTests -Dhive.version=3.1.2 -Dscala.version=2.12.12 -Dscala.binary.version=2.12 -Pflink-bundle-shade-hive3 -Pflink1.15 -Dcheckstyle.skip=true -Dspark3.2 -Dscala-2.12
> [INFO] Scanning for projects...
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-common:jar:0.12.0-SNAPSHOT
> [WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> version ${log4j2.version} vs ${log4j.test.version} @ org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1175, column 19
> [WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-api:jar -> version ${log4j2.version} vs ${log4j.test.version} @ org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1182, column 19
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-cli:jar:0.12.0-SNAPSHOT
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of version (?) @ line 216, column 17
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-api:jar -> duplicate declaration of version (?) @ line 222, column 17
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark-common_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark-common_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-spark-datasource/hudi-spark-common/pom.xml, line 24, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-spark-datasource/hudi-spark/pom.xml, line 26, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-utilities_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-utilities/pom.xml, line 26, column 15
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of version (?) @ org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-utilities/pom.xml, line 501, column 17
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-hive-sync:jar:0.12.0-SNAPSHOT
> [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of version (?) @ line 162, column 17
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark3.2-bundle_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark${sparkbundle.version}-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-spark-bundle/pom.xml, line 26, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-utilities-bundle_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-utilities-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-utilities-bundle/pom.xml, line 26, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-utilities-slim-bundle_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-utilities-slim-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-utilities-slim-bundle/pom.xml, line 26, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-flink1.14-bundle:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-flink${flink.bundle.version}-bundle:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-flink-bundle/pom.xml, line 28, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark2_2.12:jar:0.12.0-SNAPSHOT
> [WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark2_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-spark-datasource/hudi-spark2/pom.xml, line 24, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi:pom:0.12.0-SNAPSHOT
> [WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> version ${log4j2.version} vs ${log4j.test.version} @ line 1175, column 19
> [WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-api:jar -> version ${log4j2.version} vs ${log4j.test.version} @ line 1182, column 19
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
> [WARNING]
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Build Order:
> [INFO]
> [INFO] Hudi [pom]
> [INFO] hudi-common [jar]
> [INFO] hudi-hadoop-mr [jar]
> [INFO] hudi-sync-common [jar]
> [INFO] hudi-hive-sync [jar]
> [INFO] hudi-aws [jar]
> [INFO] hudi-timeline-service [jar]
> [INFO] hudi-client [pom]
> [INFO] hudi-client-common [jar]
> [INFO] hudi-spark-client [jar]
> [INFO] hudi-spark-datasource [pom]
> [INFO] hudi-spark-common_2.12 [jar]
> [INFO] hudi-spark3-common [jar]
> [INFO] hudi-spark3_2.12 [jar]
> [INFO] hudi-java-client [jar]
> [INFO] hudi-spark_2.12 [jar]
> [INFO] hudi-utilities_2.12 [jar]
> [INFO] hudi-utilities-bundle_2.12 [jar]
> [INFO] hudi-cli [jar]
> [INFO] hudi-flink-client [jar]
> [INFO] hudi-gcp [jar]
> [INFO] hudi-datahub-sync [jar]
> [INFO] hudi-adb-sync [jar]
> [INFO] hudi-sync [pom]
> [INFO] hudi-hadoop-mr-bundle [jar]
> [INFO] hudi-datahub-sync-bundle [jar]
> [INFO] hudi-hive-sync-bundle [jar]
> [INFO] hudi-aws-bundle [jar]
> [INFO] hudi-gcp-bundle [jar]
> [INFO] hudi-spark3.2-bundle_2.12 [jar]
> [INFO] hudi-presto-bundle [jar]
> [INFO] hudi-utilities-slim-bundle_2.12 [jar]
> [INFO] hudi-timeline-server-bundle [jar]
> [INFO] hudi-trino-bundle [jar]
> [INFO] hudi-examples [pom]
> [INFO] hudi-examples-common [jar]
> [INFO] hudi-examples-spark [jar]
> [INFO] hudi-flink-datasource [pom]
> [INFO] hudi-flink1.14.x [jar]
> [INFO] hudi-flink [jar]
> [INFO] hudi-examples-flink [jar]
> [INFO] hudi-examples-java [jar]
> [INFO] hudi-flink1.13.x [jar]
> [INFO] hudi-flink1.15.x [jar]
> [INFO] hudi-kafka-connect [jar]
> [INFO] hudi-flink1.14-bundle [jar]
> [INFO] hudi-kafka-connect-bundle [jar]
> [INFO] hudi-spark2_2.12 [jar]
> [INFO] hudi-spark2-common [jar]
> [INFO]
> [INFO] ------------------------< org.apache.hudi:hudi >------------------------
> [INFO] Building Hudi 0.12.0-SNAPSHOT [1/49]
> [INFO] --------------------------------[ pom ]---------------------------------
> [INFO]
> [INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ hudi ---
> [INFO] Deleting /data/hudi-master/target
> [INFO]
> ......{code}
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)