You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/07/12 07:35:26 UTC
[GitHub] [hudi] xiaozhch5 opened a new pull request, #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
xiaozhch5 opened a new pull request, #6084:
URL: https://github.com/apache/hudi/pull/6084
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
*(For example: This pull request adds quick-start document.)*
## Brief change log
Fix compile bug.
At present, when I compile hudi with the parameter of "-Pflink1.15", the flink version of hudi-flink-bundle is still 1.14.
the output is list below:
```bash
[root@hadoop3 hudi-master]# mvn clean package -DskipTests -Dhive.version=3.1.2 -Dscala.version=2.12.12 -Dscala.binary.version=2.12 -Pflink-bundle-shade-hive3 -Pflink1.15 -Dcheckstyle.skip=true -Dspark3.2 -Dscala-2.12
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-common:jar:0.12.0-SNAPSHOT
[WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> version ${log4j2.version} vs ${log4j.test.version} @ org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1175, column 19
[WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-api:jar -> version ${log4j2.version} vs ${log4j.test.version} @ org.apache.hudi:hudi:0.12.0-SNAPSHOT, /data/hudi-master/pom.xml, line 1182, column 19
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-cli:jar:0.12.0-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of version (?) @ line 216, column 17
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-api:jar -> duplicate declaration of version (?) @ line 222, column 17
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark-common_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark-common_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-spark-datasource/hudi-spark-common/pom.xml, line 24, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-spark-datasource/hudi-spark/pom.xml, line 26, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-utilities_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-utilities/pom.xml, line 26, column 15
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of version (?) @ org.apache.hudi:hudi-utilities_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-utilities/pom.xml, line 501, column 17
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-hive-sync:jar:0.12.0-SNAPSHOT
[WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> duplicate declaration of version (?) @ line 162, column 17
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark3.2-bundle_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark${sparkbundle.version}-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-spark-bundle/pom.xml, line 26, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-utilities-bundle_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-utilities-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-utilities-bundle/pom.xml, line 26, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-utilities-slim-bundle_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-utilities-slim-bundle_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-utilities-slim-bundle/pom.xml, line 26, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-flink1.14-bundle:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-flink${flink.bundle.version}-bundle:0.12.0-SNAPSHOT, /data/hudi-master/packaging/hudi-flink-bundle/pom.xml, line 28, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi-spark2_2.12:jar:0.12.0-SNAPSHOT
[WARNING] 'artifactId' contains an expression but should be a constant. @ org.apache.hudi:hudi-spark2_${scala.binary.version}:0.12.0-SNAPSHOT, /data/hudi-master/hudi-spark-datasource/hudi-spark2/pom.xml, line 24, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.hudi:hudi:pom:0.12.0-SNAPSHOT
[WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-core:jar -> version ${log4j2.version} vs ${log4j.test.version} @ line 1175, column 19
[WARNING] 'dependencyManagement.dependencies.dependency.(groupId:artifactId:type:classifier)' must be unique: org.apache.logging.log4j:log4j-api:jar -> version ${log4j2.version} vs ${log4j.test.version} @ line 1182, column 19
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Build Order:
[INFO]
[INFO] Hudi [pom]
[INFO] hudi-common [jar]
[INFO] hudi-hadoop-mr [jar]
[INFO] hudi-sync-common [jar]
[INFO] hudi-hive-sync [jar]
[INFO] hudi-aws [jar]
[INFO] hudi-timeline-service [jar]
[INFO] hudi-client [pom]
[INFO] hudi-client-common [jar]
[INFO] hudi-spark-client [jar]
[INFO] hudi-spark-datasource [pom]
[INFO] hudi-spark-common_2.12 [jar]
[INFO] hudi-spark3-common [jar]
[INFO] hudi-spark3_2.12 [jar]
[INFO] hudi-java-client [jar]
[INFO] hudi-spark_2.12 [jar]
[INFO] hudi-utilities_2.12 [jar]
[INFO] hudi-utilities-bundle_2.12 [jar]
[INFO] hudi-cli [jar]
[INFO] hudi-flink-client [jar]
[INFO] hudi-gcp [jar]
[INFO] hudi-datahub-sync [jar]
[INFO] hudi-adb-sync [jar]
[INFO] hudi-sync [pom]
[INFO] hudi-hadoop-mr-bundle [jar]
[INFO] hudi-datahub-sync-bundle [jar]
[INFO] hudi-hive-sync-bundle [jar]
[INFO] hudi-aws-bundle [jar]
[INFO] hudi-gcp-bundle [jar]
[INFO] hudi-spark3.2-bundle_2.12 [jar]
[INFO] hudi-presto-bundle [jar]
[INFO] hudi-utilities-slim-bundle_2.12 [jar]
[INFO] hudi-timeline-server-bundle [jar]
[INFO] hudi-trino-bundle [jar]
[INFO] hudi-examples [pom]
[INFO] hudi-examples-common [jar]
[INFO] hudi-examples-spark [jar]
[INFO] hudi-flink-datasource [pom]
[INFO] hudi-flink1.14.x [jar]
[INFO] hudi-flink [jar]
[INFO] hudi-examples-flink [jar]
[INFO] hudi-examples-java [jar]
[INFO] hudi-flink1.13.x [jar]
[INFO] hudi-flink1.15.x [jar]
[INFO] hudi-kafka-connect [jar]
[INFO] hudi-flink1.14-bundle [jar]
[INFO] hudi-kafka-connect-bundle [jar]
[INFO] hudi-spark2_2.12 [jar]
[INFO] hudi-spark2-common [jar]
[INFO]
[INFO] ------------------------< org.apache.hudi:hudi >------------------------
[INFO] Building Hudi 0.12.0-SNAPSHOT [1/49]
[INFO] --------------------------------[ pom ]---------------------------------
[INFO]
[INFO] --- maven-clean-plugin:3.1.0:clean (default-clean) @ hudi ---
[INFO] Deleting /data/hudi-master/target
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-maven-version) @ hudi ---
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M1:enforce (enforce-versions) @ hudi ---
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ hudi ---
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ hudi ---
[INFO]
[INFO] --- maven-source-plugin:2.2.1:jar-no-fork (attach-sources) @ hudi ---
[INFO]
[INFO] --- maven-site-plugin:3.7.1:attach-descriptor (attach-descriptor) @ hudi ---
[INFO] No site descriptor found: nothing to attach.
......
```
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6084:
URL: https://github.com/apache/hudi/pull/6084#issuecomment-1181451395
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9864",
"triggerID" : "63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9864)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6084:
URL: https://github.com/apache/hudi/pull/6084#issuecomment-1181585123
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9864",
"triggerID" : "63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9864)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on pull request #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
Posted by "bvaradar (via GitHub)" <gi...@apache.org>.
bvaradar commented on PR #6084:
URL: https://github.com/apache/hudi/pull/6084#issuecomment-1439539177
@danny0405 : Is this PR still valid to be landed ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6084:
URL: https://github.com/apache/hudi/pull/6084#issuecomment-1181446601
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 63fe847164f2ab09d16f0dcbfa74fbcab2bba7b9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #6084:
URL: https://github.com/apache/hudi/pull/6084#issuecomment-1439657551
Not anymore, close it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 closed pull request #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 closed pull request #6084: [HUDI-4383]Make hudi-flink-bundle module compile with the correct flink version
URL: https://github.com/apache/hudi/pull/6084
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org