You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "rahil-c (via GitHub)" <gi...@apache.org> on 2023/03/01 23:03:46 UTC
[GitHub] [hudi] rahil-c opened a new pull request, #8082: [HUDI-5868] Upgrade Spark to 3.3.2
rahil-c opened a new pull request, #8082:
URL: https://github.com/apache/hudi/pull/8082
### Change Logs
Upgrade spark to 3.3.2
### Impact
low minor upgrade
### Documentation Update
minor doc update
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1537768291
@xiarixiaoyao Thanks for your analysis.
Ive tried adding that code block you linked in this pr. The one thing I am seeing from the tests is a new failure since this "returning_batch" config does not seem to be getting set internally by spark.
```
java.lang.IllegalArgumentException: OPTION_RETURNING_BATCH should always be set for ParquetFileFormat. To workaround this issue, set spark.sql.parquet.enableVectorizedReader=false.
```
Do you have any idea why applying this fix from spark is causing issues? From my understanding The property should be set within spark https://github.com/apache/hudi/pull/8082/files
```
lazy val inputRDD: RDD[InternalRow] = {
val options = relation.options +
(FileFormat.OPTION_RETURNING_BATCH -> supportsColumnar.toString)
val readFile: (PartitionedFile) => Iterator[InternalRow] =
relation.fileFormat.buildReaderWithPartitionValues(
sparkSession = relation.sparkSession,
dataSchema = relation.dataSchema,
partitionSchema = relation.partitionSchema,
requiredSchema = requiredSchema,
filters = pushedDownFilters,
options = options,
hadoopConf = relation.sparkSession.sessionState.newHadoopConfWithOptions(relation.options))
```
should be set inside `DataSourceScanExec.scala`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1538821912
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 9b8fd35638220cdc084d9d16b7e39b67025798aa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891)
* b285ca4f163dc720d061cfa9ade88aefed49dff1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1540548174
> There was one failure in the CI: TestAvroSchemaResolutionSupport.testDataTypePromotions
Had offline conversation, will disable this test for spark 332 for now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1537085817
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 010b74b7ea5da195f365507aac106a1a26d091ac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851)
* 9b8fd35638220cdc084d9d16b7e39b67025798aa UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1456420293
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a3473633e6456cf3d6ee4e4dfc34f98250bdff17 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561)
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1454173948
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 61dda6da1e111009d968f3af1735f56b43181be7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542)
* 47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1454222596
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559)
* d5333e95b609d585c00404c55151830108dd160c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1451037017
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1541183122
Let's disable the vec reader for spark 3.3.2 first, will ping @xiarixiaoyao to dig into the format issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1188080242
##########
hudi-client/hudi-spark-client/src/main/scala/org/apache/hudi/HoodieSparkUtils.scala:
##########
@@ -58,6 +58,7 @@ private[hudi] trait SparkVersionsSupport {
def gteqSpark3_2_1: Boolean = getSparkVersion >= "3.2.1"
def gteqSpark3_2_2: Boolean = getSparkVersion >= "3.2.2"
def gteqSpark3_3: Boolean = getSparkVersion >= "3.3"
+ def gteqSpark3_3_2: Boolean = getSparkVersion >= "3.3.2"
Review Comment:
Should be runtime, I think.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1530480262
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 58edb8dbad6d6e4dd7455bcabc5e5f70369493ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265)
* 5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781)
* 0a082e637cc56db6cfd266c8d355aad666e7af2e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1536989748
> @xiarixiaoyao
>
> Atleast from the java ci perspective when disabling this vectorized reader config for spark 3.3.2, all the tests are passing.
>
> cc @danny0405 @yihua
Yeah, but @xiarixiaoyao opinion is right, we can cherry pick the fix from Spark, it seems a bug introduced in Spark 3.3.2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1182725019
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/adapter/Spark3_3Adapter.scala:
##########
@@ -18,7 +18,7 @@
package org.apache.spark.sql.adapter
import org.apache.avro.Schema
-import org.apache.hudi.Spark33HoodieFileScanRDD
+import org.apache.hudi.{HoodieSparkUtils, Spark33HoodieFileScanRDD}
import org.apache.spark.sql._
Review Comment:
yes will remove thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535506282
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 0a082e637cc56db6cfd266c8d355aad666e7af2e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782)
* 72718aa9c5742484684bf10548ee875b7d7557ac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838)
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 merged pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 merged PR #8082:
URL: https://github.com/apache/hudi/pull/8082
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1454180148
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1454303245
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559)
* d5333e95b609d585c00404c55151830108dd160c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560)
* a3473633e6456cf3d6ee4e4dfc34f98250bdff17 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1460701128
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535476825
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 0a082e637cc56db6cfd266c8d355aad666e7af2e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782)
* 72718aa9c5742484684bf10548ee875b7d7557ac UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535511876
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 72718aa9c5742484684bf10548ee875b7d7557ac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838)
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1182058559
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/adapter/Spark3_3Adapter.scala:
##########
@@ -18,7 +18,7 @@
package org.apache.spark.sql.adapter
import org.apache.avro.Schema
-import org.apache.hudi.Spark33HoodieFileScanRDD
+import org.apache.hudi.{HoodieSparkUtils, Spark33HoodieFileScanRDD}
import org.apache.spark.sql._
Review Comment:
Unnecessary change?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535707221
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 31b46f86d75bfa039845780be655a7d94f38b892 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849)
* 010b74b7ea5da195f365507aac106a1a26d091ac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1542687715
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
}, {
"hash" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988",
"triggerID" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"triggerType" : "PUSH"
}, {
"hash" : "36f9bb2a1380683736a7a7465fb897e0a802c733",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16999",
"triggerID" : "36f9bb2a1380683736a7a7465fb897e0a802c733",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 36f9bb2a1380683736a7a7465fb897e0a802c733 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16999)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1541567783
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
}, {
"hash" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988",
"triggerID" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 3dca5ebd346463d52d2f413080ca9e3f87b7a40a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1504203496
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 58edb8dbad6d6e4dd7455bcabc5e5f70369493ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1503886479
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 46a2c22795b5e1be2bc74f92090cd1a496ea9a39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264)
* 58edb8dbad6d6e4dd7455bcabc5e5f70369493ab UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1187725527
##########
hudi-client/hudi-spark-client/src/main/scala/org/apache/hudi/HoodieSparkUtils.scala:
##########
@@ -58,6 +58,7 @@ private[hudi] trait SparkVersionsSupport {
def gteqSpark3_2_1: Boolean = getSparkVersion >= "3.2.1"
def gteqSpark3_2_2: Boolean = getSparkVersion >= "3.2.2"
def gteqSpark3_3: Boolean = getSparkVersion >= "3.3"
+ def gteqSpark3_3_2: Boolean = getSparkVersion >= "3.3.2"
Review Comment:
Is this based on compile-time Spark version or runtime Spark version?
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/storage/HoodieSparkFileReaderFactory.java:
##########
@@ -33,6 +33,8 @@ protected HoodieFileReader newParquetFileReader(Configuration conf, Path path) {
conf.setIfUnset(SQLConf.PARQUET_BINARY_AS_STRING().key(), SQLConf.PARQUET_BINARY_AS_STRING().defaultValueString());
conf.setIfUnset(SQLConf.PARQUET_INT96_AS_TIMESTAMP().key(), SQLConf.PARQUET_INT96_AS_TIMESTAMP().defaultValueString());
conf.setIfUnset(SQLConf.CASE_SENSITIVE().key(), SQLConf.CASE_SENSITIVE().defaultValueString());
+ // Using string value of this conf to preserve compatibility across spark versions.
+ conf.setIfUnset("spark.sql.legacy.parquet.nanosAsLong", "false");
Review Comment:
Could you use a variable to define the default value `false`?
##########
hudi-spark-datasource/hudi-spark3.2plus-common/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32PlusHoodieParquetFileFormat.scala:
##########
@@ -95,7 +95,11 @@ class Spark32PlusHoodieParquetFileFormat(private val shouldAppendPartitionValues
hadoopConf.setBoolean(
SQLConf.PARQUET_INT96_AS_TIMESTAMP.key,
sparkSession.sessionState.conf.isParquetINT96AsTimestamp)
-
+ // Using string value of this conf to preserve compatibility across spark versions.
+ hadoopConf.setBoolean(
+ "spark.sql.legacy.parquet.nanosAsLong",
+ sparkSession.sessionState.conf.getConfString("spark.sql.legacy.parquet.nanosAsLong", "false").toBoolean
Review Comment:
Similar here for the default value `false`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1539289962
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* b285ca4f163dc720d061cfa9ade88aefed49dff1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1454363083
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a3473633e6456cf3d6ee4e4dfc34f98250bdff17 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1456533387
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a3473633e6456cf3d6ee4e4dfc34f98250bdff17 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561)
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 5933ef4bb1a6c803c014ae3fc0a50886460193d0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596)
* f5b3f091499552a0dc44c547d6672301c6a95de9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1532370377
> but I encountered an issue where I was unable to read the data back and received a null pointer exception
This patch should solve your issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1534100699
> TestNestedSchemaPruningOptimization failed only in spark3.3.2
Yes, I even try the Spark 3.2.1 and it works fine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1472218536
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 9fc3fb68ef74a191e2e3c5da242c654c95169fbd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625)
* 46a2c22795b5e1be2bc74f92090cd1a496ea9a39 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1456435409
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a3473633e6456cf3d6ee4e4dfc34f98250bdff17 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561)
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 5933ef4bb1a6c803c014ae3fc0a50886460193d0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nikoshet commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "nikoshet (via GitHub)" <gi...@apache.org>.
nikoshet commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1490150785
Any info on when will this be merged?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1460711562
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 9fc3fb68ef74a191e2e3c5da242c654c95169fbd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1472231380
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 46a2c22795b5e1be2bc74f92090cd1a496ea9a39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1530706297
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 0a082e637cc56db6cfd266c8d355aad666e7af2e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1188080016
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/storage/HoodieSparkFileReaderFactory.java:
##########
@@ -33,6 +33,8 @@ protected HoodieFileReader newParquetFileReader(Configuration conf, Path path) {
conf.setIfUnset(SQLConf.PARQUET_BINARY_AS_STRING().key(), SQLConf.PARQUET_BINARY_AS_STRING().defaultValueString());
conf.setIfUnset(SQLConf.PARQUET_INT96_AS_TIMESTAMP().key(), SQLConf.PARQUET_INT96_AS_TIMESTAMP().defaultValueString());
conf.setIfUnset(SQLConf.CASE_SENSITIVE().key(), SQLConf.CASE_SENSITIVE().defaultValueString());
+ // Using string value of this conf to preserve compatibility across spark versions.
+ conf.setIfUnset("spark.sql.legacy.parquet.nanosAsLong", "false");
Review Comment:
No need to do that.
##########
hudi-spark-datasource/hudi-spark3.2plus-common/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32PlusHoodieParquetFileFormat.scala:
##########
@@ -95,7 +95,11 @@ class Spark32PlusHoodieParquetFileFormat(private val shouldAppendPartitionValues
hadoopConf.setBoolean(
SQLConf.PARQUET_INT96_AS_TIMESTAMP.key,
sparkSession.sessionState.conf.isParquetINT96AsTimestamp)
-
+ // Using string value of this conf to preserve compatibility across spark versions.
+ hadoopConf.setBoolean(
+ "spark.sql.legacy.parquet.nanosAsLong",
+ sparkSession.sessionState.conf.getConfString("spark.sql.legacy.parquet.nanosAsLong", "false").toBoolean
Review Comment:
No need to do that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1537160316
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 9b8fd35638220cdc084d9d16b7e39b67025798aa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1541376759
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
}, {
"hash" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988",
"triggerID" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982)
* 3dca5ebd346463d52d2f413080ca9e3f87b7a40a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1171678174
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
Review Comment:
Yes this is true since, but my understanding is currently that hudi supports only minor version of spark. https://github.com/apache/hudi/blob/master/pom.xml#L159 im not sure if users should be changing the version in the poms and trying to compile with a different version. cc @yihua
Currently when im taking the open source jars from Hudi which are compiled via spark 3.3.1 and try running them on spark 3.3.2 they hit failures due to the new config causing issues, so we eventually I think have to support this.
However I think the main thing we need to check is runtime support meaning if this change of upgrading to spark 3.3.2 atleast can run on a Spark 3.3.1 runtime so we dont break users.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1171768329
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
Review Comment:
Update on this when compiling with spark 3.3.1 things are working fine even with these 3.3.2 changes .
`mvn clean install -Dspark3 -Dscala-2.12 -DskipTests -pl packaging/hudi-spark-bundle -am -Dspark.version=3.3.1`
```
[INFO] Hudi ............................................... SUCCESS [ 2.629 s]
[INFO] hudi-tests-common .................................. SUCCESS [ 1.752 s]
[INFO] hudi-common ........................................ SUCCESS [ 29.852 s]
[INFO] hudi-hadoop-mr ..................................... SUCCESS [ 7.301 s]
[INFO] hudi-sync-common ................................... SUCCESS [ 2.429 s]
[INFO] hudi-hive-sync ..................................... SUCCESS [ 6.965 s]
[INFO] hudi-aws ........................................... SUCCESS [ 4.255 s]
[INFO] hudi-timeline-service .............................. SUCCESS [ 2.550 s]
[INFO] hudi-client ........................................ SUCCESS [ 0.082 s]
[INFO] hudi-client-common ................................. SUCCESS [ 13.594 s]
[INFO] hudi-spark-client .................................. SUCCESS [ 36.826 s]
[INFO] hudi-spark-datasource .............................. SUCCESS [ 0.079 s]
[INFO] hudi-spark-common_2.12 ............................. SUCCESS [ 28.910 s]
[INFO] hudi-spark3-common ................................. SUCCESS [ 9.304 s]
[INFO] hudi-spark3.2plus-common ........................... SUCCESS [ 12.118 s]
[INFO] hudi-spark3.3.x_2.12 ............................... SUCCESS [ 23.851 s]
[INFO] hudi-java-client ................................... SUCCESS [ 4.792 s]
[INFO] hudi-spark_2.12 .................................... SUCCESS [ 53.643 s]
[INFO] hudi-spark3.3-bundle_2.12 .......................... SUCCESS [ 29.585 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 04:31 min
[INFO] Finished at: 2023-04-19T11:56:41-07:00
[INFO] ---------------------------------------------
```
confirmed via mvn logs that it was using 3.3.1
```
[INFO] Copying derby-10.14.2.0.jar to /Users/rchertar/hudi/hudi-spark-datasource/hudi-spark/target/lib/derby-10.14.2.0.jar
[INFO] Copying spark-sql_2.12-3.3.1-tests.jar to /Users/rchertar/hudi/hudi-spark-datasource/hudi-spark/target/lib/spark-sql_2.12-3.3.1-tests.jar
[INFO] Copying spark-core_2.12-3.3.1-tests.jar to /Users/rchertar/hudi/hudi-spark-datasource/hudi-spark/target/lib/spark-core_2.12-3.3.1-tests.jar
[INFO] Copying spark-catalyst_2.12-3.3.1-tests.jar to /Users/rchertar/hudi/hudi-spark-datasource/hudi-spark/target/lib/spark-catalyst_2.12-3.3.1-tests.jar
[INFO] Copying scala-parser-combinators_2.12-1.1.2.jar to /Users/rchertar/hudi/hudi-spark-datasource/hudi-spark/target/lib/scala-parser-combinators_2.12-1.1.2.jar
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535602285
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1456644895
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 5933ef4bb1a6c803c014ae3fc0a50886460193d0 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596)
* f5b3f091499552a0dc44c547d6672301c6a95de9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1456555241
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 5933ef4bb1a6c803c014ae3fc0a50886460193d0 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596)
* f5b3f091499552a0dc44c547d6672301c6a95de9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535693959
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839)
* 31b46f86d75bfa039845780be655a7d94f38b892 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535942452
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 010b74b7ea5da195f365507aac106a1a26d091ac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "xiarixiaoyao (via GitHub)" <gi...@apache.org>.
xiarixiaoyao commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1536060525
@rahil-c @danny0405 @yihua
I don't think this error was caused by spark.sql.parquet.enableVectorizedReader=true， This value spark defaults to true.
The modification of Spark below mentioned this error, we can adapt according to this PR.
https://github.com/apache/spark/commit/77694b4673dd2efb5b79d596fbd647af3db5f8a0
for spark3.3.2 add the following code to Spark32PlusHoodieParquetFileFormat(maybe we need a new parquet format for spark3.3.2) can solve the problem
```
// Should always be set by FileSourceScanExec creating this.
// Check conf before checking option, to allow working around an issue by changing conf.
val returningBatch = sparkSession.sessionState.conf.parquetVectorizedReaderEnabled &&
options.get(FileFormat.OPTION_RETURNING_BATCH)
.getOrElse {
throw new IllegalArgumentException(
"OPTION_RETURNING_BATCH should always be set for ParquetFileFormat. " +
"To workaround this issue, set spark.sql.parquet.enableVectorizedReader=false.")
}
.equals("true")
if (returningBatch) {
// If the passed option said that we are to return batches, we need to also be able to
// do this based on config and resultSchema.
assert(supportBatch(sparkSession, resultSchema))
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1536481643
@xiarixiaoyao
Atleast from the java ci perspective when disabling this vectorized reader config for spark 3.3.2, all the tests are passing.
cc @danny0405 @yihua
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1188946920
##########
hudi-spark-datasource/hudi-spark3.2plus-common/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32PlusHoodieParquetFileFormat.scala:
##########
@@ -42,7 +42,7 @@ import org.apache.spark.sql.catalyst.expressions.codegen.GenerateUnsafeProjectio
import org.apache.spark.sql.catalyst.expressions.{Cast, JoinedRow}
import org.apache.spark.sql.catalyst.util.DateTimeUtils
import org.apache.spark.sql.execution.datasources.parquet.Spark32PlusHoodieParquetFileFormat._
-import org.apache.spark.sql.execution.datasources.{DataSourceUtils, PartitionedFile, RecordReaderIterator}
+import org.apache.spark.sql.execution.datasources.{DataSourceUtils, FileFormat, PartitionedFile, RecordReaderIterator}
Review Comment:
Need to remove this unused FileFormat
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] CTTY commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "CTTY (via GitHub)" <gi...@apache.org>.
CTTY commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1163228965
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
Review Comment:
With this class under `hudi-spark3.3.x`, Hudi won't be able to compile with Spark 3.3.1 anymore
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/storage/HoodieSparkFileReaderFactory.java:
##########
@@ -33,6 +33,7 @@ protected HoodieFileReader newParquetFileReader(Configuration conf, Path path) {
conf.setIfUnset(SQLConf.PARQUET_INT96_AS_TIMESTAMP().key(),
SQLConf.PARQUET_INT96_AS_TIMESTAMP().defaultValueString());
conf.setIfUnset(SQLConf.CASE_SENSITIVE().key(), SQLConf.CASE_SENSITIVE().defaultValueString());
+ conf.setIfUnset("spark.sql.legacy.parquet.nanosAsLong", "false");
Review Comment:
nit: Can we add a comment to explain why we put a plain string here?
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
+
+ override def buildReaderWithPartitionValues(sparkSession: SparkSession,
+ dataSchema: StructType,
+ partitionSchema: StructType,
+ requiredSchema: StructType,
+ filters: Seq[Filter],
+ options: Map[String, String],
+ hadoopConf: Configuration): PartitionedFile => Iterator[InternalRow] = {
+ // Sets flags for `ParquetToSparkSchemaConverter`
+ hadoopConf.setBoolean(SQLConf.LEGACY_PARQUET_NANOS_AS_LONG.key, sparkSession.sessionState.conf.legacyParquetNanosAsLong)
Review Comment:
Maybe use string here for property name would help build issues with Spark 3.3.1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1503894762
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 46a2c22795b5e1be2bc74f92090cd1a496ea9a39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264)
* 58edb8dbad6d6e4dd7455bcabc5e5f70369493ab Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535516583
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 72718aa9c5742484684bf10548ee875b7d7557ac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838)
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1536151704
> maybe we need a new parquet format
You mean to sync again from Spark 3.3.2 ? The copy code is hard to maintain, you will always need to sync upstream fixes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "xiarixiaoyao (via GitHub)" <gi...@apache.org>.
xiarixiaoyao commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1537984230
> @xiarixiaoyao Thanks for your analysis.
>
> Ive tried adding that code block you linked in this pr. The one thing I am seeing from the tests is a new failure since this "returning_batch" config does not seem to be getting set internally by spark.
>
> ```
> java.lang.IllegalArgumentException: OPTION_RETURNING_BATCH should always be set for ParquetFileFormat. To workaround this issue, set spark.sql.parquet.enableVectorizedReader=false.
> ```
>
> Do you have any idea why applying this fix from spark is causing issues? From my understanding The property should be set within spark https://github.com/apache/hudi/pull/8082/files
>
> ```
>
> lazy val inputRDD: RDD[InternalRow] = {
> val options = relation.options +
> (FileFormat.OPTION_RETURNING_BATCH -> supportsColumnar.toString)
> val readFile: (PartitionedFile) => Iterator[InternalRow] =
> relation.fileFormat.buildReaderWithPartitionValues(
> sparkSession = relation.sparkSession,
> dataSchema = relation.dataSchema,
> partitionSchema = relation.partitionSchema,
> requiredSchema = requiredSchema,
> filters = pushedDownFilters,
> options = options,
> hadoopConf = relation.sparkSession.sessionState.newHadoopConfWithOptions(relation.options))
> ```
>
> should be set inside `DataSourceScanExec.scala`.
@rahil-c
hoodie mor table cannot trigger spark FileSourceStrategy plan. let's pass FileFormat.OPTION_RETURNING_BATCH by ourselves
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1532480189
Okay, finally I find out the reason for the failure from test `TestNestedSchemaPruningOptimization`.
It is because we hard code the Parquet vectorized reader in base realtion: https://github.com/apache/hudi/blob/620f39a5fd5e1392819d530ea963f866c3f1c301/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala#L78 in https://github.com/apache/hudi/pull/5168,
after we upgrade to Spark 3.3.2, the whole stage codegen triggered in Spark physical plan during the code generation, and the whole stage code gen id doing the code generation based on per-row assumption (no vectorized reader supported).
I have created a patch to fix this(also fix the compilure error for hudi-sync module). The patch disable the vectorized reader, but I'm not sure how it would impact the performance, would ping @xiarixiaoyao for a review ~
[5868.patch.zip](https://github.com/apache/hudi/files/11379613/5868.patch.zip)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1530848494
Thanks for the fix @rahil-c , you may need to rebase with the latest master to get rid of the test failures.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1452769806
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1454240600
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559)
* d5333e95b609d585c00404c55151830108dd160c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1458873892
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 3e2ae734bb05cdee830bead345f3be0a324e7d52 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610)
* 9fc3fb68ef74a191e2e3c5da242c654c95169fbd UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1458888535
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 9fc3fb68ef74a191e2e3c5da242c654c95169fbd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1452764196
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1451182922
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1458547646
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 3e2ae734bb05cdee830bead345f3be0a324e7d52 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1530389729
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 58edb8dbad6d6e4dd7455bcabc5e5f70369493ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265)
* 5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1530493775
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781)
* 0a082e637cc56db6cfd266c8d355aad666e7af2e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535683746
> If we'd like to have this fix in 0.13.1 release without introducing performance problems for existing Spark versions, could we consider the following to triage the scope of impact?
>
> (1) Could we disable the optimization rule of nested schema pruning for Spark 3.3.2 only, and see if the tests can pass (without config change of vectorized reader)? This is done by not adding `org.apache.spark.sql.execution.datasources.Spark33NestedSchemaPruning` for Spark 3.3.2 in [HoodieAnalysis](https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala#L132). (2) If the above does not work, could we disable the vectorized reader for Spark 3.3.2 only? And still use Spark 3.3.1 as the compile dependency in this case? (3) Could we also list all the failed tests and see what are in common for further investigation?
@yihua
1). When trying to disable the optimization rule and run the test it seems the issues is present when trying on several failed tests.
2). I think this path can work, i added a check to only have this config set to true only when it encounters spark version other spark 3.3.2. Im not sure what you mean on using spark 3.3.1 compile dependency though.
3). Have test failure list above
cc @danny0405 @xiarixiaoyao
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1542477356
Agree that at this point let's disable vectorized reader for spark 3.3.2 only without affecting the Hudi integration with existing Spark versions, and keep compile version to be Spark 3.3.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1503840585
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1171768846
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
+
+ override def buildReaderWithPartitionValues(sparkSession: SparkSession,
+ dataSchema: StructType,
+ partitionSchema: StructType,
+ requiredSchema: StructType,
+ filters: Seq[Filter],
+ options: Map[String, String],
+ hadoopConf: Configuration): PartitionedFile => Iterator[InternalRow] = {
+ // Sets flags for `ParquetToSparkSchemaConverter`
+ hadoopConf.setBoolean(SQLConf.LEGACY_PARQUET_NANOS_AS_LONG.key, sparkSession.sessionState.conf.legacyParquetNanosAsLong)
Review Comment:
Update from above comment spark 3.3.1 builds fine with these changes so dont think we need to use string.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1537087387
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 010b74b7ea5da195f365507aac106a1a26d091ac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851)
* 9b8fd35638220cdc084d9d16b7e39b67025798aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1538835115
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 9b8fd35638220cdc084d9d16b7e39b67025798aa Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891)
* b285ca4f163dc720d061cfa9ade88aefed49dff1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1454306233
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d5333e95b609d585c00404c55151830108dd160c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560)
* a3473633e6456cf3d6ee4e4dfc34f98250bdff17 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1452779602
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541)
* 61dda6da1e111009d968f3af1735f56b43181be7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1456866897
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* f5b3f091499552a0dc44c547d6672301c6a95de9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1458512273
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* f5b3f091499552a0dc44c547d6672301c6a95de9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597)
* 3e2ae734bb05cdee830bead345f3be0a324e7d52 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1456516185
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a3473633e6456cf3d6ee4e4dfc34f98250bdff17 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561)
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 5933ef4bb1a6c803c014ae3fc0a50886460193d0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1171692754
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
+
+ override def buildReaderWithPartitionValues(sparkSession: SparkSession,
+ dataSchema: StructType,
+ partitionSchema: StructType,
+ requiredSchema: StructType,
+ filters: Seq[Filter],
+ options: Map[String, String],
+ hadoopConf: Configuration): PartitionedFile => Iterator[InternalRow] = {
+ // Sets flags for `ParquetToSparkSchemaConverter`
+ hadoopConf.setBoolean(SQLConf.LEGACY_PARQUET_NANOS_AS_LONG.key, sparkSession.sessionState.conf.legacyParquetNanosAsLong)
Review Comment:
I think we can use the string value for the key, the problem however is I dont think we can use a string for the value. Depending on how user sets the conf I think we need to actually access the sessionState and therefore access the conf object.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1542507512
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
}, {
"hash" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988",
"triggerID" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"triggerType" : "PUSH"
}, {
"hash" : "36f9bb2a1380683736a7a7465fb897e0a802c733",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16999",
"triggerID" : "36f9bb2a1380683736a7a7465fb897e0a802c733",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 3dca5ebd346463d52d2f413080ca9e3f87b7a40a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988)
* 36f9bb2a1380683736a7a7465fb897e0a802c733 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16999)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1540572508
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* b285ca4f163dc720d061cfa9ade88aefed49dff1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953)
* 4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1541194539
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1539339102
There was one failure in the CI: TestAvroSchemaResolutionSupport.testDataTypePromotions
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1530370118
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 58edb8dbad6d6e4dd7455bcabc5e5f70369493ab Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265)
* 5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "bvaradar (via GitHub)" <gi...@apache.org>.
bvaradar commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1530892000
@yihua : FYI
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535453367
If we'd like to have this fix in 0.13.1 release without introducing performance problems for existing Spark versions, could we consider the following to triage the scope of impact?
(1) Could we disable the optimization rule of nested schema pruning for Spark 3.3.2 only, and see if the tests can pass (without config change of vectorized reader)? This is done by not adding `org.apache.spark.sql.execution.datasources.Spark33NestedSchemaPruning` for Spark 3.3.2 in [HoodieAnalysis](https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala#L132).
(2) If the above does not work, could we disable the vectorized reader for Spark 3.3.2 only? And still use Spark 3.3.1 as the compile dependency in this case?
(3) Could we also list all the failed tests and see what are in common for further investigation?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535699664
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839)
* 31b46f86d75bfa039845780be655a7d94f38b892 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849)
* 010b74b7ea5da195f365507aac106a1a26d091ac UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] abdkumar commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "abdkumar (via GitHub)" <gi...@apache.org>.
abdkumar commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1531782015
I tried to write data as a MOR (Merge On Read) table after pulling the latest master, but I encountered an issue where I was unable to read the data back and received a null pointer exception. I followed some suggestions and set the relevant Spark configurations, but the error persists.
```
spark.conf.set("spark.sql.legacy.parquet.nanosAsLong", "false");
spark.conf.set("spark.sql.parquet.binaryAsString", "false");
spark.conf.set("spark.sql.parquet.int96AsTimestamp", "true");
spark.conf.set("spark.sql.caseSensitive", "false");
```
**Environment Description**
Hudi : 0.14.0
Spark version : 3.3.2
Hive version : 3.1.3
Hadoop version : 3.3.2
Storage (HDFS/S3/GCS..) : Local
Running on Docker? (yes/no) : no
**stacktrace**
`23/05/02 16:25:55 ERROR Executor: Exception in task 0.0 in stage 190.0 (TID 227)
java.lang.IllegalArgumentException: For input string: "null"
at scala.collection.immutable.StringLike.parseBoolean(StringLike.scala:330)
at scala.collection.immutable.StringLike.toBoolean(StringLike.scala:289)
at scala.collection.immutable.StringLike.toBoolean$(StringLike.scala:289)
at scala.collection.immutable.StringOps.toBoolean(StringOps.scala:33)
at org.apache.spark.sql.execution.datasources.parquet.ParquetToSparkSchemaConverter.<init>(ParquetSchemaConverter.scala:70)
at org.apache.spark.sql.execution.datasources.parquet.HoodieParquetFileFormatHelper$.buildImplicitSchemaChangeInfo(HoodieParquetFileFormatHelper.scala:30)
at org.apache.spark.sql.execution.datasources.parquet.Spark32PlusHoodieParquetFileFormat.$anonfun$buildReaderWithPartitionValues$2(Spark32PlusHoodieParquetFileFormat.scala:232)
at org.apache.hudi.HoodieDataSourceHelper$.$anonfun$buildHoodieParquetReader$1(HoodieDataSourceHelper.scala:71)
at org.apache.hudi.HoodieBaseRelation.$anonfun$createBaseFileReader$2(HoodieBaseRelation.scala:582)
at org.apache.hudi.HoodieBaseRelation$BaseFileReader.apply(HoodieBaseRelation.scala:652)
at org.apache.hudi.HoodieMergeOnReadRDD.compute(HoodieMergeOnReadRDD.scala:87)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:365)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:329)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:365)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:329)
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:365)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:329)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90)
at org.apache.spark.scheduler.Task.run(Task.scala:136)
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:548)
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1504)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:551)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535715859
> > If we'd like to have this fix in 0.13.1 release without introducing performance problems for existing Spark versions, could we consider the following to triage the scope of impact?
> > (1) Could we disable the optimization rule of nested schema pruning for Spark 3.3.2 only, and see if the tests can pass (without config change of vectorized reader)? This is done by not adding `org.apache.spark.sql.execution.datasources.Spark33NestedSchemaPruning` for Spark 3.3.2 in [HoodieAnalysis](https://github.com/apache/hudi/blob/master/hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/analysis/HoodieAnalysis.scala#L132). (2) If the above does not work, could we disable the vectorized reader for Spark 3.3.2 only? And still use Spark 3.3.1 as the compile dependency in this case? (3) Could we also list all the failed tests and see what are in common for further investigation?
>
> @yihua 1). When trying to disable the optimization rule and run the test it seems the issues is present when trying on several failed tests.
>
> 2). I think this path can work, i added a check to only have this config set to true only when it encounters spark version other spark 3.3.2. Im not sure what you mean on using spark 3.3.1 compile dependency though.
>
> 3). Have test failure list above
>
> cc @danny0405 @xiarixiaoyao
I have concern that the whole stage code gen does not even support vectorized reader at all, I'm speculating that old version Spark does not throw just because it does not trigger the whole stage code optimization. Somehow, I think we should make the vectorized reader flag configurable, but maybe not in this patch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1503656500
> Any info on when will this be merged?
Will try to get this in ideally sometime this week. @yihua
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1503877790
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 46a2c22795b5e1be2bc74f92090cd1a496ea9a39 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xiarixiaoyao commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "xiarixiaoyao (via GitHub)" <gi...@apache.org>.
xiarixiaoyao commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1533999490
> BaseFileOnlyRelation.scala
the reason why we hard-coded is that：
The parent class of baseFileOnlyRelation is hard-coded to disable vectorization by default, resulting in the failure of vectorization to be enabled normally, and the performance regress significantly.
TestNestedSchemaPruningOptimization failed only in spark3.3.2 ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1535003728
> spark.sql.parquet.enableVectorizedReader", "true")
@xiarixiaoyao @danny0405 Thank you both for taking a look at this. Just to confirm are we saying we cant disable this `spark.sql.parquet.enableVectorizedReader` since this would cause performance regression. Is there any other workaround you guys are aware of?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1541371788
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
}, {
"hash" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982)
* 3dca5ebd346463d52d2f413080ca9e3f87b7a40a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1540585190
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* b285ca4f163dc720d061cfa9ade88aefed49dff1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953)
* 4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1542498392
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15754",
"triggerID" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"triggerType" : "PUSH"
}, {
"hash" : "46a2c22795b5e1be2bc74f92090cd1a496ea9a39",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16264",
"triggerID" : "1503840585",
"triggerType" : "MANUAL"
}, {
"hash" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16265",
"triggerID" : "58edb8dbad6d6e4dd7455bcabc5e5f70369493ab",
"triggerType" : "PUSH"
}, {
"hash" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16781",
"triggerID" : "5ea37cb5e51d1e98302ffbfc47cb94da10c39fbd",
"triggerType" : "PUSH"
}, {
"hash" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16782",
"triggerID" : "0a082e637cc56db6cfd266c8d355aad666e7af2e",
"triggerType" : "PUSH"
}, {
"hash" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16838",
"triggerID" : "72718aa9c5742484684bf10548ee875b7d7557ac",
"triggerType" : "PUSH"
}, {
"hash" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6a62994325c4b1110a265262a56da1a94e1f6e2",
"triggerType" : "PUSH"
}, {
"hash" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16839",
"triggerID" : "2caafc1bdc76ab4786e3a02f1d8ad64fecfe559e",
"triggerType" : "PUSH"
}, {
"hash" : "31b46f86d75bfa039845780be655a7d94f38b892",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16849",
"triggerID" : "31b46f86d75bfa039845780be655a7d94f38b892",
"triggerType" : "PUSH"
}, {
"hash" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16851",
"triggerID" : "010b74b7ea5da195f365507aac106a1a26d091ac",
"triggerType" : "PUSH"
}, {
"hash" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16891",
"triggerID" : "9b8fd35638220cdc084d9d16b7e39b67025798aa",
"triggerType" : "PUSH"
}, {
"hash" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16953",
"triggerID" : "b285ca4f163dc720d061cfa9ade88aefed49dff1",
"triggerType" : "PUSH"
}, {
"hash" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16982",
"triggerID" : "4a8aeb33a5a7dff29c8d488028a9eb7df0ff67b7",
"triggerType" : "PUSH"
}, {
"hash" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988",
"triggerID" : "3dca5ebd346463d52d2f413080ca9e3f87b7a40a",
"triggerType" : "PUSH"
}, {
"hash" : "36f9bb2a1380683736a7a7465fb897e0a802c733",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "36f9bb2a1380683736a7a7465fb897e0a802c733",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* b6a62994325c4b1110a265262a56da1a94e1f6e2 UNKNOWN
* 3dca5ebd346463d52d2f413080ca9e3f87b7a40a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16988)
* 36f9bb2a1380683736a7a7465fb897e0a802c733 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1187718202
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
Review Comment:
The log you show is different; it copies the jars to `target/lib`. Could you try modifying the Spark version directly in POM and see if the changes can be compiled with Spark 3.3.1, to be safe?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rahil-c commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "rahil-c (via GitHub)" <gi...@apache.org>.
rahil-c commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1171670870
##########
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/storage/HoodieSparkFileReaderFactory.java:
##########
@@ -33,6 +33,7 @@ protected HoodieFileReader newParquetFileReader(Configuration conf, Path path) {
conf.setIfUnset(SQLConf.PARQUET_INT96_AS_TIMESTAMP().key(),
SQLConf.PARQUET_INT96_AS_TIMESTAMP().defaultValueString());
conf.setIfUnset(SQLConf.CASE_SENSITIVE().key(), SQLConf.CASE_SENSITIVE().defaultValueString());
+ conf.setIfUnset("spark.sql.legacy.parquet.nanosAsLong", "false");
Review Comment:
Sure I can add a comment before this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] CTTY commented on a diff in pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "CTTY (via GitHub)" <gi...@apache.org>.
CTTY commented on code in PR #8082:
URL: https://github.com/apache/hudi/pull/8082#discussion_r1171786381
##########
hudi-spark-datasource/hudi-spark3.3.x/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark332PlusHoodieParquetFileFormat.scala:
##########
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements. See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.spark.sql.execution.datasources.parquet
+
+import org.apache.hadoop.conf.Configuration
+import org.apache.spark.sql.SparkSession
+import org.apache.spark.sql.catalyst.InternalRow
+import org.apache.spark.sql.execution.datasources.PartitionedFile
+import org.apache.spark.sql.internal.SQLConf
+import org.apache.spark.sql.sources.Filter
+import org.apache.spark.sql.types.StructType
+
+class Spark332PlusHoodieParquetFileFormat(override protected val shouldAppendPartitionValues: Boolean) extends Spark32PlusHoodieParquetFileFormat(shouldAppendPartitionValues) {
Review Comment:
I'm good if we are not running into any compilation issues
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1460719448
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
}, {
"hash" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15559",
"triggerID" : "47cd0ff13e3bce77194c4c85bf3c9ec6ac190c1d",
"triggerType" : "PUSH"
}, {
"hash" : "d5333e95b609d585c00404c55151830108dd160c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15560",
"triggerID" : "d5333e95b609d585c00404c55151830108dd160c",
"triggerType" : "PUSH"
}, {
"hash" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15561",
"triggerID" : "a3473633e6456cf3d6ee4e4dfc34f98250bdff17",
"triggerType" : "PUSH"
}, {
"hash" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f43a772d2efe7d19657b44d2ce8b92b8fcee390f",
"triggerType" : "PUSH"
}, {
"hash" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15596",
"triggerID" : "5933ef4bb1a6c803c014ae3fc0a50886460193d0",
"triggerType" : "PUSH"
}, {
"hash" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15597",
"triggerID" : "f5b3f091499552a0dc44c547d6672301c6a95de9",
"triggerType" : "PUSH"
}, {
"hash" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15610",
"triggerID" : "3e2ae734bb05cdee830bead345f3be0a324e7d52",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612",
"triggerID" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"triggerType" : "PUSH"
}, {
"hash" : "9fc3fb68ef74a191e2e3c5da242c654c95169fbd",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625",
"triggerID" : "1460701128",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* f43a772d2efe7d19657b44d2ce8b92b8fcee390f UNKNOWN
* 9fc3fb68ef74a191e2e3c5da242c654c95169fbd Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15612) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15625)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1451041852
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1452775663
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541)
* 61dda6da1e111009d968f3af1735f56b43181be7 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1452811793
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15523",
"triggerID" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"triggerType" : "PUSH"
}, {
"hash" : "fb4c221c771d36a04ebf6bffbb9e993e4b32f4bf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15541",
"triggerID" : "1452764196",
"triggerType" : "MANUAL"
}, {
"hash" : "61dda6da1e111009d968f3af1735f56b43181be7",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542",
"triggerID" : "61dda6da1e111009d968f3af1735f56b43181be7",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 61dda6da1e111009d968f3af1735f56b43181be7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15542)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] wolf8334 commented on pull request #8082: [HUDI-5868] Upgrade Spark to 3.3.2
Posted by "wolf8334 (via GitHub)" <gi...@apache.org>.
wolf8334 commented on PR #8082:
URL: https://github.com/apache/hudi/pull/8082#issuecomment-1473267695
I am new to both github and hudi,but I want to help.
so plz tell me what can I do for you?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org