You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "xuzifu666 (via GitHub)" <gi...@apache.org> on 2023/03/08 14:05:28 UTC
[GitHub] [hudi] xuzifu666 opened a new pull request, #8133: [HUDI-5904] support one more update actions in merge into sql
xuzifu666 opened a new pull request, #8133:
URL: https://github.com/apache/hudi/pull/8133
### Change Logs
_Describe context and summary for this change. Highlight if any code was copied._
### Impact
_Describe any public API or user-facing feature change or any performance impact._
### Risk level (write none, low medium or high below)
_If medium or high, explain what verification was done to mitigate the risks._
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change_
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463434887
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* a690c5122694914f975ebbb717e06630ac3b5902 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646)
* a9f08395c3578b1567ec34ed61fb34acc219aa28 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654)
* 9795e86a4071d23307852ce59a09af8d5e41ffae UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "XuQianJin-Stars (via GitHub)" <gi...@apache.org>.
XuQianJin-Stars commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1132353849
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -19,7 +19,8 @@ package org.apache.spark.sql.hudi
import org.apache.hudi.{DataSourceReadOptions, HoodieDataSourceHelpers, HoodieSparkUtils, ScalaAssertionSupport}
import org.apache.hudi.common.fs.FSUtils
-import org.apache.hudi.exception.SchemaCompatibilityException
+import org.apache.spark.SparkConf
+import org.apache.spark.sql.SparkSession
Review Comment:
Can remove it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1462149339
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53a6b317d65baadbb12b440f45b39fecca8bba9d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636)
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 5b8a43f4b2f18352738b6e9c9a183a1bde5c4540 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1130727610
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,72 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
+ .config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
Review Comment:
Got it, thanks for the fix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1461928335
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d9df3394e7f023685edf606626268a625fc9b9cc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624)
* 53a6b317d65baadbb12b440f45b39fecca8bba9d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463187972
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 5b8a43f4b2f18352738b6e9c9a183a1bde5c4540 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639)
* 0268541001db5b561328bdf9390ee2cbcccc5e92 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463506582
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15657",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 9795e86a4071d23307852ce59a09af8d5e41ffae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1464219994
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15657",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15665",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666",
"triggerID" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"triggerType" : "PUSH"
}, {
"hash" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15667",
"triggerID" : "1464216645",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* f51a45589d72a12c4e894e17bb90a56bca44fca6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15667)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1460288422
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3057083a1b146bf864f1385be905a3ab3b3fb0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463368031
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* a690c5122694914f975ebbb717e06630ac3b5902 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463784272
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15657",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15665",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1132350431
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,65 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
+ .config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
Review Comment:
> other tests also set HoodieSparkSessionExtension.
yes，i had change it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463129575
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 5b8a43f4b2f18352738b6e9c9a183a1bde5c4540 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639)
* 0268541001db5b561328bdf9390ee2cbcccc5e92 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1460313296
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d9df3394e7f023685edf606626268a625fc9b9cc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463779687
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1132008580
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,65 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
Review Comment:
ok，thanks. I add a Todo issue https://issues.apache.org/jira/browse/HUDI-5918 @XuQianJin-Stars
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463442675
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 9795e86a4071d23307852ce59a09af8d5e41ffae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1130710788
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,72 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
+ .config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
Review Comment:
> Is this PR still valid since master seems already got the fix?
no，master is not fix. this pr can fix the problem for more than once update actions @danny0405
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1461944225
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d9df3394e7f023685edf606626268a625fc9b9cc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624)
* 53a6b317d65baadbb12b440f45b39fecca8bba9d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] leesf commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "leesf (via GitHub)" <gi...@apache.org>.
leesf commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1131055256
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,65 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
+ .config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
Review Comment:
these config can be removed and please refer to other tests.
```
val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
val spark = SparkSession.builder().config(conf)
.config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
.config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1462124893
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53a6b317d65baadbb12b440f45b39fecca8bba9d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636)
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463376698
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* a690c5122694914f975ebbb717e06630ac3b5902 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646)
* a9f08395c3578b1567ec34ed61fb34acc219aa28 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463226268
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 0268541001db5b561328bdf9390ee2cbcccc5e92 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644)
* a690c5122694914f975ebbb717e06630ac3b5902 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1462426618
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 5b8a43f4b2f18352738b6e9c9a183a1bde5c4540 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463803982
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15657",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15665",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666",
"triggerID" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* f51a45589d72a12c4e894e17bb90a56bca44fca6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1464216645
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1464477812
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15657",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15665",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666",
"triggerID" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"triggerType" : "PUSH"
}, {
"hash" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15667",
"triggerID" : "1464216645",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* f51a45589d72a12c4e894e17bb90a56bca44fca6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15667)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1462040249
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53a6b317d65baadbb12b440f45b39fecca8bba9d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463493476
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 9795e86a4071d23307852ce59a09af8d5e41ffae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "XuQianJin-Stars (via GitHub)" <gi...@apache.org>.
XuQianJin-Stars commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463492838
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463793039
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15657",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15665",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* f51a45589d72a12c4e894e17bb90a56bca44fca6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars merged pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "XuQianJin-Stars (via GitHub)" <gi...@apache.org>.
XuQianJin-Stars merged PR #8133:
URL: https://github.com/apache/hudi/pull/8133
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support one more update actions in merge into sql
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1460226276
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3057083a1b146bf864f1385be905a3ab3b3fb0 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1130533957
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,72 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
+ .config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
Review Comment:
Is this PR still valid since master seems already got the fix?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463177403
> Will cause data quality problems if we only remove the check, if source table without precombineField, look like hudi will add the first updateAction assignments vlaue expre which key is target precombineField to source df, because we need dedup before use payload And need add more test: cow/mor
>
> * different updateAction with diff precombine field expr
> * source table without precombineField (like target.precombineField = source.otherfield)
> a simple test like this:
>
> ```sql
> merge into $cowTableName t0
> using (
> select 1 as id, 'a1_n_6' as name, 6 as price, 1010 as v_ts, '1' as flag union
> select 2 as id, 'a2_n_6' as name, 6 as price, 1010 as v_ts, '2' as flag union
> select 6 as id, 'a3_n_6' as name, 6 as price, 1010 as v_ts, '1' as flag
> ) s0
> on s0.id = t0.id
> when matched and flag = '1' then update set
> id = s0.id, name = s0.name, ts = 1003
> when matched and flag = '2' then update set
> id = s0.id, price = s0.price, ts = s0.v_ts + 2
> when not matched and flag = '1' then insert *
> ```
yes，but mostly business is upsert only one record. i thought this is not impact bussiness in one record upsert
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1462136912
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 53a6b317d65baadbb12b440f45b39fecca8bba9d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636)
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 5b8a43f4b2f18352738b6e9c9a183a1bde5c4540 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1460300889
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3057083a1b146bf864f1385be905a3ab3b3fb0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623)
* d9df3394e7f023685edf606626268a625fc9b9cc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on pull request #8133: [HUDI-5904] support one more update actions in merge into sql
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1460255178
@danny0405 @XuQianJin-Stars have a review please
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1463199917
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* 5b8a43f4b2f18352738b6e9c9a183a1bde5c4540 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639)
* 0268541001db5b561328bdf9390ee2cbcccc5e92 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644)
* a690c5122694914f975ebbb717e06630ac3b5902 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8133:
URL: https://github.com/apache/hudi/pull/8133#issuecomment-1464204373
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15623",
"triggerID" : "8e3057083a1b146bf864f1385be905a3ab3b3fb0",
"triggerType" : "PUSH"
}, {
"hash" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15624",
"triggerID" : "d9df3394e7f023685edf606626268a625fc9b9cc",
"triggerType" : "PUSH"
}, {
"hash" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15636",
"triggerID" : "53a6b317d65baadbb12b440f45b39fecca8bba9d",
"triggerType" : "PUSH"
}, {
"hash" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620",
"triggerType" : "PUSH"
}, {
"hash" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15639",
"triggerID" : "5b8a43f4b2f18352738b6e9c9a183a1bde5c4540",
"triggerType" : "PUSH"
}, {
"hash" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15644",
"triggerID" : "0268541001db5b561328bdf9390ee2cbcccc5e92",
"triggerType" : "PUSH"
}, {
"hash" : "a690c5122694914f975ebbb717e06630ac3b5902",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15646",
"triggerID" : "a690c5122694914f975ebbb717e06630ac3b5902",
"triggerType" : "PUSH"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15654",
"triggerID" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15643",
"triggerID" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"triggerType" : "PUSH"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15657",
"triggerID" : "1463492838",
"triggerType" : "MANUAL"
}, {
"hash" : "a9f08395c3578b1567ec34ed61fb34acc219aa28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15665",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "9795e86a4071d23307852ce59a09af8d5e41ffae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15659",
"triggerID" : "1463779687",
"triggerType" : "MANUAL"
}, {
"hash" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666",
"triggerID" : "f51a45589d72a12c4e894e17bb90a56bca44fca6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8e3fad5fa9e9c64e7e345a317865f6fe6a9a7620 UNKNOWN
* f51a45589d72a12c4e894e17bb90a56bca44fca6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15666)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xuzifu666 commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "xuzifu666 (via GitHub)" <gi...@apache.org>.
xuzifu666 commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1131058033
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,65 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
+ .config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
Review Comment:
thanks，temple view need HoodieSparkSessionExtension，so i add this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] leesf commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "leesf (via GitHub)" <gi...@apache.org>.
leesf commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1132348375
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,65 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
+ .config("spark.sql.extensions", "org.apache.spark.sql.hudi.HoodieSparkSessionExtension")
Review Comment:
other tests also set HoodieSparkSessionExtension.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "XuQianJin-Stars (via GitHub)" <gi...@apache.org>.
XuQianJin-Stars commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1132353849
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -19,7 +19,8 @@ package org.apache.spark.sql.hudi
import org.apache.hudi.{DataSourceReadOptions, HoodieDataSourceHelpers, HoodieSparkUtils, ScalaAssertionSupport}
import org.apache.hudi.common.fs.FSUtils
-import org.apache.hudi.exception.SchemaCompatibilityException
+import org.apache.spark.SparkConf
+import org.apache.spark.sql.SparkSession
Review Comment:
Nit: can remove it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on a diff in pull request #8133: [HUDI-5904] support more than one update actions in merge into table
Posted by "XuQianJin-Stars (via GitHub)" <gi...@apache.org>.
XuQianJin-Stars commented on code in PR #8133:
URL: https://github.com/apache/hudi/pull/8133#discussion_r1131979301
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestMergeIntoTable.scala:
##########
@@ -115,6 +116,65 @@ class TestMergeIntoTable extends HoodieSparkSqlTestBase with ScalaAssertionSuppo
})
}
+ test("Test MergeInto with more than once update actions") {
+ withRecordType()(withTempDir {tmp =>
+ val conf = new SparkConf().setAppName("insertDatasToHudi").setMaster("local[*]")
+ val spark = SparkSession.builder().config(conf)
+ .config("spark.serializer", "org.apache.spark.serializer.KryoSerializer")
Review Comment:
Both `conf` and `spark` can be removed, both in the `HoodieSparkSqlTestBase` class.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org