You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "rfyu (via GitHub)" <gi...@apache.org> on 2023/03/27 07:42:50 UTC
[GitHub] [hudi] rfyu opened a new pull request, #8299: [HUDI-5990]Avoid missing data during incremental queries
rfyu opened a new pull request, #8299:
URL: https://github.com/apache/hudi/pull/8299
### Change Logs
Avoid missing data during incremental queries
The reason for missing data is that the timeline used by `MergeOnReadIncrementalRelation` only contain completed instants.When the incremental range contains an incomplete compaction plan, `fsView.getLatestMergedFileSlicesBeforeOrOn` in `collectFileSplits` will filter out some fileslices.
### Impact
cause wrong query results
### Risk level (write none, low medium or high below)
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change_
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1506901861
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
}, {
"hash" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278",
"triggerID" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"triggerType" : "PUSH"
}, {
"hash" : "c0fc740641546218180be303626a86aea628b3a2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c0fc740641546218180be303626a86aea628b3a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cbb28bbdfc0434564d7ddd363bb42405b9771ed1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278)
* c0fc740641546218180be303626a86aea628b3a2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rfyu commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "rfyu (via GitHub)" <gi...@apache.org>.
rfyu commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1489831084
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1484717168
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2f1a6724ca9f1ce24d7dc518fc165833055e996a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1484975084
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2c687b7b1cd34b08f93d76b10bedc1a907575767 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] rfyu commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "rfyu (via GitHub)" <gi...@apache.org>.
rfyu commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1506190152
@danny0405 @codope Could you please help to review?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1490162280
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 71963bcf055f63179dfdcc235478aff8487bd328 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1486432314
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2c687b7b1cd34b08f93d76b10bedc1a907575767 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941)
* 71963bcf055f63179dfdcc235478aff8487bd328 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1506963785
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
}, {
"hash" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278",
"triggerID" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"triggerType" : "PUSH"
}, {
"hash" : "c0fc740641546218180be303626a86aea628b3a2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16317",
"triggerID" : "c0fc740641546218180be303626a86aea628b3a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cbb28bbdfc0434564d7ddd363bb42405b9771ed1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278)
* c0fc740641546218180be303626a86aea628b3a2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16317)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope merged pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "codope (via GitHub)" <gi...@apache.org>.
codope merged PR #8299:
URL: https://github.com/apache/hudi/pull/8299
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #8299:
URL: https://github.com/apache/hudi/pull/8299#discussion_r1149231388
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/MergeOnReadIncrementalRelation.scala:
##########
@@ -60,9 +60,9 @@ case class MergeOnReadIncrementalRelation(override val sqlContext: SQLContext,
override protected def timeline: HoodieTimeline = {
if (fullTableScan) {
- super.timeline
+ metaClient.getCommitsAndCompactionTimeline
} else {
- super.timeline.findInstantsInRange(startTimestamp, endTimestamp)
+ metaClient.getCommitsAndCompactionTimeline.findInstantsInRange(startTimestamp, endTimestamp)
Review Comment:
Nice catch ~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1504669117
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
}, {
"hash" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71963bcf055f63179dfdcc235478aff8487bd328 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988)
* cbb28bbdfc0434564d7ddd363bb42405b9771ed1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1505032392
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
}, {
"hash" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278",
"triggerID" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* cbb28bbdfc0434564d7ddd363bb42405b9771ed1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1489836929
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 71963bcf055f63179dfdcc235478aff8487bd328 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1484802905
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2f1a6724ca9f1ce24d7dc518fc165833055e996a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940)
* 2c687b7b1cd34b08f93d76b10bedc1a907575767 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1484729536
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2f1a6724ca9f1ce24d7dc518fc165833055e996a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1507251690
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
}, {
"hash" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278",
"triggerID" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"triggerType" : "PUSH"
}, {
"hash" : "c0fc740641546218180be303626a86aea628b3a2",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16317",
"triggerID" : "c0fc740641546218180be303626a86aea628b3a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c0fc740641546218180be303626a86aea628b3a2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16317)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1504676930
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988",
"triggerID" : "1489831084",
"triggerType" : "MANUAL"
}, {
"hash" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278",
"triggerID" : "cbb28bbdfc0434564d7ddd363bb42405b9771ed1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71963bcf055f63179dfdcc235478aff8487bd328 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15988)
* cbb28bbdfc0434564d7ddd363bb42405b9771ed1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16278)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1486443678
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2c687b7b1cd34b08f93d76b10bedc1a907575767 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941)
* 71963bcf055f63179dfdcc235478aff8487bd328 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1486693386
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
}, {
"hash" : "71963bcf055f63179dfdcc235478aff8487bd328",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955",
"triggerID" : "71963bcf055f63179dfdcc235478aff8487bd328",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71963bcf055f63179dfdcc235478aff8487bd328 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15955)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8299: [HUDI-5990]Avoid missing data during incremental queries
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8299:
URL: https://github.com/apache/hudi/pull/8299#issuecomment-1484814755
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940",
"triggerID" : "2f1a6724ca9f1ce24d7dc518fc165833055e996a",
"triggerType" : "PUSH"
}, {
"hash" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941",
"triggerID" : "2c687b7b1cd34b08f93d76b10bedc1a907575767",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2f1a6724ca9f1ce24d7dc518fc165833055e996a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15940)
* 2c687b7b1cd34b08f93d76b10bedc1a907575767 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=15941)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org