You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/09/26 10:42:29 UTC
[GitHub] [hudi] fengjian428 opened a new pull request, #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
fengjian428 opened a new pull request, #6796:
URL: https://github.com/apache/hudi/pull/6796
…all in an infinity loop
### Change Logs
_Describe context and summary for this change. Highlight if any code was copied._
### Impact
_Describe any public API or user-facing feature change or any performance impact._
**Risk level: none | low | medium | high**
_Choose one. If medium or high, explain what verification was done to mitigate the risks._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1261179898
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 93f7f82686fd7dbb670a97d0e419f2051e4670f4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832)
* b28310f319ace9aa7d972ce3d5f93194c2237f31 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1261354675
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b28310f319ace9aa7d972ce3d5f93194c2237f31 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] fengjian428 commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
fengjian428 commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1261138010
I have tested this in append-only&non-shuffle&non-rebalance scenario, manually kill one TM, new operator can reuse the current instant, no side effects to other TMs.
without this, if kill one TM, the newly restored operator will throw "Timeout while waiting for initialize instant" Exception after 10 minites, then restart the whole job
@danny0405 @yuzhaojing
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1285861817
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
}, {
"hash" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b28310f319ace9aa7d972ce3d5f93194c2237f31 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850)
* 65fd7f9ce6e2c3448433c683c034694df3b12c85 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1261193943
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 93f7f82686fd7dbb670a97d0e419f2051e4670f4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832)
* b28310f319ace9aa7d972ce3d5f93194c2237f31 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1258377593
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1260539910
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d9f56f195dfdc3acd0962eeba3d646163fec0842 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828)
* 93f7f82686fd7dbb670a97d0e419f2051e4670f4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1259628593
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768)
* d9f56f195dfdc3acd0962eeba3d646163fec0842 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1286481122
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
}, {
"hash" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395",
"triggerID" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 65fd7f9ce6e2c3448433c683c034694df3b12c85 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1259017091
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] fengjian428 commented on a diff in pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
fengjian428 commented on code in PR #6796:
URL: https://github.com/apache/hudi/pull/6796#discussion_r980016780
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java:
##########
@@ -410,6 +414,12 @@ private void handleBootstrapEvent(WriteMetadataEvent event) {
if (Arrays.stream(eventBuffer).allMatch(evt -> evt != null && evt.isBootstrap())) {
// start to initialize the instant.
initInstant(event.getInstantTime());
+ } else if (event.isBootstrap() && subtaskResetStatus[event.getTaskID()] == 1
+ && !Arrays.stream(subtaskResetStatus).allMatch(st -> st == 1)) {
+ // handle partial failover, if only a subset of subtasks send bootstrap event, hence not all subtasks need to restore,
+ // then these subtasks can reuse previous instant to write
Review Comment:
> The full re-start failover is included in this check condition :)
Do you mean included in the first condition if (Arrays.stream(eventBuffer).allMatch(evt -> evt != null && evt.isBootstrap())) ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1261087577
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 93f7f82686fd7dbb670a97d0e419f2051e4670f4 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] fengjian428 commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
fengjian428 commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1258936193
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1260546263
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d9f56f195dfdc3acd0962eeba3d646163fec0842 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828)
* 93f7f82686fd7dbb670a97d0e419f2051e4670f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 merged pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
danny0405 merged PR #6796:
URL: https://github.com/apache/hudi/pull/6796
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1283593246
@danny0405 @yuzhaojing : can either of you guys follow up on review here please.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1295954485
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
}, {
"hash" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395",
"triggerID" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"triggerType" : "PUSH"
}, {
"hash" : "40a9ac7a64580aadb786d8ec0310a137be2245e2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12663",
"triggerID" : "40a9ac7a64580aadb786d8ec0310a137be2245e2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 40a9ac7a64580aadb786d8ec0310a137be2245e2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12663)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #6796:
URL: https://github.com/apache/hudi/pull/6796#discussion_r979968718
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java:
##########
@@ -410,6 +414,12 @@ private void handleBootstrapEvent(WriteMetadataEvent event) {
if (Arrays.stream(eventBuffer).allMatch(evt -> evt != null && evt.isBootstrap())) {
// start to initialize the instant.
initInstant(event.getInstantTime());
+ } else if (event.isBootstrap() && subtaskResetStatus[event.getTaskID()] == 1
+ && !Arrays.stream(subtaskResetStatus).allMatch(st -> st == 1)) {
+ // handle partial failover, if only a subset of subtasks send bootstrap event, hence not all subtasks need to restore,
+ // then these subtasks can reuse previous instant to write
Review Comment:
The full re-start failover is included in this check condition :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1259959079
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d9f56f195dfdc3acd0962eeba3d646163fec0842 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1257881234
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1260460580
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* d9f56f195dfdc3acd0962eeba3d646163fec0842 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1258961876
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1295909638
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
}, {
"hash" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395",
"triggerID" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"triggerType" : "PUSH"
}, {
"hash" : "40a9ac7a64580aadb786d8ec0310a137be2245e2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12663",
"triggerID" : "40a9ac7a64580aadb786d8ec0310a137be2245e2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 65fd7f9ce6e2c3448433c683c034694df3b12c85 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395)
* 40a9ac7a64580aadb786d8ec0310a137be2245e2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12663)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1295908456
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
}, {
"hash" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395",
"triggerID" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"triggerType" : "PUSH"
}, {
"hash" : "40a9ac7a64580aadb786d8ec0310a137be2245e2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "40a9ac7a64580aadb786d8ec0310a137be2245e2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 65fd7f9ce6e2c3448433c683c034694df3b12c85 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395)
* 40a9ac7a64580aadb786d8ec0310a137be2245e2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
danny0405 commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1295737904
[4741.patch.zip](https://github.com/apache/hudi/files/9893050/4741.patch.zip)
Thanks for the contribution, i have reviewed and applied a patch, this is a completely new patch, you may apply it directly on master base.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1259620856
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739) Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768)
* d9f56f195dfdc3acd0962eeba3d646163fec0842 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] XuQianJin-Stars commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
XuQianJin-Stars commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1260456837
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] fengjian428 commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
fengjian428 commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1257842843
@danny0405 this is just a hotfix for the infinity loop issue
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1257887125
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #6796: [HUDI-4741] hotfix to avoid partial failover cause restored subtask f…
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #6796:
URL: https://github.com/apache/hudi/pull/6796#issuecomment-1285868190
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11739",
"triggerID" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"triggerType" : "PUSH"
}, {
"hash" : "58b6620bef9f7af9e7d9dd2c1c7c69d652b54ec6",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11768",
"triggerID" : "1258936193",
"triggerType" : "MANUAL"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11793",
"triggerID" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"triggerType" : "PUSH"
}, {
"hash" : "d9f56f195dfdc3acd0962eeba3d646163fec0842",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11828",
"triggerID" : "1260456837",
"triggerType" : "MANUAL"
}, {
"hash" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11832",
"triggerID" : "93f7f82686fd7dbb670a97d0e419f2051e4670f4",
"triggerType" : "PUSH"
}, {
"hash" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850",
"triggerID" : "b28310f319ace9aa7d972ce3d5f93194c2237f31",
"triggerType" : "PUSH"
}, {
"hash" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395",
"triggerID" : "65fd7f9ce6e2c3448433c683c034694df3b12c85",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b28310f319ace9aa7d972ce3d5f93194c2237f31 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=11850)
* 65fd7f9ce6e2c3448433c683c034694df3b12c85 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=12395)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org