You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "SteNicholas (via GitHub)" <gi...@apache.org> on 2023/07/16 17:01:49 UTC
[GitHub] [hudi] SteNicholas opened a new pull request, #9211: [HUDI-6540] Support failed writes clean policy for Flink
SteNicholas opened a new pull request, #9211:
URL: https://github.com/apache/hudi/pull/9211
### Change Logs
The failed writes clean policy should be lazy when write concurrency mode is optimistic concurrency control. `FlinkOptions` should support to config failed writes clean policy. The parameters of `FlinkStreamerConfig`, `FlinkCompactionConfig` and `FlinkClusteringConfig` should also support failed writes clean policy parameter. Meanwhile, append mode without inline clustering should add clean operator in pipeline to rollback failed writes.
### Impact
`FlinkOptions`, `FlinkStreamerConfig`, `FlinkCompactionConfig` and `FlinkClusteringConfig` supports to config failed writes clean policy. Meanwhile, append mode without inline clustering adds clean operator in pipeline to rollback failed writes via lazy failed writes clean policy.
### Risk level (write none, low medium or high below)
none.
### Documentation Update
none.
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Change Logs and Impact were stated clearly
- [x] Adequate tests were added if applicable
- [x] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1659070690
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922",
"triggerID" : "1657924510",
"triggerType" : "MANUAL"
}, {
"hash" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928",
"triggerID" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* c0b4aa4f64c37ee755284ce1b905459830d27ba9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649500610
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* d8e39cb69480b8eb9014f09f6b84e741b9092a9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635)
* 278399029bc5dc3ab81d0366b65aaed3cf019b7c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821)
* f8607c6bd9ecf09e8da2d6b372a80eff2221108d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1658712790
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922",
"triggerID" : "1657924510",
"triggerType" : "MANUAL"
}, {
"hash" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928",
"triggerID" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922)
* c0b4aa4f64c37ee755284ce1b905459830d27ba9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637145918
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637292455
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* d8e39cb69480b8eb9014f09f6b84e741b9092a9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649795214
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* f8607c6bd9ecf09e8da2d6b372a80eff2221108d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 merged pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 merged PR #9211:
URL: https://github.com/apache/hudi/pull/9211
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637147573
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637327728
@danny0405, even if the failed writes clean policy could be inferred from optimistic concurrent control is enabled, this support has no conflict with the inferernce. Meanwhile, append mode without inline clustering in multiple writers should require clean action to rollback failed writes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637195117
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628)
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* e88535130285a46f95b88c59655b44558df5173e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637206355
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628)
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* e88535130285a46f95b88c59655b44558df5173e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632)
* d8e39cb69480b8eb9014f09f6b84e741b9092a9f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649253690
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* d8e39cb69480b8eb9014f09f6b84e741b9092a9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635)
* 278399029bc5dc3ab81d0366b65aaed3cf019b7c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649468041
@stream2000, I mean that append mode without async clustering should add clean operator to trigger rollback failed writes, otherwise there is no clean action to rollback.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1659531558
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #9211:
URL: https://github.com/apache/hudi/pull/9211#discussion_r1274284407
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/TestWriteCopyOnWrite.java:
##########
@@ -114,10 +116,28 @@ public void testCheckpointFails() throws Exception {
}
@Test
- public void testSubtaskFails() throws Exception {
+ public void testSubtaskFailsWithEagerFailedWritesCleanPolicy() throws Exception {
+ testSubtaskFails()
+ // the last checkpoint instant was rolled back by subTaskFails(0, 2)
+ // with EAGER cleaning strategy
+ .assertNoEvent()
Review Comment:
Can we add new tests instead of modifying existing one?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1657538276
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* f8607c6bd9ecf09e8da2d6b372a80eff2221108d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826)
* b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1657991703
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922",
"triggerID" : "1657924510",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1658597615
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922",
"triggerID" : "1657924510",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1659544576
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922",
"triggerID" : "1657924510",
"triggerType" : "MANUAL"
}, {
"hash" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928",
"triggerID" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"triggerType" : "PUSH"
}, {
"hash" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18947",
"triggerID" : "1659531558",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* c0b4aa4f64c37ee755284ce1b905459830d27ba9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928) Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18947)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1660210933
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922",
"triggerID" : "1657924510",
"triggerType" : "MANUAL"
}, {
"hash" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928",
"triggerID" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"triggerType" : "PUSH"
}, {
"hash" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18947",
"triggerID" : "1659531558",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* c0b4aa4f64c37ee755284ce1b905459830d27ba9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18928) Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18947)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649522478
@danny0405, could you take a look at this pull request?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1658617497
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922",
"triggerID" : "1657924510",
"triggerType" : "MANUAL"
}, {
"hash" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c0b4aa4f64c37ee755284ce1b905459830d27ba9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909) Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18922)
* c0b4aa4f64c37ee755284ce1b905459830d27ba9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1661519274
@danny0405, the CI is successful. PTAL.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1657552120
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* f8607c6bd9ecf09e8da2d6b372a80eff2221108d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826)
* b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637182772
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637214090
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* e88535130285a46f95b88c59655b44558df5173e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632)
* d8e39cb69480b8eb9014f09f6b84e741b9092a9f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] stream2000 commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "stream2000 (via GitHub)" <gi...@apache.org>.
stream2000 commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649457125
> even if the failed writes clean policy could be inferred from optimistic concurrent control is enabled, this support has no conflict with the inference.
Do you mean by even if we can infer the lazy clean config, we still won't add the clean operator to the pipeline so we still need this pr?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on a diff in pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on code in PR #9211:
URL: https://github.com/apache/hudi/pull/9211#discussion_r1274428725
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/TestWriteCopyOnWrite.java:
##########
@@ -114,10 +116,28 @@ public void testCheckpointFails() throws Exception {
}
@Test
- public void testSubtaskFails() throws Exception {
+ public void testSubtaskFailsWithEagerFailedWritesCleanPolicy() throws Exception {
+ testSubtaskFails()
+ // the last checkpoint instant was rolled back by subTaskFails(0, 2)
+ // with EAGER cleaning strategy
+ .assertNoEvent()
Review Comment:
@danny0405, I only modified the name of test method and extracted part into a common method, not modify the existing one. PTAL.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649243768
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* d8e39cb69480b8eb9014f09f6b84e741b9092a9f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635)
* 278399029bc5dc3ab81d0366b65aaed3cf019b7c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on a diff in pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on code in PR #9211:
URL: https://github.com/apache/hudi/pull/9211#discussion_r1273233193
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSink.java:
##########
@@ -95,6 +95,9 @@ public SinkRuntimeProvider getSinkRuntimeProvider(Context context) {
DataStream<Object> pipeline = Pipelines.append(conf, rowType, dataStream, context.isBounded());
if (OptionsResolver.needsAsyncClustering(conf)) {
return Pipelines.cluster(conf, rowType, pipeline);
+ } else if (OptionsResolver.isLazyFailedWritesCleanPolicy(conf)) {
Review Comment:
@stream2000, thanks for the reminder. I have modified `HoodieFlinkStreamer`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on a diff in pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on code in PR #9211:
URL: https://github.com/apache/hudi/pull/9211#discussion_r1278770434
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/TestWriteCopyOnWrite.java:
##########
@@ -114,10 +116,28 @@ public void testCheckpointFails() throws Exception {
}
@Test
- public void testSubtaskFails() throws Exception {
+ public void testSubtaskFailsWithEagerFailedWritesCleanPolicy() throws Exception {
+ testSubtaskFails()
+ // the last checkpoint instant was rolled back by subTaskFails(0, 2)
+ // with EAGER cleaning strategy
+ .assertNoEvent()
Review Comment:
@danny0405, I have added a simple test for failed writes rollback. PTAL.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1657815058
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
}, {
"hash" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909",
"triggerID" : "b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* b9a9a998b722ebf7f2be0004c9ed65b9e5560ab1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18909)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #9211:
URL: https://github.com/apache/hudi/pull/9211#discussion_r1276995698
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/TestWriteCopyOnWrite.java:
##########
@@ -114,10 +116,28 @@ public void testCheckpointFails() throws Exception {
}
@Test
- public void testSubtaskFails() throws Exception {
+ public void testSubtaskFailsWithEagerFailedWritesCleanPolicy() throws Exception {
+ testSubtaskFails()
+ // the last checkpoint instant was rolled back by subTaskFails(0, 2)
+ // with EAGER cleaning strategy
+ .assertNoEvent()
Review Comment:
Just add a simple test for failed writes rollback, do not modify the existing tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] stream2000 commented on a diff in pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "stream2000 (via GitHub)" <gi...@apache.org>.
stream2000 commented on code in PR #9211:
URL: https://github.com/apache/hudi/pull/9211#discussion_r1273176064
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSink.java:
##########
@@ -95,6 +95,9 @@ public SinkRuntimeProvider getSinkRuntimeProvider(Context context) {
DataStream<Object> pipeline = Pipelines.append(conf, rowType, dataStream, context.isBounded());
if (OptionsResolver.needsAsyncClustering(conf)) {
return Pipelines.cluster(conf, rowType, pipeline);
+ } else if (OptionsResolver.isLazyFailedWritesCleanPolicy(conf)) {
Review Comment:
Should we also modify `HoodieFlinkStreamer` here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1649517541
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
}, {
"hash" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18635",
"triggerID" : "d8e39cb69480b8eb9014f09f6b84e741b9092a9f",
"triggerType" : "PUSH"
}, {
"hash" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821",
"triggerID" : "278399029bc5dc3ab81d0366b65aaed3cf019b7c",
"triggerType" : "PUSH"
}, {
"hash" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826",
"triggerID" : "f8607c6bd9ecf09e8da2d6b372a80eff2221108d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* 278399029bc5dc3ab81d0366b65aaed3cf019b7c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18821)
* f8607c6bd9ecf09e8da2d6b372a80eff2221108d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18826)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas closed pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas closed pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
URL: https://github.com/apache/hudi/pull/9211
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1657924510
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637193804
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628)
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] SteNicholas closed pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "SteNicholas (via GitHub)" <gi...@apache.org>.
SteNicholas closed pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
URL: https://github.com/apache/hudi/pull/9211
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637203593
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628",
"triggerID" : "d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb",
"triggerType" : "PUSH"
}, {
"hash" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b6afe889ca6b47f4d1d934bb552cc1c489f9d0af",
"triggerType" : "PUSH"
}, {
"hash" : "e88535130285a46f95b88c59655b44558df5173e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632",
"triggerID" : "e88535130285a46f95b88c59655b44558df5173e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d56f0036ce7c23791e55d72bd922ffd2d1dfcfbb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18628)
* b6afe889ca6b47f4d1d934bb552cc1c489f9d0af UNKNOWN
* e88535130285a46f95b88c59655b44558df5173e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=18632)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #9211: [HUDI-6540] Support failed writes clean policy for Flink
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #9211:
URL: https://github.com/apache/hudi/pull/9211#issuecomment-1637314609
> The failed writes clean policy should be lazy when write concurrency mode is optimistic concurrency control.
The write config builder would infer the cleaning strategy as lazy when optimistic concurrent control is enabled.
> Meanwhile, append mode without inline clustering should add clean operator in pipeline to rollback failed writes
Do you mean multi write use cases?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org