You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/16 18:58:53 UTC
[GitHub] [hudi] yuzhaojing opened a new pull request, #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
yuzhaojing opened a new pull request, #5890:
URL: https://github.com/apache/hudi/pull/5890
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*
## What is the purpose of the pull request
*(For example: This pull request adds quick-start document.)*
## Brief change log
*(for example:)*
- *Modify AnnotationLocation checkstyle rule in checkstyle.xml*
## Verify this pull request
*(Please pick either of the following options)*
This pull request is a trivial rework / code cleanup without any test coverage.
*(or)*
This pull request is already covered by existing tests, such as *(please describe tests)*.
(or)
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end.*
- *Added HoodieClientWriteTest to verify the change.*
- *Manually verified the change by running a job locally.*
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163868853
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* f848aee6edc047f633744d272a88f079bcf23adf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458)
* 8ce4693d9abc58cf40530dabdb32f8b2f2526865 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164301116
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1164299128",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467)
* 7101eceffe0728e0690283c1c96d62d4163508f4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161345818
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ad3fa03a343c906cd6fd96bdff69131d24424325 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366)
* 3ff0f9d5a8bd7c079fe0fb5534266872eb31717b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419)
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1158042759
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4608398f0fa8e47f0817fb957a6fd171bde9b219 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161820156
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* bad27b281256bc02dea359383176ffc72d590c60 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1158048059
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4608398f0fa8e47f0817fb957a6fd171bde9b219 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163933113
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 8ce4693d9abc58cf40530dabdb32f8b2f2526865 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462)
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164000382
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164297450
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467)
* 7101eceffe0728e0690283c1c96d62d4163508f4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r899722284
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -594,6 +594,12 @@ private FlinkOptions() {
.defaultValue(false) // default false for pipeline
.withDescription("Schedule the cluster plan, default false");
+ public static final ConfigOption<Boolean> CLUSTERING_ASYNC_ENABLED = ConfigOptions
+ .key("clustering.async.enabled")
+ .booleanType()
+ .defaultValue(false) // default false for pipeline
+ .withDescription("Async Clustering, default fals");
+
Review Comment:
fals -> false
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/ITTestDataStreamWrite.java:
##########
@@ -234,6 +234,7 @@ private void testWriteToHoodie(
Pipelines.clean(conf, pipeline);
Pipelines.compact(conf, pipeline);
}
+ Pipelines.cluster(conf, rowType, pipeline);
JobClient client = execEnv.executeAsync(jobName);
Review Comment:
Revert this line and add a new test for INSERT mode and async clustering.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java:
##########
@@ -253,6 +253,14 @@ public void notifyCheckpointComplete(long checkpointId) {
CompactionUtil.scheduleCompaction(metaClient, writeClient, tableState.isDeltaTimeCompaction, committed);
}
+ if (tableState.scheduleClustering && committed) {
+ // if async clustering is on, schedule the clustering
+ if (OptionsResolver.isBucketIndexType(conf)) {
+ throw new UnsupportedOperationException("Bucket index not supported for clustering.");
+ }
Review Comment:
`Bucket index not supported` -> `Bucket index is not supported`,
And can we move the code block:
```java
if (xxx) {
}
writeClient.scheduleClustering
```
into a tool clazz like ClusteringUtils.scheduleClustering(writeClient, committed), just like what we do to compaction
scheduling.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -650,6 +656,12 @@ private FlinkOptions() {
.defaultValue(30)
.withDescription("Maximum number of groups to create as part of ClusteringPlan. Increasing groups will increase parallelism, default is 30");
+ public static final ConfigOption<Integer> CLUSTERING_TIMEOUT_SECONDS = ConfigOptions
+ .key("clustering.timeout.seconds")
+ .intType()
+ .defaultValue(1200) // default 20 minutes
Review Comment:
The option can be removed because it is never used.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringOperator.java:
##########
@@ -100,15 +104,32 @@ public class ClusteringOperator extends TableStreamOperator<ClusteringCommitEven
private transient AvroToRowDataConverters.AvroToRowDataConverter avroToRowDataConverter;
private transient HoodieFlinkWriteClient writeClient;
private transient BulkInsertWriterHelper writerHelper;
- private transient String instantTime;
private transient BinaryExternalSorter sorter;
private transient StreamRecordCollector<ClusteringCommitEvent> collector;
private transient BinaryRowDataSerializer binarySerializer;
+ /**
+ * Whether to execute compaction asynchronously.
+ */
+ private final boolean asyncClustering;
+
+ /**
+ * Executor service to execute the clustering task.
+ */
+ private transient NonThrownExecutor executor;
+
+ /**
+ * Flag saying whether the schema is initialized,
+ * the table may be empty when start up, in order to fetch the latest schema,
+ * initializes the schema lazily.
+ */
+ private boolean initialized = false;
Review Comment:
Is it necessary to be lazy initialized ? Based on the fact that we already passed in the `rowType` on construction, only static schema is supported.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161392181
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ad3fa03a343c906cd6fd96bdff69131d24424325 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366)
* 3ff0f9d5a8bd7c079fe0fb5534266872eb31717b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419)
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1158906881
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4608398f0fa8e47f0817fb957a6fd171bde9b219 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345)
* 3c1f829328a7e59b36e2a49d1843439f20b5edfb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163084848
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* f420aa31d4d516ed0ac42f79cf6ea508610cb3f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453)
* 6f7e0eb38269361a49694e5047df673edf01e538 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456)
* f848aee6edc047f633744d272a88f079bcf23adf UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163930584
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 8ce4693d9abc58cf40530dabdb32f8b2f2526865 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462)
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1162612364
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* bad27b281256bc02dea359383176ffc72d590c60 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436)
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164304875
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1164299128",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1164304216",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467)
* 7101eceffe0728e0690283c1c96d62d4163508f4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164158389
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164701405
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164299128",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164304216",
"triggerType" : "MANUAL"
}, {
"hash" : "99b98b80a774ab0d51294b34b618a9f5c44aebcc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "99b98b80a774ab0d51294b34b618a9f5c44aebcc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7101eceffe0728e0690283c1c96d62d4163508f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470)
* 99b98b80a774ab0d51294b34b618a9f5c44aebcc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Athayde3586 commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
Athayde3586 commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164299128
Ur going to keep on
On Thu, Jun 23, 2022, 6:21 AM hudi-bot ***@***.***> wrote:
> CI report:
>
> - 08e1fa6
> <https://github.com/apache/hudi/commit/08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a>
> UNKNOWN
> - 34a0f8d
> <https://github.com/apache/hudi/commit/34a0f8d9d13806bc30c3a13df9f72c58e5834fa5>
> Azure: FAILURE
> <https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467>
>
> Bot commands @hudi-bot <https://github.com/hudi-bot> supports the
> following commands:
>
> - @hudi-bot run azure re-run the last Azure build
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/hudi/pull/5890#issuecomment-1164286194>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AYYXGWRP4WSGYVYSMMDT443VQRCDLANCNFSM5Y7YCD7Q>
> .
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163019098
```java
src/main/java/org/apache/hudi/util/ClusteringUtil.java:[23,8] (imports) UnusedImports: Unused import - org.apache.hudi.common.table.timeline.HoodieTimeline.
```
Please fix the checkstyle issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r904487370
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringPlanSourceFunction.java:
##########
@@ -75,7 +74,7 @@ public void open(Configuration parameters) throws Exception {
public void run(SourceContext<ClusteringPlanEvent> sourceContext) throws Exception {
for (HoodieClusteringGroup clusteringGroup : clusteringPlan.getInputGroups()) {
LOG.info("ClusteringPlanSourceFunction cluster " + clusteringGroup + " files");
- sourceContext.collect(new ClusteringPlanEvent(this.instant.getTimestamp(), ClusteringGroupInfo.create(clusteringGroup), clusteringPlan.getStrategy().getStrategyParams()));
Review Comment:
Execute clustering plan for instant {} as {} file slices ?
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringPlanOperator.java:
##########
@@ -0,0 +1,139 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.sink.clustering;
+
+import org.apache.hudi.avro.model.HoodieClusteringGroup;
+import org.apache.hudi.avro.model.HoodieClusteringPlan;
+import org.apache.hudi.common.model.ClusteringGroupInfo;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.ClusteringUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.table.HoodieFlinkTable;
+import org.apache.hudi.util.ClusteringUtil;
+import org.apache.hudi.util.FlinkTables;
+import org.apache.hudi.util.StreamerUtil;
+
+import org.apache.flink.annotation.VisibleForTesting;
+import org.apache.flink.configuration.Configuration;
+import org.apache.flink.streaming.api.operators.AbstractStreamOperator;
+import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
+import org.apache.flink.streaming.api.operators.Output;
+import org.apache.flink.streaming.runtime.streamrecord.StreamRecord;
+
+/**
+ * Operator that generates the clustering plan with pluggable strategies on finished checkpoints.
+ *
+ * <p>It should be singleton to avoid conflicts.
+ */
+public class ClusteringPlanOperator extends AbstractStreamOperator<ClusteringPlanEvent>
+ implements OneInputStreamOperator<Object, ClusteringPlanEvent> {
+
+ /**
+ * Config options.
+ */
+ private final Configuration conf;
+
+ /**
+ * Meta Client.
+ */
+ @SuppressWarnings("rawtypes")
+ private transient HoodieFlinkTable table;
+
+ public ClusteringPlanOperator(Configuration conf) {
+ this.conf = conf;
+ }
+
+ @Override
+ public void open() throws Exception {
+ super.open();
+ this.table = FlinkTables.createTable(conf, getRuntimeContext());
+ // when starting up, rolls back all the inflight clustering instants if there exists,
+ // these instants are in priority for scheduling task because the clustering instants are
+ // scheduled from earliest(FIFO sequence).
+ ClusteringUtil.rollbackClustering(table, StreamerUtil.createWriteClient(conf, getRuntimeContext()));
+ }
+
+ @Override
+ public void processElement(StreamRecord<Object> streamRecord) {
+ // no operation
+ }
+
+ @Override
+ public void notifyCheckpointComplete(long checkpointId) {
+ try {
+ table.getMetaClient().reloadActiveTimeline();
+ scheduleClustering(table, checkpointId);
+ } catch (Throwable throwable) {
+ // make it fail-safe
+ LOG.error("Error while scheduling clustering plan for checkpoint: " + checkpointId, throwable);
+ }
+ }
+
+ private void scheduleClustering(HoodieFlinkTable<?> table, long checkpointId) {
+ // the first instant takes the highest priority.
+ Option<HoodieInstant> firstRequested = Option.fromJavaOptional(
+ ClusteringUtils.getPendingClusteringInstantTimes(table.getMetaClient()).stream()
+ .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED).findFirst());
+ if (!firstRequested.isPresent()) {
+ // do nothing.
+ LOG.info("No clustering plan for checkpoint " + checkpointId);
+ return;
+ }
+
+ String clusteringInstantTime = firstRequested.get().getTimestamp();
+
+ // generate clustering plan
+ // should support configurable commit metadata
+ Option<Pair<HoodieInstant, HoodieClusteringPlan>> clusteringPlanOption = ClusteringUtils.getClusteringPlan(
+ table.getMetaClient(), HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstantTime));
+
+ if (!clusteringPlanOption.isPresent()) {
+ // do nothing.
+ LOG.info("No clustering plan scheduled");
+ return;
+ }
+
+ HoodieClusteringPlan clusteringPlan = clusteringPlanOption.get().getRight();
+
+ if (clusteringPlan == null || (clusteringPlan.getInputGroups() == null)
+ || (clusteringPlan.getInputGroups().isEmpty())) {
+ // do nothing.
+ LOG.info("Empty clustering plan for instant " + clusteringInstantTime);
+ } else {
+ HoodieInstant instant = HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstantTime);
+ // Mark instant as clustering inflight
Review Comment:
`instant` can be reused because line 106 did the same thing.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringPlanOperator.java:
##########
@@ -0,0 +1,139 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.sink.clustering;
+
+import org.apache.hudi.avro.model.HoodieClusteringGroup;
+import org.apache.hudi.avro.model.HoodieClusteringPlan;
+import org.apache.hudi.common.model.ClusteringGroupInfo;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.ClusteringUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.table.HoodieFlinkTable;
+import org.apache.hudi.util.ClusteringUtil;
+import org.apache.hudi.util.FlinkTables;
+import org.apache.hudi.util.StreamerUtil;
+
+import org.apache.flink.annotation.VisibleForTesting;
+import org.apache.flink.configuration.Configuration;
+import org.apache.flink.streaming.api.operators.AbstractStreamOperator;
+import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
+import org.apache.flink.streaming.api.operators.Output;
+import org.apache.flink.streaming.runtime.streamrecord.StreamRecord;
+
+/**
+ * Operator that generates the clustering plan with pluggable strategies on finished checkpoints.
+ *
+ * <p>It should be singleton to avoid conflicts.
+ */
+public class ClusteringPlanOperator extends AbstractStreamOperator<ClusteringPlanEvent>
+ implements OneInputStreamOperator<Object, ClusteringPlanEvent> {
+
+ /**
+ * Config options.
+ */
+ private final Configuration conf;
+
+ /**
+ * Meta Client.
+ */
+ @SuppressWarnings("rawtypes")
+ private transient HoodieFlinkTable table;
+
+ public ClusteringPlanOperator(Configuration conf) {
+ this.conf = conf;
+ }
+
+ @Override
+ public void open() throws Exception {
+ super.open();
+ this.table = FlinkTables.createTable(conf, getRuntimeContext());
+ // when starting up, rolls back all the inflight clustering instants if there exists,
+ // these instants are in priority for scheduling task because the clustering instants are
+ // scheduled from earliest(FIFO sequence).
+ ClusteringUtil.rollbackClustering(table, StreamerUtil.createWriteClient(conf, getRuntimeContext()));
+ }
+
+ @Override
+ public void processElement(StreamRecord<Object> streamRecord) {
+ // no operation
+ }
+
+ @Override
+ public void notifyCheckpointComplete(long checkpointId) {
+ try {
+ table.getMetaClient().reloadActiveTimeline();
+ scheduleClustering(table, checkpointId);
+ } catch (Throwable throwable) {
+ // make it fail-safe
+ LOG.error("Error while scheduling clustering plan for checkpoint: " + checkpointId, throwable);
+ }
+ }
+
+ private void scheduleClustering(HoodieFlinkTable<?> table, long checkpointId) {
+ // the first instant takes the highest priority.
+ Option<HoodieInstant> firstRequested = Option.fromJavaOptional(
+ ClusteringUtils.getPendingClusteringInstantTimes(table.getMetaClient()).stream()
+ .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED).findFirst());
+ if (!firstRequested.isPresent()) {
+ // do nothing.
+ LOG.info("No clustering plan for checkpoint " + checkpointId);
+ return;
+ }
+
+ String clusteringInstantTime = firstRequested.get().getTimestamp();
+
+ // generate clustering plan
+ // should support configurable commit metadata
+ Option<Pair<HoodieInstant, HoodieClusteringPlan>> clusteringPlanOption = ClusteringUtils.getClusteringPlan(
+ table.getMetaClient(), HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstantTime));
+
+ if (!clusteringPlanOption.isPresent()) {
+ // do nothing.
+ LOG.info("No clustering plan scheduled");
+ return;
+ }
+
+ HoodieClusteringPlan clusteringPlan = clusteringPlanOption.get().getRight();
+
+ if (clusteringPlan == null || (clusteringPlan.getInputGroups() == null)
+ || (clusteringPlan.getInputGroups().isEmpty())) {
+ // do nothing.
+ LOG.info("Empty clustering plan for instant " + clusteringInstantTime);
+ } else {
+ HoodieInstant instant = HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstantTime);
+ // Mark instant as clustering inflight
+ table.getActiveTimeline().transitionReplaceRequestedToInflight(instant, Option.empty());
+ table.getMetaClient().reloadActiveTimeline();
+
+ for (HoodieClusteringGroup clusteringGroup : clusteringPlan.getInputGroups()) {
+ LOG.info("ClusteringPlanSourceFunction cluster " + clusteringGroup + " files");
+ output.collect(new StreamRecord<>(
Review Comment:
The message `ClusteringPlanSourceFunction` is wrong, `Execute clustering plan for instant {} as {} file slices` ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1162967723
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444)
* f420aa31d4d516ed0ac42f79cf6ea508610cb3f3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161652398
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r902557641
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringOperator.java:
##########
@@ -100,15 +105,25 @@ public class ClusteringOperator extends TableStreamOperator<ClusteringCommitEven
private transient AvroToRowDataConverters.AvroToRowDataConverter avroToRowDataConverter;
private transient HoodieFlinkWriteClient writeClient;
private transient BulkInsertWriterHelper writerHelper;
- private transient String instantTime;
private transient BinaryExternalSorter sorter;
private transient StreamRecordCollector<ClusteringCommitEvent> collector;
private transient BinaryRowDataSerializer binarySerializer;
+ /**
+ * Whether to execute compaction asynchronously.
+ */
Review Comment:
fixed.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/util/ClusteringUtil.java:
##########
@@ -0,0 +1,75 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.util;
+
+import org.apache.hudi.client.HoodieFlinkWriteClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.configuration.OptionsResolver;
+import org.apache.hudi.table.HoodieFlinkTable;
+
+import org.apache.flink.configuration.Configuration;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+/**
+ * Utilities for flink hudi clustering.
+ */
+public class ClusteringUtil {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ClusteringUtil.class);
+
+ public static void validateClusteringScheduling(Configuration conf) {
+ if (OptionsResolver.isBucketIndexType(conf)) {
+ throw new UnsupportedOperationException("Clustering is not supported for bucket index.");
+ }
+ }
+
+ /**
+ * Schedules clustering plan by condition.
+ *
+ * @param conf The configuration
+ * @param writeClient The write client
+ * @param committed Whether the instant was committed
+ */
+ public static void scheduleClustering(Configuration conf, HoodieFlinkWriteClient writeClient, boolean committed) {
+ validateClusteringScheduling(conf);
+ if (committed) {
+ writeClient.scheduleClustering(Option.empty());
+ }
+ }
+
+ /**
+ * Force rolls back all the inflight clustering instants, especially for job failover restart.
+ *
+ * @param table The hoodie table
+ */
+ public static void rollbackClustering(HoodieFlinkTable<?> table) {
+ HoodieTimeline inflightClusteringTimeline = table.getActiveTimeline()
+ .filterPendingCompactionTimeline()
Review Comment:
This is my mistake, fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161669429
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429)
* e2195d27bcd63c9b9a419aa09560d61ea9d9d75d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1158847794
Thanks for the work, i have reviewed and apply a patch here:
[4273-review.patch.zip](https://github.com/apache/hudi/files/8927620/4273-review.patch.zip)
You may need to go on with the patch for service mode :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r900690065
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/ITTestDataStreamWrite.java:
##########
@@ -234,6 +234,7 @@ private void testWriteToHoodie(
Pipelines.clean(conf, pipeline);
Pipelines.compact(conf, pipeline);
}
+ Pipelines.cluster(conf, rowType, pipeline);
JobClient client = execEnv.executeAsync(jobName);
Review Comment:
Ok, i will add this later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164111093
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Athayde3586 commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
Athayde3586 commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164304216
This is me
On Thu, Jun 23, 2022, 6:21 AM hudi-bot ***@***.***> wrote:
> CI report:
>
> - 08e1fa6
> <https://github.com/apache/hudi/commit/08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a>
> UNKNOWN
> - 34a0f8d
> <https://github.com/apache/hudi/commit/34a0f8d9d13806bc30c3a13df9f72c58e5834fa5>
> Azure: FAILURE
> <https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467>
>
> Bot commands @hudi-bot <https://github.com/hudi-bot> supports the
> following commands:
>
> - @hudi-bot run azure re-run the last Azure build
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/hudi/pull/5890#issuecomment-1164286194>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AYYXGWRP4WSGYVYSMMDT443VQRCDLANCNFSM5Y7YCD7Q>
> .
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1162971747
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444)
* f420aa31d4d516ed0ac42f79cf6ea508610cb3f3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r902557363
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/HoodieFlinkClusteringJob.java:
##########
@@ -45,148 +49,290 @@
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
+import java.util.concurrent.CompletableFuture;
+import java.util.concurrent.ExecutorService;
+import java.util.concurrent.Executors;
+
/**
* Flink hudi clustering program that can be executed manually.
*/
public class HoodieFlinkClusteringJob {
protected static final Logger LOG = LoggerFactory.getLogger(HoodieFlinkClusteringJob.class);
+ /**
+ * Flink Execution Environment.
+ */
+ private final AsyncClusteringService clusteringScheduleService;
+
+ public HoodieFlinkClusteringJob(AsyncClusteringService service) {
+ this.clusteringScheduleService = service;
+ }
+
public static void main(String[] args) throws Exception {
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
+ FlinkClusteringConfig cfg = getFlinkClusteringConfig(args);
+ Configuration conf = FlinkClusteringConfig.toFlinkConfig(cfg);
+
+ AsyncClusteringService service = new AsyncClusteringService(cfg, conf, env);
+
+ new HoodieFlinkClusteringJob(service).start(cfg.serviceMode);
+ }
+
+ /**
+ * Main method to start clustering service.
+ */
+ public void start(boolean serviceMode) throws Exception {
+ if (serviceMode) {
+ clusteringScheduleService.start(null);
+ try {
+ clusteringScheduleService.waitForShutdown();
+ } catch (Exception e) {
+ throw new HoodieException(e.getMessage(), e);
+ } finally {
+ LOG.info("Shut down hoodie flink clustering");
+ }
+ } else {
+ LOG.info("Hoodie Flink Clustering running only single round");
+ try {
+ clusteringScheduleService.cluster();
+ } catch (Exception e) {
+ LOG.error("Got error running delta sync once. Shutting down", e);
+ throw e;
+ } finally {
+ LOG.info("Shut down hoodie flink clustering");
+ }
+ }
+ }
+
+ public static FlinkClusteringConfig getFlinkClusteringConfig(String[] args) {
FlinkClusteringConfig cfg = new FlinkClusteringConfig();
JCommander cmd = new JCommander(cfg, null, args);
if (cfg.help || args.length == 0) {
cmd.usage();
System.exit(1);
}
+ return cfg;
+ }
- Configuration conf = FlinkClusteringConfig.toFlinkConfig(cfg);
-
- // create metaClient
- HoodieTableMetaClient metaClient = StreamerUtil.createMetaClient(conf);
-
- // set table name
- conf.setString(FlinkOptions.TABLE_NAME, metaClient.getTableConfig().getTableName());
-
- // set table type
- conf.setString(FlinkOptions.TABLE_TYPE, metaClient.getTableConfig().getTableType().name());
-
- // set record key field
- conf.setString(FlinkOptions.RECORD_KEY_FIELD, metaClient.getTableConfig().getRecordKeyFieldProp());
+ // -------------------------------------------------------------------------
+ // Inner Class
+ // -------------------------------------------------------------------------
+
+ /**
+ * Schedules clustering in service.
+ */
+ public static class AsyncClusteringService extends HoodieAsyncTableService {
+ private static final long serialVersionUID = 1L;
+
+ /**
+ * Flink Clustering Config.
+ */
+ private final FlinkClusteringConfig cfg;
+
+ /**
+ * Flink Config.
+ */
+ private final Configuration conf;
+
+ /**
+ * Meta Client.
+ */
+ private final HoodieTableMetaClient metaClient;
+
+ /**
+ * Write Client.
+ */
+ private final HoodieFlinkWriteClient<?> writeClient;
+
+ /**
+ * The hoodie table.
+ */
+ private final HoodieFlinkTable<?> table;
+
+ /**
+ * Flink Execution Environment.
+ */
+ private final StreamExecutionEnvironment env;
+
+ /**
+ * Executor Service.
+ */
+ private final ExecutorService executor;
+
+ public AsyncClusteringService(FlinkClusteringConfig cfg, Configuration conf, StreamExecutionEnvironment env) throws Exception {
+ this.cfg = cfg;
+ this.conf = conf;
+ this.env = env;
+ this.executor = Executors.newFixedThreadPool(1);
+
+ // create metaClient
+ this.metaClient = StreamerUtil.createMetaClient(conf);
+
+ // set table name
+ conf.setString(FlinkOptions.TABLE_NAME, metaClient.getTableConfig().getTableName());
+
+ // set table type
+ conf.setString(FlinkOptions.TABLE_TYPE, metaClient.getTableConfig().getTableType().name());
+
+ // set record key field
+ conf.setString(FlinkOptions.RECORD_KEY_FIELD, metaClient.getTableConfig().getRecordKeyFieldProp());
+
+ // set partition field
+ conf.setString(FlinkOptions.PARTITION_PATH_FIELD, metaClient.getTableConfig().getPartitionFieldProp());
+
+ // set table schema
+ CompactionUtil.setAvroSchema(conf, metaClient);
+
+ this.writeClient = StreamerUtil.createWriteClient(conf);
+ this.writeConfig = writeClient.getConfig();
+ this.table = writeClient.getHoodieTable();
+ }
- // set partition field
- conf.setString(FlinkOptions.PARTITION_PATH_FIELD, metaClient.getTableConfig().getPartitionFieldProp());
+ @Override
+ protected Pair<CompletableFuture, ExecutorService> startService() {
+ return Pair.of(CompletableFuture.supplyAsync(() -> {
+ boolean error = false;
+
+ try {
+ while (!isShutdownRequested()) {
+ try {
+ cluster();
+ Thread.sleep(cfg.minClusteringIntervalSeconds * 1000);
+ } catch (Exception e) {
+ LOG.error("Shutting down clustering service due to exception", e);
+ error = true;
+ throw new HoodieException(e.getMessage(), e);
+ }
+ }
+ } finally {
+ shutdownAsyncService(error);
+ }
+ return true;
+ }, executor), executor);
+ }
- // set table schema
- CompactionUtil.setAvroSchema(conf, metaClient);
+ private void cluster() throws Exception {
+ table.getMetaClient().reloadActiveTimeline();
- HoodieFlinkWriteClient writeClient = StreamerUtil.createWriteClient(conf);
- HoodieFlinkTable<?> table = writeClient.getHoodieTable();
+ // judges whether there are operations
+ // to compute the clustering instant time and exec clustering.
+ if (cfg.schedule) {
+ ClusteringUtil.validateClusteringScheduling(conf);
+ String clusteringInstantTime = HoodieActiveTimeline.createNewInstantTime();
+ boolean scheduled = writeClient.scheduleClusteringAtInstant(clusteringInstantTime, Option.empty());
+ if (!scheduled) {
+ // do nothing.
+ LOG.info("No clustering plan for this job ");
+ return;
+ }
+ table.getMetaClient().reloadActiveTimeline();
+ }
- // judge whether have operation
- // to compute the clustering instant time and do cluster.
- if (cfg.schedule) {
- String clusteringInstantTime = HoodieActiveTimeline.createNewInstantTime();
- boolean scheduled = writeClient.scheduleClusteringAtInstant(clusteringInstantTime, Option.empty());
- if (!scheduled) {
+ // fetch the instant based on the configured execution sequence
+ HoodieTimeline timeline = table.getActiveTimeline().filterPendingReplaceTimeline()
+ .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED);
+ Option<HoodieInstant> requested = CompactionUtil.isLIFO(cfg.clusteringSeq) ? timeline.lastInstant() : timeline.firstInstant();
+ if (!requested.isPresent()) {
// do nothing.
- LOG.info("No clustering plan for this job ");
+ LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
return;
}
- }
- table.getMetaClient().reloadActiveTimeline();
+ HoodieInstant clusteringInstant = requested.get();
- // fetch the instant based on the configured execution sequence
- HoodieTimeline timeline = table.getActiveTimeline().filterPendingReplaceTimeline()
- .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED);
- Option<HoodieInstant> requested = CompactionUtil.isLIFO(cfg.clusteringSeq) ? timeline.lastInstant() : timeline.firstInstant();
- if (!requested.isPresent()) {
- // do nothing.
- LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
- return;
- }
+ HoodieInstant inflightInstant = HoodieTimeline.getReplaceCommitInflightInstant(clusteringInstant.getTimestamp());
+ if (timeline.containsInstant(inflightInstant)) {
+ LOG.info("Rollback inflight clustering instant: [" + clusteringInstant + "]");
+ table.rollbackInflightClustering(inflightInstant,
+ commitToRollback -> writeClient.getPendingRollbackInfo(table.getMetaClient(), commitToRollback, false));
+ table.getMetaClient().reloadActiveTimeline();
+ }
- HoodieInstant clusteringInstant = requested.get();
+ // generate clustering plan
+ // should support configurable commit metadata
+ Option<Pair<HoodieInstant, HoodieClusteringPlan>> clusteringPlanOption = ClusteringUtils.getClusteringPlan(
+ table.getMetaClient(), clusteringInstant);
- HoodieInstant inflightInstant = HoodieTimeline.getReplaceCommitInflightInstant(clusteringInstant.getTimestamp());
- if (timeline.containsInstant(inflightInstant)) {
- LOG.info("Rollback inflight clustering instant: [" + clusteringInstant + "]");
- table.rollbackInflightClustering(inflightInstant,
- commitToRollback -> writeClient.getPendingRollbackInfo(table.getMetaClient(), commitToRollback, false));
- table.getMetaClient().reloadActiveTimeline();
- }
+ if (!clusteringPlanOption.isPresent()) {
+ // do nothing.
+ LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
+ return;
+ }
- // generate clustering plan
- // should support configurable commit metadata
- Option<Pair<HoodieInstant, HoodieClusteringPlan>> clusteringPlanOption = ClusteringUtils.getClusteringPlan(
- table.getMetaClient(), clusteringInstant);
+ HoodieClusteringPlan clusteringPlan = clusteringPlanOption.get().getRight();
- if (!clusteringPlanOption.isPresent()) {
- // do nothing.
- LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
- return;
- }
+ if (clusteringPlan == null || (clusteringPlan.getInputGroups() == null)
+ || (clusteringPlan.getInputGroups().isEmpty())) {
+ // No clustering plan, do nothing and return.
+ LOG.info("No clustering plan for instant " + clusteringInstant.getTimestamp());
+ return;
+ }
- HoodieClusteringPlan clusteringPlan = clusteringPlanOption.get().getRight();
+ HoodieInstant instant = HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstant.getTimestamp());
+ HoodieTimeline pendingClusteringTimeline = table.getActiveTimeline().filterPendingReplaceTimeline();
+ if (!pendingClusteringTimeline.containsInstant(instant)) {
+ // this means that the clustering plan was written to auxiliary path(.tmp)
+ // but not the meta path(.hoodie), this usually happens when the job crush
+ // exceptionally.
- if (clusteringPlan == null || (clusteringPlan.getInputGroups() == null)
- || (clusteringPlan.getInputGroups().isEmpty())) {
- // No clustering plan, do nothing and return.
- LOG.info("No clustering plan for instant " + clusteringInstant.getTimestamp());
- return;
- }
+ // clean the clustering plan in auxiliary path and cancels the clustering.
- HoodieInstant instant = HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstant.getTimestamp());
- HoodieTimeline pendingClusteringTimeline = table.getActiveTimeline().filterPendingReplaceTimeline();
- if (!pendingClusteringTimeline.containsInstant(instant)) {
- // this means that the clustering plan was written to auxiliary path(.tmp)
- // but not the meta path(.hoodie), this usually happens when the job crush
- // exceptionally.
+ LOG.warn("The clustering plan was fetched through the auxiliary path(.tmp) but not the meta path(.hoodie).\n"
+ + "Clean the clustering plan in auxiliary path and cancels the clustering");
+ CompactionUtil.cleanInstant(table.getMetaClient(), instant);
+ return;
+ }
- // clean the clustering plan in auxiliary path and cancels the clustering.
+ // get clusteringParallelism.
+ int clusteringParallelism = conf.getInteger(FlinkOptions.CLUSTERING_TASKS) == -1
+ ? clusteringPlan.getInputGroups().size() : conf.getInteger(FlinkOptions.CLUSTERING_TASKS);
- LOG.warn("The clustering plan was fetched through the auxiliary path(.tmp) but not the meta path(.hoodie).\n"
- + "Clean the clustering plan in auxiliary path and cancels the clustering");
- CompactionUtil.cleanInstant(table.getMetaClient(), instant);
- return;
- }
+ // Mark instant as clustering inflight
+ table.getActiveTimeline().transitionReplaceRequestedToInflight(instant, Option.empty());
- // get clusteringParallelism.
- int clusteringParallelism = conf.getInteger(FlinkOptions.CLUSTERING_TASKS) == -1
- ? clusteringPlan.getInputGroups().size() : conf.getInteger(FlinkOptions.CLUSTERING_TASKS);
+ final Schema tableAvroSchema = StreamerUtil.getTableAvroSchema(table.getMetaClient(), false);
+ final DataType rowDataType = AvroSchemaConverter.convertToDataType(tableAvroSchema);
+ final RowType rowType = (RowType) rowDataType.getLogicalType();
- // Mark instant as clustering inflight
- table.getActiveTimeline().transitionReplaceRequestedToInflight(instant, Option.empty());
+ // setup configuration
+ long ckpTimeout = env.getCheckpointConfig().getCheckpointTimeout();
+ conf.setLong(FlinkOptions.WRITE_COMMIT_ACK_TIMEOUT, ckpTimeout);
- final Schema tableAvroSchema = StreamerUtil.getTableAvroSchema(table.getMetaClient(), false);
- final DataType rowDataType = AvroSchemaConverter.convertToDataType(tableAvroSchema);
- final RowType rowType = (RowType) rowDataType.getLogicalType();
+ DataStream<ClusteringCommitEvent> dataStream = env.addSource(new ClusteringPlanSourceFunction(timeline.lastInstant().get(), clusteringPlan))
+ .name("clustering_source")
+ .uid("uid_clustering_source")
Review Comment:
Use clustering instant instand it.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringPlanOperator.java:
##########
@@ -0,0 +1,137 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.sink.clustering;
+
+import org.apache.hudi.avro.model.HoodieClusteringGroup;
+import org.apache.hudi.avro.model.HoodieClusteringPlan;
+import org.apache.hudi.common.model.ClusteringGroupInfo;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.ClusteringUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.table.HoodieFlinkTable;
+import org.apache.hudi.util.ClusteringUtil;
+import org.apache.hudi.util.FlinkTables;
+
+import org.apache.flink.annotation.VisibleForTesting;
+import org.apache.flink.configuration.Configuration;
+import org.apache.flink.streaming.api.operators.AbstractStreamOperator;
+import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
+import org.apache.flink.streaming.api.operators.Output;
+import org.apache.flink.streaming.runtime.streamrecord.StreamRecord;
+
+/**
+ * Operator that generates the clustering plan with pluggable strategies on finished checkpoints.
+ *
+ * <p>It should be singleton to avoid conflicts.
+ */
+public class ClusteringPlanOperator extends AbstractStreamOperator<ClusteringPlanEvent>
+ implements OneInputStreamOperator<Object, ClusteringPlanEvent> {
+
+ /**
+ * Config options.
+ */
+ private final Configuration conf;
+
+ /**
+ * Meta Client.
+ */
+ @SuppressWarnings("rawtypes")
+ private transient HoodieFlinkTable table;
+
+ public ClusteringPlanOperator(Configuration conf) {
+ this.conf = conf;
+ }
+
+ @Override
+ public void open() throws Exception {
+ super.open();
+ this.table = FlinkTables.createTable(conf, getRuntimeContext());
+ // when starting up, rolls back all the inflight clustering instants if there exists,
+ // these instants are in priority for scheduling task because the clustering instants are
+ // scheduled from earliest(FIFO sequence).
+ ClusteringUtil.rollbackClustering(table);
+ }
+
+ @Override
+ public void processElement(StreamRecord<Object> streamRecord) {
+ // no operation
+ }
+
+ @Override
+ public void notifyCheckpointComplete(long checkpointId) {
+ try {
+ table.getMetaClient().reloadActiveTimeline();
+ scheduleClustering(table, checkpointId);
+ } catch (Throwable throwable) {
+ // make it fail-safe
+ LOG.error("Error while scheduling clustering plan for checkpoint: " + checkpointId, throwable);
+ }
+ }
+
+ private void scheduleClustering(HoodieFlinkTable<?> table, long checkpointId) {
+ // the first instant takes the highest priority.
+ Option<HoodieInstant> firstRequested = table.getActiveTimeline().filterPendingReplaceTimeline()
+ .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED).firstInstant();
+ if (!firstRequested.isPresent()) {
Review Comment:
fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r902392796
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringOperator.java:
##########
@@ -100,15 +105,25 @@ public class ClusteringOperator extends TableStreamOperator<ClusteringCommitEven
private transient AvroToRowDataConverters.AvroToRowDataConverter avroToRowDataConverter;
private transient HoodieFlinkWriteClient writeClient;
private transient BulkInsertWriterHelper writerHelper;
- private transient String instantTime;
private transient BinaryExternalSorter sorter;
private transient StreamRecordCollector<ClusteringCommitEvent> collector;
private transient BinaryRowDataSerializer binarySerializer;
+ /**
+ * Whether to execute compaction asynchronously.
+ */
Review Comment:
compaction -> clustering
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringPlanOperator.java:
##########
@@ -0,0 +1,137 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.sink.clustering;
+
+import org.apache.hudi.avro.model.HoodieClusteringGroup;
+import org.apache.hudi.avro.model.HoodieClusteringPlan;
+import org.apache.hudi.common.model.ClusteringGroupInfo;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.ClusteringUtils;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.common.util.collection.Pair;
+import org.apache.hudi.table.HoodieFlinkTable;
+import org.apache.hudi.util.ClusteringUtil;
+import org.apache.hudi.util.FlinkTables;
+
+import org.apache.flink.annotation.VisibleForTesting;
+import org.apache.flink.configuration.Configuration;
+import org.apache.flink.streaming.api.operators.AbstractStreamOperator;
+import org.apache.flink.streaming.api.operators.OneInputStreamOperator;
+import org.apache.flink.streaming.api.operators.Output;
+import org.apache.flink.streaming.runtime.streamrecord.StreamRecord;
+
+/**
+ * Operator that generates the clustering plan with pluggable strategies on finished checkpoints.
+ *
+ * <p>It should be singleton to avoid conflicts.
+ */
+public class ClusteringPlanOperator extends AbstractStreamOperator<ClusteringPlanEvent>
+ implements OneInputStreamOperator<Object, ClusteringPlanEvent> {
+
+ /**
+ * Config options.
+ */
+ private final Configuration conf;
+
+ /**
+ * Meta Client.
+ */
+ @SuppressWarnings("rawtypes")
+ private transient HoodieFlinkTable table;
+
+ public ClusteringPlanOperator(Configuration conf) {
+ this.conf = conf;
+ }
+
+ @Override
+ public void open() throws Exception {
+ super.open();
+ this.table = FlinkTables.createTable(conf, getRuntimeContext());
+ // when starting up, rolls back all the inflight clustering instants if there exists,
+ // these instants are in priority for scheduling task because the clustering instants are
+ // scheduled from earliest(FIFO sequence).
+ ClusteringUtil.rollbackClustering(table);
+ }
+
+ @Override
+ public void processElement(StreamRecord<Object> streamRecord) {
+ // no operation
+ }
+
+ @Override
+ public void notifyCheckpointComplete(long checkpointId) {
+ try {
+ table.getMetaClient().reloadActiveTimeline();
+ scheduleClustering(table, checkpointId);
+ } catch (Throwable throwable) {
+ // make it fail-safe
+ LOG.error("Error while scheduling clustering plan for checkpoint: " + checkpointId, throwable);
+ }
+ }
+
+ private void scheduleClustering(HoodieFlinkTable<?> table, long checkpointId) {
+ // the first instant takes the highest priority.
+ Option<HoodieInstant> firstRequested = table.getActiveTimeline().filterPendingReplaceTimeline()
+ .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED).firstInstant();
+ if (!firstRequested.isPresent()) {
Review Comment:
We should use `ClusteringUtils.getPendingClusteringInstantTimes` to fetch the clustering instants, the clustering instant uses the `REPLACE_COMMIT_ACTION` as action which is same with `INSERT OVERWRITE`, we should distinguish here to avoid ambiguity
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/HoodieFlinkClusteringJob.java:
##########
@@ -45,148 +49,290 @@
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
+import java.util.concurrent.CompletableFuture;
+import java.util.concurrent.ExecutorService;
+import java.util.concurrent.Executors;
+
/**
* Flink hudi clustering program that can be executed manually.
*/
public class HoodieFlinkClusteringJob {
protected static final Logger LOG = LoggerFactory.getLogger(HoodieFlinkClusteringJob.class);
+ /**
+ * Flink Execution Environment.
+ */
+ private final AsyncClusteringService clusteringScheduleService;
+
+ public HoodieFlinkClusteringJob(AsyncClusteringService service) {
+ this.clusteringScheduleService = service;
+ }
+
public static void main(String[] args) throws Exception {
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
+ FlinkClusteringConfig cfg = getFlinkClusteringConfig(args);
+ Configuration conf = FlinkClusteringConfig.toFlinkConfig(cfg);
+
+ AsyncClusteringService service = new AsyncClusteringService(cfg, conf, env);
+
+ new HoodieFlinkClusteringJob(service).start(cfg.serviceMode);
+ }
+
+ /**
+ * Main method to start clustering service.
+ */
+ public void start(boolean serviceMode) throws Exception {
+ if (serviceMode) {
+ clusteringScheduleService.start(null);
+ try {
+ clusteringScheduleService.waitForShutdown();
+ } catch (Exception e) {
+ throw new HoodieException(e.getMessage(), e);
+ } finally {
+ LOG.info("Shut down hoodie flink clustering");
+ }
+ } else {
+ LOG.info("Hoodie Flink Clustering running only single round");
+ try {
+ clusteringScheduleService.cluster();
+ } catch (Exception e) {
+ LOG.error("Got error running delta sync once. Shutting down", e);
+ throw e;
+ } finally {
+ LOG.info("Shut down hoodie flink clustering");
+ }
+ }
+ }
+
+ public static FlinkClusteringConfig getFlinkClusteringConfig(String[] args) {
FlinkClusteringConfig cfg = new FlinkClusteringConfig();
JCommander cmd = new JCommander(cfg, null, args);
if (cfg.help || args.length == 0) {
cmd.usage();
System.exit(1);
}
+ return cfg;
+ }
- Configuration conf = FlinkClusteringConfig.toFlinkConfig(cfg);
-
- // create metaClient
- HoodieTableMetaClient metaClient = StreamerUtil.createMetaClient(conf);
-
- // set table name
- conf.setString(FlinkOptions.TABLE_NAME, metaClient.getTableConfig().getTableName());
-
- // set table type
- conf.setString(FlinkOptions.TABLE_TYPE, metaClient.getTableConfig().getTableType().name());
-
- // set record key field
- conf.setString(FlinkOptions.RECORD_KEY_FIELD, metaClient.getTableConfig().getRecordKeyFieldProp());
+ // -------------------------------------------------------------------------
+ // Inner Class
+ // -------------------------------------------------------------------------
+
+ /**
+ * Schedules clustering in service.
+ */
+ public static class AsyncClusteringService extends HoodieAsyncTableService {
+ private static final long serialVersionUID = 1L;
+
+ /**
+ * Flink Clustering Config.
+ */
+ private final FlinkClusteringConfig cfg;
+
+ /**
+ * Flink Config.
+ */
+ private final Configuration conf;
+
+ /**
+ * Meta Client.
+ */
+ private final HoodieTableMetaClient metaClient;
+
+ /**
+ * Write Client.
+ */
+ private final HoodieFlinkWriteClient<?> writeClient;
+
+ /**
+ * The hoodie table.
+ */
+ private final HoodieFlinkTable<?> table;
+
+ /**
+ * Flink Execution Environment.
+ */
+ private final StreamExecutionEnvironment env;
+
+ /**
+ * Executor Service.
+ */
+ private final ExecutorService executor;
+
+ public AsyncClusteringService(FlinkClusteringConfig cfg, Configuration conf, StreamExecutionEnvironment env) throws Exception {
+ this.cfg = cfg;
+ this.conf = conf;
+ this.env = env;
+ this.executor = Executors.newFixedThreadPool(1);
+
+ // create metaClient
+ this.metaClient = StreamerUtil.createMetaClient(conf);
+
+ // set table name
+ conf.setString(FlinkOptions.TABLE_NAME, metaClient.getTableConfig().getTableName());
+
+ // set table type
+ conf.setString(FlinkOptions.TABLE_TYPE, metaClient.getTableConfig().getTableType().name());
+
+ // set record key field
+ conf.setString(FlinkOptions.RECORD_KEY_FIELD, metaClient.getTableConfig().getRecordKeyFieldProp());
+
+ // set partition field
+ conf.setString(FlinkOptions.PARTITION_PATH_FIELD, metaClient.getTableConfig().getPartitionFieldProp());
+
+ // set table schema
+ CompactionUtil.setAvroSchema(conf, metaClient);
+
+ this.writeClient = StreamerUtil.createWriteClient(conf);
+ this.writeConfig = writeClient.getConfig();
+ this.table = writeClient.getHoodieTable();
+ }
- // set partition field
- conf.setString(FlinkOptions.PARTITION_PATH_FIELD, metaClient.getTableConfig().getPartitionFieldProp());
+ @Override
+ protected Pair<CompletableFuture, ExecutorService> startService() {
+ return Pair.of(CompletableFuture.supplyAsync(() -> {
+ boolean error = false;
+
+ try {
+ while (!isShutdownRequested()) {
+ try {
+ cluster();
+ Thread.sleep(cfg.minClusteringIntervalSeconds * 1000);
+ } catch (Exception e) {
+ LOG.error("Shutting down clustering service due to exception", e);
+ error = true;
+ throw new HoodieException(e.getMessage(), e);
+ }
+ }
+ } finally {
+ shutdownAsyncService(error);
+ }
+ return true;
+ }, executor), executor);
+ }
- // set table schema
- CompactionUtil.setAvroSchema(conf, metaClient);
+ private void cluster() throws Exception {
+ table.getMetaClient().reloadActiveTimeline();
- HoodieFlinkWriteClient writeClient = StreamerUtil.createWriteClient(conf);
- HoodieFlinkTable<?> table = writeClient.getHoodieTable();
+ // judges whether there are operations
+ // to compute the clustering instant time and exec clustering.
+ if (cfg.schedule) {
+ ClusteringUtil.validateClusteringScheduling(conf);
+ String clusteringInstantTime = HoodieActiveTimeline.createNewInstantTime();
+ boolean scheduled = writeClient.scheduleClusteringAtInstant(clusteringInstantTime, Option.empty());
+ if (!scheduled) {
+ // do nothing.
+ LOG.info("No clustering plan for this job ");
+ return;
+ }
+ table.getMetaClient().reloadActiveTimeline();
+ }
- // judge whether have operation
- // to compute the clustering instant time and do cluster.
- if (cfg.schedule) {
- String clusteringInstantTime = HoodieActiveTimeline.createNewInstantTime();
- boolean scheduled = writeClient.scheduleClusteringAtInstant(clusteringInstantTime, Option.empty());
- if (!scheduled) {
+ // fetch the instant based on the configured execution sequence
+ HoodieTimeline timeline = table.getActiveTimeline().filterPendingReplaceTimeline()
+ .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED);
+ Option<HoodieInstant> requested = CompactionUtil.isLIFO(cfg.clusteringSeq) ? timeline.lastInstant() : timeline.firstInstant();
+ if (!requested.isPresent()) {
// do nothing.
- LOG.info("No clustering plan for this job ");
+ LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
return;
}
- }
- table.getMetaClient().reloadActiveTimeline();
+ HoodieInstant clusteringInstant = requested.get();
- // fetch the instant based on the configured execution sequence
- HoodieTimeline timeline = table.getActiveTimeline().filterPendingReplaceTimeline()
- .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED);
- Option<HoodieInstant> requested = CompactionUtil.isLIFO(cfg.clusteringSeq) ? timeline.lastInstant() : timeline.firstInstant();
- if (!requested.isPresent()) {
- // do nothing.
- LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
- return;
- }
+ HoodieInstant inflightInstant = HoodieTimeline.getReplaceCommitInflightInstant(clusteringInstant.getTimestamp());
+ if (timeline.containsInstant(inflightInstant)) {
+ LOG.info("Rollback inflight clustering instant: [" + clusteringInstant + "]");
+ table.rollbackInflightClustering(inflightInstant,
+ commitToRollback -> writeClient.getPendingRollbackInfo(table.getMetaClient(), commitToRollback, false));
+ table.getMetaClient().reloadActiveTimeline();
+ }
- HoodieInstant clusteringInstant = requested.get();
+ // generate clustering plan
+ // should support configurable commit metadata
+ Option<Pair<HoodieInstant, HoodieClusteringPlan>> clusteringPlanOption = ClusteringUtils.getClusteringPlan(
+ table.getMetaClient(), clusteringInstant);
- HoodieInstant inflightInstant = HoodieTimeline.getReplaceCommitInflightInstant(clusteringInstant.getTimestamp());
- if (timeline.containsInstant(inflightInstant)) {
- LOG.info("Rollback inflight clustering instant: [" + clusteringInstant + "]");
- table.rollbackInflightClustering(inflightInstant,
- commitToRollback -> writeClient.getPendingRollbackInfo(table.getMetaClient(), commitToRollback, false));
- table.getMetaClient().reloadActiveTimeline();
- }
+ if (!clusteringPlanOption.isPresent()) {
+ // do nothing.
+ LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
+ return;
+ }
- // generate clustering plan
- // should support configurable commit metadata
- Option<Pair<HoodieInstant, HoodieClusteringPlan>> clusteringPlanOption = ClusteringUtils.getClusteringPlan(
- table.getMetaClient(), clusteringInstant);
+ HoodieClusteringPlan clusteringPlan = clusteringPlanOption.get().getRight();
- if (!clusteringPlanOption.isPresent()) {
- // do nothing.
- LOG.info("No clustering plan scheduled, turns on the clustering plan schedule with --schedule option");
- return;
- }
+ if (clusteringPlan == null || (clusteringPlan.getInputGroups() == null)
+ || (clusteringPlan.getInputGroups().isEmpty())) {
+ // No clustering plan, do nothing and return.
+ LOG.info("No clustering plan for instant " + clusteringInstant.getTimestamp());
+ return;
+ }
- HoodieClusteringPlan clusteringPlan = clusteringPlanOption.get().getRight();
+ HoodieInstant instant = HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstant.getTimestamp());
+ HoodieTimeline pendingClusteringTimeline = table.getActiveTimeline().filterPendingReplaceTimeline();
+ if (!pendingClusteringTimeline.containsInstant(instant)) {
+ // this means that the clustering plan was written to auxiliary path(.tmp)
+ // but not the meta path(.hoodie), this usually happens when the job crush
+ // exceptionally.
- if (clusteringPlan == null || (clusteringPlan.getInputGroups() == null)
- || (clusteringPlan.getInputGroups().isEmpty())) {
- // No clustering plan, do nothing and return.
- LOG.info("No clustering plan for instant " + clusteringInstant.getTimestamp());
- return;
- }
+ // clean the clustering plan in auxiliary path and cancels the clustering.
- HoodieInstant instant = HoodieTimeline.getReplaceCommitRequestedInstant(clusteringInstant.getTimestamp());
- HoodieTimeline pendingClusteringTimeline = table.getActiveTimeline().filterPendingReplaceTimeline();
- if (!pendingClusteringTimeline.containsInstant(instant)) {
- // this means that the clustering plan was written to auxiliary path(.tmp)
- // but not the meta path(.hoodie), this usually happens when the job crush
- // exceptionally.
+ LOG.warn("The clustering plan was fetched through the auxiliary path(.tmp) but not the meta path(.hoodie).\n"
+ + "Clean the clustering plan in auxiliary path and cancels the clustering");
+ CompactionUtil.cleanInstant(table.getMetaClient(), instant);
+ return;
+ }
- // clean the clustering plan in auxiliary path and cancels the clustering.
+ // get clusteringParallelism.
+ int clusteringParallelism = conf.getInteger(FlinkOptions.CLUSTERING_TASKS) == -1
+ ? clusteringPlan.getInputGroups().size() : conf.getInteger(FlinkOptions.CLUSTERING_TASKS);
- LOG.warn("The clustering plan was fetched through the auxiliary path(.tmp) but not the meta path(.hoodie).\n"
- + "Clean the clustering plan in auxiliary path and cancels the clustering");
- CompactionUtil.cleanInstant(table.getMetaClient(), instant);
- return;
- }
+ // Mark instant as clustering inflight
+ table.getActiveTimeline().transitionReplaceRequestedToInflight(instant, Option.empty());
- // get clusteringParallelism.
- int clusteringParallelism = conf.getInteger(FlinkOptions.CLUSTERING_TASKS) == -1
- ? clusteringPlan.getInputGroups().size() : conf.getInteger(FlinkOptions.CLUSTERING_TASKS);
+ final Schema tableAvroSchema = StreamerUtil.getTableAvroSchema(table.getMetaClient(), false);
+ final DataType rowDataType = AvroSchemaConverter.convertToDataType(tableAvroSchema);
+ final RowType rowType = (RowType) rowDataType.getLogicalType();
- // Mark instant as clustering inflight
- table.getActiveTimeline().transitionReplaceRequestedToInflight(instant, Option.empty());
+ // setup configuration
+ long ckpTimeout = env.getCheckpointConfig().getCheckpointTimeout();
+ conf.setLong(FlinkOptions.WRITE_COMMIT_ACK_TIMEOUT, ckpTimeout);
- final Schema tableAvroSchema = StreamerUtil.getTableAvroSchema(table.getMetaClient(), false);
- final DataType rowDataType = AvroSchemaConverter.convertToDataType(tableAvroSchema);
- final RowType rowType = (RowType) rowDataType.getLogicalType();
+ DataStream<ClusteringCommitEvent> dataStream = env.addSource(new ClusteringPlanSourceFunction(timeline.lastInstant().get(), clusteringPlan))
+ .name("clustering_source")
+ .uid("uid_clustering_source")
Review Comment:
Is `timeline.lastInstant().get()` the timestamp we want to cluster ? I don't think so.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/util/ClusteringUtil.java:
##########
@@ -0,0 +1,75 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.util;
+
+import org.apache.hudi.client.HoodieFlinkWriteClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.configuration.OptionsResolver;
+import org.apache.hudi.table.HoodieFlinkTable;
+
+import org.apache.flink.configuration.Configuration;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+/**
+ * Utilities for flink hudi clustering.
+ */
+public class ClusteringUtil {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ClusteringUtil.class);
+
+ public static void validateClusteringScheduling(Configuration conf) {
+ if (OptionsResolver.isBucketIndexType(conf)) {
+ throw new UnsupportedOperationException("Clustering is not supported for bucket index.");
+ }
+ }
+
+ /**
+ * Schedules clustering plan by condition.
+ *
+ * @param conf The configuration
+ * @param writeClient The write client
+ * @param committed Whether the instant was committed
+ */
+ public static void scheduleClustering(Configuration conf, HoodieFlinkWriteClient writeClient, boolean committed) {
+ validateClusteringScheduling(conf);
+ if (committed) {
+ writeClient.scheduleClustering(Option.empty());
+ }
+ }
+
+ /**
+ * Force rolls back all the inflight clustering instants, especially for job failover restart.
+ *
+ * @param table The hoodie table
+ */
+ public static void rollbackClustering(HoodieFlinkTable<?> table) {
+ HoodieTimeline inflightClusteringTimeline = table.getActiveTimeline()
+ .filterPendingCompactionTimeline()
Review Comment:
The timeline is wrong, you may need to fetch the clustering plan with REQUESTED instant to decide this is a clustering instant.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/HoodieFlinkClusteringJob.java:
##########
@@ -45,148 +49,290 @@
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
+import java.util.concurrent.CompletableFuture;
+import java.util.concurrent.ExecutorService;
+import java.util.concurrent.Executors;
+
/**
* Flink hudi clustering program that can be executed manually.
*/
public class HoodieFlinkClusteringJob {
protected static final Logger LOG = LoggerFactory.getLogger(HoodieFlinkClusteringJob.class);
+ /**
+ * Flink Execution Environment.
+ */
+ private final AsyncClusteringService clusteringScheduleService;
+
+ public HoodieFlinkClusteringJob(AsyncClusteringService service) {
+ this.clusteringScheduleService = service;
+ }
+
public static void main(String[] args) throws Exception {
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
+ FlinkClusteringConfig cfg = getFlinkClusteringConfig(args);
+ Configuration conf = FlinkClusteringConfig.toFlinkConfig(cfg);
+
+ AsyncClusteringService service = new AsyncClusteringService(cfg, conf, env);
+
+ new HoodieFlinkClusteringJob(service).start(cfg.serviceMode);
+ }
+
+ /**
+ * Main method to start clustering service.
+ */
+ public void start(boolean serviceMode) throws Exception {
+ if (serviceMode) {
+ clusteringScheduleService.start(null);
+ try {
+ clusteringScheduleService.waitForShutdown();
+ } catch (Exception e) {
+ throw new HoodieException(e.getMessage(), e);
+ } finally {
+ LOG.info("Shut down hoodie flink clustering");
+ }
+ } else {
+ LOG.info("Hoodie Flink Clustering running only single round");
+ try {
+ clusteringScheduleService.cluster();
+ } catch (Exception e) {
+ LOG.error("Got error running delta sync once. Shutting down", e);
+ throw e;
+ } finally {
+ LOG.info("Shut down hoodie flink clustering");
+ }
+ }
+ }
+
+ public static FlinkClusteringConfig getFlinkClusteringConfig(String[] args) {
FlinkClusteringConfig cfg = new FlinkClusteringConfig();
JCommander cmd = new JCommander(cfg, null, args);
if (cfg.help || args.length == 0) {
cmd.usage();
System.exit(1);
}
+ return cfg;
+ }
- Configuration conf = FlinkClusteringConfig.toFlinkConfig(cfg);
-
- // create metaClient
- HoodieTableMetaClient metaClient = StreamerUtil.createMetaClient(conf);
-
- // set table name
- conf.setString(FlinkOptions.TABLE_NAME, metaClient.getTableConfig().getTableName());
-
- // set table type
- conf.setString(FlinkOptions.TABLE_TYPE, metaClient.getTableConfig().getTableType().name());
-
- // set record key field
- conf.setString(FlinkOptions.RECORD_KEY_FIELD, metaClient.getTableConfig().getRecordKeyFieldProp());
+ // -------------------------------------------------------------------------
+ // Inner Class
+ // -------------------------------------------------------------------------
+
+ /**
+ * Schedules clustering in service.
+ */
+ public static class AsyncClusteringService extends HoodieAsyncTableService {
+ private static final long serialVersionUID = 1L;
+
+ /**
+ * Flink Clustering Config.
+ */
+ private final FlinkClusteringConfig cfg;
+
+ /**
+ * Flink Config.
+ */
+ private final Configuration conf;
+
+ /**
+ * Meta Client.
+ */
+ private final HoodieTableMetaClient metaClient;
+
+ /**
+ * Write Client.
+ */
+ private final HoodieFlinkWriteClient<?> writeClient;
+
+ /**
+ * The hoodie table.
+ */
+ private final HoodieFlinkTable<?> table;
+
+ /**
+ * Flink Execution Environment.
+ */
+ private final StreamExecutionEnvironment env;
+
+ /**
+ * Executor Service.
+ */
+ private final ExecutorService executor;
+
+ public AsyncClusteringService(FlinkClusteringConfig cfg, Configuration conf, StreamExecutionEnvironment env) throws Exception {
+ this.cfg = cfg;
+ this.conf = conf;
+ this.env = env;
+ this.executor = Executors.newFixedThreadPool(1);
+
+ // create metaClient
+ this.metaClient = StreamerUtil.createMetaClient(conf);
+
+ // set table name
+ conf.setString(FlinkOptions.TABLE_NAME, metaClient.getTableConfig().getTableName());
+
+ // set table type
+ conf.setString(FlinkOptions.TABLE_TYPE, metaClient.getTableConfig().getTableType().name());
+
+ // set record key field
+ conf.setString(FlinkOptions.RECORD_KEY_FIELD, metaClient.getTableConfig().getRecordKeyFieldProp());
+
+ // set partition field
+ conf.setString(FlinkOptions.PARTITION_PATH_FIELD, metaClient.getTableConfig().getPartitionFieldProp());
+
+ // set table schema
+ CompactionUtil.setAvroSchema(conf, metaClient);
+
+ this.writeClient = StreamerUtil.createWriteClient(conf);
+ this.writeConfig = writeClient.getConfig();
+ this.table = writeClient.getHoodieTable();
+ }
- // set partition field
- conf.setString(FlinkOptions.PARTITION_PATH_FIELD, metaClient.getTableConfig().getPartitionFieldProp());
+ @Override
+ protected Pair<CompletableFuture, ExecutorService> startService() {
+ return Pair.of(CompletableFuture.supplyAsync(() -> {
+ boolean error = false;
+
+ try {
+ while (!isShutdownRequested()) {
+ try {
+ cluster();
+ Thread.sleep(cfg.minClusteringIntervalSeconds * 1000);
+ } catch (Exception e) {
+ LOG.error("Shutting down clustering service due to exception", e);
+ error = true;
+ throw new HoodieException(e.getMessage(), e);
+ }
+ }
+ } finally {
+ shutdownAsyncService(error);
+ }
+ return true;
+ }, executor), executor);
+ }
- // set table schema
- CompactionUtil.setAvroSchema(conf, metaClient);
+ private void cluster() throws Exception {
+ table.getMetaClient().reloadActiveTimeline();
- HoodieFlinkWriteClient writeClient = StreamerUtil.createWriteClient(conf);
- HoodieFlinkTable<?> table = writeClient.getHoodieTable();
+ // judges whether there are operations
+ // to compute the clustering instant time and exec clustering.
+ if (cfg.schedule) {
+ ClusteringUtil.validateClusteringScheduling(conf);
+ String clusteringInstantTime = HoodieActiveTimeline.createNewInstantTime();
+ boolean scheduled = writeClient.scheduleClusteringAtInstant(clusteringInstantTime, Option.empty());
+ if (!scheduled) {
+ // do nothing.
+ LOG.info("No clustering plan for this job ");
+ return;
+ }
+ table.getMetaClient().reloadActiveTimeline();
+ }
- // judge whether have operation
- // to compute the clustering instant time and do cluster.
- if (cfg.schedule) {
- String clusteringInstantTime = HoodieActiveTimeline.createNewInstantTime();
- boolean scheduled = writeClient.scheduleClusteringAtInstant(clusteringInstantTime, Option.empty());
- if (!scheduled) {
+ // fetch the instant based on the configured execution sequence
+ HoodieTimeline timeline = table.getActiveTimeline().filterPendingReplaceTimeline()
+ .filter(instant -> instant.getState() == HoodieInstant.State.REQUESTED);
Review Comment:
We should use ClusteringUtils.getPendingClusteringInstantTimes to fetch the clustering instants, the clustering instant uses the REPLACE_COMMIT_ACTION as action which is same with INSERT OVERWRITE, we should distinguish here to avoid ambiguity
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163870928
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* f848aee6edc047f633744d272a88f079bcf23adf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458)
* 8ce4693d9abc58cf40530dabdb32f8b2f2526865 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163413985
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* f848aee6edc047f633744d272a88f079bcf23adf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164113285
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1162980108
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444)
* f420aa31d4d516ed0ac42f79cf6ea508610cb3f3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453)
* 6f7e0eb38269361a49694e5047df673edf01e538 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163029001
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444)
* f420aa31d4d516ed0ac42f79cf6ea508610cb3f3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453)
* 6f7e0eb38269361a49694e5047df673edf01e538 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456)
* f848aee6edc047f633744d272a88f079bcf23adf UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r900689937
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -594,6 +594,12 @@ private FlinkOptions() {
.defaultValue(false) // default false for pipeline
.withDescription("Schedule the cluster plan, default false");
+ public static final ConfigOption<Boolean> CLUSTERING_ASYNC_ENABLED = ConfigOptions
+ .key("clustering.async.enabled")
+ .booleanType()
+ .defaultValue(false) // default false for pipeline
+ .withDescription("Async Clustering, default fals");
+
Review Comment:
fixed.
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java:
##########
@@ -253,6 +253,14 @@ public void notifyCheckpointComplete(long checkpointId) {
CompactionUtil.scheduleCompaction(metaClient, writeClient, tableState.isDeltaTimeCompaction, committed);
}
+ if (tableState.scheduleClustering && committed) {
+ // if async clustering is on, schedule the clustering
+ if (OptionsResolver.isBucketIndexType(conf)) {
+ throw new UnsupportedOperationException("Bucket index not supported for clustering.");
+ }
Review Comment:
fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r900689947
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java:
##########
@@ -650,6 +656,12 @@ private FlinkOptions() {
.defaultValue(30)
.withDescription("Maximum number of groups to create as part of ClusteringPlan. Increasing groups will increase parallelism, default is 30");
+ public static final ConfigOption<Integer> CLUSTERING_TIMEOUT_SECONDS = ConfigOptions
+ .key("clustering.timeout.seconds")
+ .intType()
+ .defaultValue(1200) // default 20 minutes
Review Comment:
fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161407727
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ad3fa03a343c906cd6fd96bdff69131d24424325 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366)
* 3ff0f9d5a8bd7c079fe0fb5534266872eb31717b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419)
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1159350461
> 感谢您的工作，我已在此处查看并应用补丁： [4273-review.patch.zip](https://github.com/apache/hudi/files/8927620/4273-review.patch.zip) 您可能需要继续使用补丁以用于服务模式:)
Thanks for review and patch, I will add service mode later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r900697528
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/clustering/ClusteringOperator.java:
##########
@@ -100,15 +104,32 @@ public class ClusteringOperator extends TableStreamOperator<ClusteringCommitEven
private transient AvroToRowDataConverters.AvroToRowDataConverter avroToRowDataConverter;
private transient HoodieFlinkWriteClient writeClient;
private transient BulkInsertWriterHelper writerHelper;
- private transient String instantTime;
private transient BinaryExternalSorter sorter;
private transient StreamRecordCollector<ClusteringCommitEvent> collector;
private transient BinaryRowDataSerializer binarySerializer;
+ /**
+ * Whether to execute compaction asynchronously.
+ */
+ private final boolean asyncClustering;
+
+ /**
+ * Executor service to execute the clustering task.
+ */
+ private transient NonThrownExecutor executor;
+
+ /**
+ * Flag saying whether the schema is initialized,
+ * the table may be empty when start up, in order to fetch the latest schema,
+ * initializes the schema lazily.
+ */
+ private boolean initialized = false;
Review Comment:
Modify it, passed schema from `rowType`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1159369068
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* ad3fa03a343c906cd6fd96bdff69131d24424325 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 merged pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 merged PR #5890:
URL: https://github.com/apache/hudi/pull/5890
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164815181
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164299128",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164304216",
"triggerType" : "MANUAL"
}, {
"hash" : "99b98b80a774ab0d51294b34b618a9f5c44aebcc",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9481",
"triggerID" : "99b98b80a774ab0d51294b34b618a9f5c44aebcc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 99b98b80a774ab0d51294b34b618a9f5c44aebcc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9481)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] Athayde3586 commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
Athayde3586 commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164295948
Quit trying to steal again fucken pussy
On Thu, Jun 23, 2022, 6:21 AM hudi-bot ***@***.***> wrote:
> CI report:
>
> - 08e1fa6
> <https://github.com/apache/hudi/commit/08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a>
> UNKNOWN
> - 34a0f8d
> <https://github.com/apache/hudi/commit/34a0f8d9d13806bc30c3a13df9f72c58e5834fa5>
> Azure: FAILURE
> <https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467>
>
> Bot commands @hudi-bot <https://github.com/hudi-bot> supports the
> following commands:
>
> - @hudi-bot run azure re-run the last Azure build
>
> —
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/hudi/pull/5890#issuecomment-1164286194>, or
> unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AYYXGWRP4WSGYVYSMMDT443VQRCDLANCNFSM5Y7YCD7Q>
> .
> You are receiving this because you are subscribed to this thread.Message
> ID: ***@***.***>
>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161654535
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161659566
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429)
* e2195d27bcd63c9b9a419aa09560d61ea9d9d75d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163024947
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444)
* f420aa31d4d516ed0ac42f79cf6ea508610cb3f3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453)
* 6f7e0eb38269361a49694e5047df673edf01e538 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163090091
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* f420aa31d4d516ed0ac42f79cf6ea508610cb3f3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453)
* 6f7e0eb38269361a49694e5047df673edf01e538 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456)
* f848aee6edc047f633744d272a88f079bcf23adf Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164237370
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463)
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161725105
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429)
* e2195d27bcd63c9b9a419aa09560d61ea9d9d75d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434)
* bad27b281256bc02dea359383176ffc72d590c60 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r903237307
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/ITTestDataStreamWrite.java:
##########
@@ -234,6 +234,7 @@ private void testWriteToHoodie(
Pipelines.clean(conf, pipeline);
Pipelines.compact(conf, pipeline);
}
+ Pipelines.cluster(conf, rowType, pipeline);
JobClient client = execEnv.executeAsync(jobName);
Review Comment:
Please remember to add it then ~
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r903236727
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/util/ClusteringUtil.java:
##########
@@ -0,0 +1,77 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.util;
+
+import org.apache.hudi.client.HoodieFlinkWriteClient;
+import org.apache.hudi.common.table.timeline.HoodieInstant;
+import org.apache.hudi.common.table.timeline.HoodieTimeline;
+import org.apache.hudi.common.util.Option;
+import org.apache.hudi.configuration.OptionsResolver;
+import org.apache.hudi.table.HoodieFlinkTable;
+
+import org.apache.flink.configuration.Configuration;
+import org.slf4j.Logger;
+import org.slf4j.LoggerFactory;
+
+/**
+ * Utilities for flink hudi clustering.
+ */
+public class ClusteringUtil {
+
+ private static final Logger LOG = LoggerFactory.getLogger(ClusteringUtil.class);
+
+ public static void validateClusteringScheduling(Configuration conf) {
+ if (OptionsResolver.isBucketIndexType(conf)) {
+ throw new UnsupportedOperationException("Clustering is not supported for bucket index.");
+ }
+ }
+
+ /**
+ * Schedules clustering plan by condition.
+ *
+ * @param conf The configuration
+ * @param writeClient The write client
+ * @param committed Whether the instant was committed
+ */
+ public static void scheduleClustering(Configuration conf, HoodieFlinkWriteClient writeClient, boolean committed) {
+ validateClusteringScheduling(conf);
+ if (committed) {
+ writeClient.scheduleClustering(Option.empty());
+ }
+ }
+
+ /**
+ * Force rolls back all the inflight clustering instants, especially for job failover restart.
+ *
+ * @param table The hoodie table
+ * @param writeClient The write client
+ */
+ public static void rollbackClustering(HoodieFlinkTable<?> table, HoodieFlinkWriteClient writeClient) {
+ HoodieTimeline inflightClusteringTimeline = table.getActiveTimeline()
+ .filterPendingReplaceTimeline()
+ .filter(instant ->
+ instant.getState() == HoodieInstant.State.INFLIGHT);
+ inflightClusteringTimeline.getInstants().forEach(inflightInstant -> {
+ LOG.info("Rollback the inflight clustering instant: " + inflightInstant + " for failover");
+ table.rollbackInflightClustering(inflightInstant,
+ commitToRollback -> writeClient.getPendingRollbackInfo(table.getMetaClient(), commitToRollback, false));
Review Comment:
We need to make sure the instant belongs to clustering action first.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1158955236
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3c1f829328a7e59b36e2a49d1843439f20b5edfb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1159361824
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1159367177
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* ad3fa03a343c906cd6fd96bdff69131d24424325 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1159350557
> Thanks for the work, i have reviewed and apply a patch here: [4273-review.patch.zip](https://github.com/apache/hudi/files/8927620/4273-review.patch.zip) You may need to go on with the patch for service mode :)
Thanks for review and patch, I will add service mode later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1158141044
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4608398f0fa8e47f0817fb957a6fd171bde9b219 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161736209
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* e2195d27bcd63c9b9a419aa09560d61ea9d9d75d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434)
* bad27b281256bc02dea359383176ffc72d590c60 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164175879
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463)
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164347281
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164299128",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164304216",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467)
* 7101eceffe0728e0690283c1c96d62d4163508f4 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164485750
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164299128",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164304216",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7101eceffe0728e0690283c1c96d62d4163508f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161537600
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3ff0f9d5a8bd7c079fe0fb5534266872eb31717b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419)
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1162718613
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163900725
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* f848aee6edc047f633744d272a88f079bcf23adf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458)
* 8ce4693d9abc58cf40530dabdb32f8b2f2526865 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462)
* 7ae535a205aa373c1967b6dcc752ec4ee67a551c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163260514
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 6f7e0eb38269361a49694e5047df673edf01e538 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456)
* f848aee6edc047f633744d272a88f079bcf23adf Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161342171
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ad3fa03a343c906cd6fd96bdff69131d24424325 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366)
* 3ff0f9d5a8bd7c079fe0fb5534266872eb31717b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1163027549
> ```java
> src/main/java/org/apache/hudi/util/ClusteringUtil.java:[23,8] (imports) UnusedImports: Unused import - org.apache.hudi.common.table.timeline.HoodieTimeline.
> ```
>
> Please fix the checkstyle issue.
fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1162638431
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* bad27b281256bc02dea359383176ffc72d590c60 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436)
* 2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164293782
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467)
* 7101eceffe0728e0690283c1c96d62d4163508f4 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1161592968
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 22b639b81ea33060ed656270ed5365d941d25dbe Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on a diff in pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
danny0405 commented on code in PR #5890:
URL: https://github.com/apache/hudi/pull/5890#discussion_r903660059
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/sink/ITTestDataStreamWrite.java:
##########
@@ -250,6 +261,71 @@ private void testWriteToHoodie(
}
TestData.checkWrittenFullData(tempFile, expected);
+ }
+
+ private void testWriteToHoodieWithCluster(
+ Configuration conf,
+ String jobName,
+ int checkpoints,
+ Map<String, List<String>> expected) throws Exception {
+
+ StreamExecutionEnvironment execEnv = StreamExecutionEnvironment.getExecutionEnvironment();
+ execEnv.getConfig().disableObjectReuse();
+ execEnv.setParallelism(4);
+ // set up checkpoint interval
+ execEnv.enableCheckpointing(4000, CheckpointingMode.EXACTLY_ONCE);
+ execEnv.getCheckpointConfig().setMaxConcurrentCheckpoints(1);
+
+ // Read from file source
+ RowType rowType =
+ (RowType) AvroSchemaConverter.convertToDataType(StreamerUtil.getSourceSchema(conf))
+ .getLogicalType();
+
+ JsonRowDataDeserializationSchema deserializationSchema = new JsonRowDataDeserializationSchema(
+ rowType,
+ InternalTypeInfo.of(rowType),
+ false,
+ true,
+ TimestampFormat.ISO_8601
+ );
+ String sourcePath = Objects.requireNonNull(Thread.currentThread()
+ .getContextClassLoader().getResource("test_source.data")).toString();
+ boolean isMor = conf.getString(FlinkOptions.TABLE_TYPE).equals(HoodieTableType.MERGE_ON_READ.name());
+
+ DataStream<RowData> dataStream;
+ if (isMor) {
+ TextInputFormat format = new TextInputFormat(new Path(sourcePath));
+ format.setFilesFilter(FilePathFilter.createDefaultFilter());
+ TypeInformation<String> typeInfo = BasicTypeInfo.STRING_TYPE_INFO;
+ format.setCharsetName("UTF-8");
+
+ dataStream = execEnv
+ // use PROCESS_CONTINUOUSLY mode to trigger checkpoint
+ .readFile(format, sourcePath, FileProcessingMode.PROCESS_CONTINUOUSLY, 1000, typeInfo)
+ .map(record -> deserializationSchema.deserialize(record.getBytes(StandardCharsets.UTF_8)))
+ .setParallelism(1);
+ } else {
+ dataStream = execEnv
+ // use continuous file source to trigger checkpoint
+ .addSource(new ContinuousFileSource.BoundedSourceFunction(new Path(sourcePath), checkpoints))
+ .name("continuous_file_source")
+ .setParallelism(1)
+ .map(record -> deserializationSchema.deserialize(record.getBytes(StandardCharsets.UTF_8)))
+ .setParallelism(4);
+ }
+
+ int parallelism = execEnv.getParallelism();
+ DataStream<HoodieRecord> hoodieRecordDataStream = Pipelines.bootstrap(conf, rowType, parallelism, dataStream);
+ DataStream<Object> pipeline = Pipelines.hoodieStreamWrite(conf, parallelism, hoodieRecordDataStream);
+ execEnv.addOperator(pipeline.getTransformation());
Review Comment:
We should use `Pipelines.append` instead
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164286194
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 34a0f8d9d13806bc30c3a13df9f72c58e5834fa5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1164754937
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9366",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
}, {
"hash" : "",
"status" : "DELETED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9419",
"triggerID" : "3ff0f9d5a8bd7c079fe0fb5534266872eb31717b",
"triggerType" : "PUSH"
}, {
"hash" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"triggerType" : "PUSH"
}, {
"hash" : "22b639b81ea33060ed656270ed5365d941d25dbe",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9429",
"triggerID" : "1161652398",
"triggerType" : "MANUAL"
}, {
"hash" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9434",
"triggerID" : "e2195d27bcd63c9b9a419aa09560d61ea9d9d75d",
"triggerType" : "PUSH"
}, {
"hash" : "bad27b281256bc02dea359383176ffc72d590c60",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9436",
"triggerID" : "bad27b281256bc02dea359383176ffc72d590c60",
"triggerType" : "PUSH"
}, {
"hash" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9444",
"triggerID" : "2ccf74dd4a15eb7b5e9e1aa52476a41f1da01c3e",
"triggerType" : "PUSH"
}, {
"hash" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9453",
"triggerID" : "f420aa31d4d516ed0ac42f79cf6ea508610cb3f3",
"triggerType" : "PUSH"
}, {
"hash" : "6f7e0eb38269361a49694e5047df673edf01e538",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9456",
"triggerID" : "6f7e0eb38269361a49694e5047df673edf01e538",
"triggerType" : "PUSH"
}, {
"hash" : "f848aee6edc047f633744d272a88f079bcf23adf",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9458",
"triggerID" : "f848aee6edc047f633744d272a88f079bcf23adf",
"triggerType" : "PUSH"
}, {
"hash" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9462",
"triggerID" : "8ce4693d9abc58cf40530dabdb32f8b2f2526865",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"triggerType" : "PUSH"
}, {
"hash" : "7ae535a205aa373c1967b6dcc752ec4ee67a551c",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9463",
"triggerID" : "1164111093",
"triggerType" : "MANUAL"
}, {
"hash" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9467",
"triggerID" : "34a0f8d9d13806bc30c3a13df9f72c58e5834fa5",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"triggerType" : "PUSH"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164295948",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164299128",
"triggerType" : "MANUAL"
}, {
"hash" : "7101eceffe0728e0690283c1c96d62d4163508f4",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470",
"triggerID" : "1164304216",
"triggerType" : "MANUAL"
}, {
"hash" : "99b98b80a774ab0d51294b34b618a9f5c44aebcc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9481",
"triggerID" : "99b98b80a774ab0d51294b34b618a9f5c44aebcc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 08e1fa6f7820b82180d3c0352c1f92f2b4fe2c6a UNKNOWN
* 7101eceffe0728e0690283c1c96d62d4163508f4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9470)
* 99b98b80a774ab0d51294b34b618a9f5c44aebcc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9481)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1158902115
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 4608398f0fa8e47f0817fb957a6fd171bde9b219 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345)
* 3c1f829328a7e59b36e2a49d1843439f20b5edfb UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #5890: [HUDI-4273] Support inline schedule clustering for Flink stream
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on PR #5890:
URL: https://github.com/apache/hudi/pull/5890#issuecomment-1159366669
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9345",
"triggerID" : "4608398f0fa8e47f0817fb957a6fd171bde9b219",
"triggerType" : "PUSH"
}, {
"hash" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=9363",
"triggerID" : "3c1f829328a7e59b36e2a49d1843439f20b5edfb",
"triggerType" : "PUSH"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "",
"status" : "CANCELED",
"url" : "TBD",
"triggerID" : "1159361824",
"triggerType" : "MANUAL"
}, {
"hash" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ad3fa03a343c906cd6fd96bdff69131d24424325",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* Unknown: [CANCELED](TBD)
* ad3fa03a343c906cd6fd96bdff69131d24424325 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org