You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "nsivabalan (via GitHub)" <gi...@apache.org> on 2023/04/05 06:08:49 UTC
[GitHub] [hudi] nsivabalan opened a new pull request, #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
nsivabalan opened a new pull request, #8384:
URL: https://github.com/apache/hudi/pull/8384
### Change Logs
Looks like when we fallback to full partition cleaning in clean planner, we do FS based listing even though metadata is enabled. It was added in https://github.com/apache/hudi/pull/5169 mainly due to how delete_partition was designed back then. Later delete_partition logic evolved and now we should be good to make this metadata based if applicable.
### Impact
Will improve clean planning latency for large tables.
### Risk level (write none, low medium or high below)
low.
### Documentation Update
N/A
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1517299112
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
}, {
"hash" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452",
"triggerID" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"triggerType" : "PUSH"
}, {
"hash" : "7e73a5881712dba18c44bb38bb77750a18330062",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7e73a5881712dba18c44bb38bb77750a18330062",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 4064bbe0691f5243bf326815ff6f46d2ee9e4c69 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452)
* 7e73a5881712dba18c44bb38bb77750a18330062 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1514775383
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
}, {
"hash" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452",
"triggerID" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 4064bbe0691f5243bf326815ff6f46d2ee9e4c69 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1497021959
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 98414ab27ecfabe5aa59e226b2439c34f95dd515 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1507008192
@codope @yihua : can one of you guys review this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a diff in pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "codope (via GitHub)" <gi...@apache.org>.
codope commented on code in PR #8384:
URL: https://github.com/apache/hudi/pull/8384#discussion_r1165645419
##########
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java:
##########
@@ -381,7 +376,7 @@ private static List<String> getPartitionsAdded(HoodieCommitMetadata commitMetada
}
private static List<String> getPartitionsDeleted(HoodieCommitMetadata commitMetadata) {
- if (commitMetadata instanceof HoodieReplaceCommitMetadata
+ /*if (commitMetadata instanceof HoodieReplaceCommitMetadata
Review Comment:
Why comment this block? Can remove it if not being used.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1497216197
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 98414ab27ecfabe5aa59e226b2439c34f95dd515 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1513300845
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* f8aa7b91d7ef659ad35bb070372151e7e11a10a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236)
* 9d90f977124e1b1c49915c37151555e8b4dffe20 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430)
* 08ec5be9ed4587a91f76f2121ada5e16aea6e194 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1497006537
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1502343129
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 5f940196a50e33c966cd56ee4c18b431e4b8ecae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176)
* f8aa7b91d7ef659ad35bb070372151e7e11a10a2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1513286699
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* f8aa7b91d7ef659ad35bb070372151e7e11a10a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236)
* 9d90f977124e1b1c49915c37151555e8b4dffe20 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1513637016
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 9d90f977124e1b1c49915c37151555e8b4dffe20 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430)
* 08ec5be9ed4587a91f76f2121ada5e16aea6e194 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431)
* 27c25af03349c9661a14ac9be1b36bb46897df5f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #8384:
URL: https://github.com/apache/hudi/pull/8384#discussion_r1170049570
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTableDropPartition.scala:
##########
@@ -320,9 +364,26 @@ class TestAlterTableDropPartition extends HoodieSparkSqlTestBase {
| )
|""".stripMargin)
+ df.write.format("hudi")
+ .option(HoodieWriteConfig.TBL_NAME.key, tableName)
+ .option(TABLE_TYPE.key, COW_TABLE_TYPE_OPT_VAL)
+ .option(RECORDKEY_FIELD.key, "id")
+ .option(PRECOMBINE_FIELD.key, "ts")
+ .option(PARTITIONPATH_FIELD.key, "year,month,day")
+ .option(HIVE_STYLE_PARTITIONING.key, hiveStyle)
+ .option(KEYGENERATOR_CLASS_NAME.key, classOf[ComplexKeyGenerator].getName)
+ .option(HoodieWriteConfig.INSERT_PARALLELISM_VALUE.key, "1")
+ .option(HoodieWriteConfig.UPSERT_PARALLELISM_VALUE.key, "1")
+ .mode(SaveMode.Append)
+ .save(tablePath)
+
// drop 2021-10-01 partition
spark.sql(s"alter table $tableName drop partition (year='2021', month='10', day='01')")
+ // trigger clean so that partition deletion kicks in.
+ spark.sql(s"call run_clean(table => '$tableName', retain_commits => 1)")
+ .collect()
+
Review Comment:
in L394, we already assert that entire partition dir does not exist. I felt that should suffice.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1497013810
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 98414ab27ecfabe5aa59e226b2439c34f95dd515 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1502458629
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* f8aa7b91d7ef659ad35bb070372151e7e11a10a2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on a diff in pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #8384:
URL: https://github.com/apache/hudi/pull/8384#discussion_r1170092645
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTableDropPartition.scala:
##########
@@ -320,9 +364,26 @@ class TestAlterTableDropPartition extends HoodieSparkSqlTestBase {
| )
|""".stripMargin)
+ df.write.format("hudi")
+ .option(HoodieWriteConfig.TBL_NAME.key, tableName)
+ .option(TABLE_TYPE.key, COW_TABLE_TYPE_OPT_VAL)
+ .option(RECORDKEY_FIELD.key, "id")
+ .option(PRECOMBINE_FIELD.key, "ts")
+ .option(PARTITIONPATH_FIELD.key, "year,month,day")
+ .option(HIVE_STYLE_PARTITIONING.key, hiveStyle)
+ .option(KEYGENERATOR_CLASS_NAME.key, classOf[ComplexKeyGenerator].getName)
+ .option(HoodieWriteConfig.INSERT_PARALLELISM_VALUE.key, "1")
+ .option(HoodieWriteConfig.UPSERT_PARALLELISM_VALUE.key, "1")
+ .mode(SaveMode.Append)
+ .save(tablePath)
+
// drop 2021-10-01 partition
spark.sql(s"alter table $tableName drop partition (year='2021', month='10', day='01')")
+ // trigger clean so that partition deletion kicks in.
+ spark.sql(s"call run_clean(table => '$tableName', retain_commits => 1)")
+ .collect()
+
Review Comment:
I have added an assertion to validate no of files deleted w/ latest clean is > 0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1498394682
cc @umehrot2
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1517305756
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
}, {
"hash" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452",
"triggerID" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"triggerType" : "PUSH"
}, {
"hash" : "7e73a5881712dba18c44bb38bb77750a18330062",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16520",
"triggerID" : "7e73a5881712dba18c44bb38bb77750a18330062",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 4064bbe0691f5243bf326815ff6f46d2ee9e4c69 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452)
* 7e73a5881712dba18c44bb38bb77750a18330062 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16520)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1499771659
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 98414ab27ecfabe5aa59e226b2439c34f95dd515 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135)
* 5f940196a50e33c966cd56ee4c18b431e4b8ecae Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1513321805
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 9d90f977124e1b1c49915c37151555e8b4dffe20 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430)
* 08ec5be9ed4587a91f76f2121ada5e16aea6e194 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1513647893
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 08ec5be9ed4587a91f76f2121ada5e16aea6e194 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431)
* 27c25af03349c9661a14ac9be1b36bb46897df5f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1514099160
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 27c25af03349c9661a14ac9be1b36bb46897df5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] bvaradar commented on a diff in pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "bvaradar (via GitHub)" <gi...@apache.org>.
bvaradar commented on code in PR #8384:
URL: https://github.com/apache/hudi/pull/8384#discussion_r1169393529
##########
hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTableDropPartition.scala:
##########
@@ -320,9 +364,26 @@ class TestAlterTableDropPartition extends HoodieSparkSqlTestBase {
| )
|""".stripMargin)
+ df.write.format("hudi")
+ .option(HoodieWriteConfig.TBL_NAME.key, tableName)
+ .option(TABLE_TYPE.key, COW_TABLE_TYPE_OPT_VAL)
+ .option(RECORDKEY_FIELD.key, "id")
+ .option(PRECOMBINE_FIELD.key, "ts")
+ .option(PARTITIONPATH_FIELD.key, "year,month,day")
+ .option(HIVE_STYLE_PARTITIONING.key, hiveStyle)
+ .option(KEYGENERATOR_CLASS_NAME.key, classOf[ComplexKeyGenerator].getName)
+ .option(HoodieWriteConfig.INSERT_PARALLELISM_VALUE.key, "1")
+ .option(HoodieWriteConfig.UPSERT_PARALLELISM_VALUE.key, "1")
+ .mode(SaveMode.Append)
+ .save(tablePath)
+
// drop 2021-10-01 partition
spark.sql(s"alter table $tableName drop partition (year='2021', month='10', day='01')")
+ // trigger clean so that partition deletion kicks in.
+ spark.sql(s"call run_clean(table => '$tableName', retain_commits => 1)")
+ .collect()
+
Review Comment:
Should we expect the cleanup to delete non-zero files. If so, can we add assertion ?
##########
hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java:
##########
@@ -381,7 +376,7 @@ private static List<String> getPartitionsAdded(HoodieCommitMetadata commitMetada
}
private static List<String> getPartitionsDeleted(HoodieCommitMetadata commitMetadata) {
- if (commitMetadata instanceof HoodieReplaceCommitMetadata
+ /*if (commitMetadata instanceof HoodieReplaceCommitMetadata
Review Comment:
Yes, Lets remove the function completely as it is returning just an empty list.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1514104427
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
}, {
"hash" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 27c25af03349c9661a14ac9be1b36bb46897df5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440)
* 4064bbe0691f5243bf326815ff6f46d2ee9e4c69 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1514126860
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
}, {
"hash" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16430",
"triggerID" : "9d90f977124e1b1c49915c37151555e8b4dffe20",
"triggerType" : "PUSH"
}, {
"hash" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16431",
"triggerID" : "08ec5be9ed4587a91f76f2121ada5e16aea6e194",
"triggerType" : "PUSH"
}, {
"hash" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440",
"triggerID" : "27c25af03349c9661a14ac9be1b36bb46897df5f",
"triggerType" : "PUSH"
}, {
"hash" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452",
"triggerID" : "4064bbe0691f5243bf326815ff6f46d2ee9e4c69",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 27c25af03349c9661a14ac9be1b36bb46897df5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16440)
* 4064bbe0691f5243bf326815ff6f46d2ee9e4c69 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16452)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan merged pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan merged PR #8384:
URL: https://github.com/apache/hudi/pull/8384
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1499814190
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 5f940196a50e33c966cd56ee4c18b431e4b8ecae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1499737455
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 98414ab27ecfabe5aa59e226b2439c34f95dd515 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135)
* 5f940196a50e33c966cd56ee4c18b431e4b8ecae UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #8384: [HUDI-6039] Fixing FS based listing for full cleaning in clean Planner
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #8384:
URL: https://github.com/apache/hudi/pull/8384#issuecomment-1502352000
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "e0515dc272a9c4e810839366bc53310a216540a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "e0515dc272a9c4e810839366bc53310a216540a3",
"triggerType" : "PUSH"
}, {
"hash" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16135",
"triggerID" : "98414ab27ecfabe5aa59e226b2439c34f95dd515",
"triggerType" : "PUSH"
}, {
"hash" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176",
"triggerID" : "5f940196a50e33c966cd56ee4c18b431e4b8ecae",
"triggerType" : "PUSH"
}, {
"hash" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236",
"triggerID" : "f8aa7b91d7ef659ad35bb070372151e7e11a10a2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* e0515dc272a9c4e810839366bc53310a216540a3 UNKNOWN
* 5f940196a50e33c966cd56ee4c18b431e4b8ecae Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16176)
* f8aa7b91d7ef659ad35bb070372151e7e11a10a2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=16236)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org