You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/11/14 06:04:35 UTC
[GitHub] [hudi] yihua opened a new pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
yihua opened a new pull request #3991:
URL: https://github.com/apache/hudi/pull/3991
## What is the purpose of the pull request
This PR adds an option to run async compaction and clustering jobs without providing the instant time, using the earliest instant of the corresponding requested action by default, to improve usability.
## Brief change log
- Adds an API in `HoodieTimeline` to find the first instant of a specific action and state.
- For `HoodieClusteringJob`, when `execute` mode is used, if the instant time is not provided from `--instant-time`, the job automatically finds the earliest scheduled clustering instant for execution.
- For `HoodieCompactor`, when executing compaction, if the instant time is not provided from `--instant-time`, the job automatically finds the earliest scheduled compaction instant for execution.
## Verify this pull request
This change added tests in `TestHoodieDeltaStreamer#testHoodieAsyncClusteringJob`.
The change has also been verified by running `HoodieCompactor` and `HoodieClusteringJob` with kafka-connect:
- Compaction scheduled, run `HoodieCompactor`, earliest requested compaction instant is executed.
- Compaction done, run `HoodieCompactor`, throws an exception.
- Clustering scheduled, run `HoodieClusteringJob`, earliest requested clustering instant is executed.
- Clustering done, run `HoodieClusteringJob`, throws an exception.
Async compaction command:
```
spark-submit \
--class org.apache.hudi.utilities.HoodieCompactor \
hudi/packaging/hudi-utilities-bundle/target/hudi-utilities-bundle_2.11-0.10.0-SNAPSHOT.jar \
--base-path /tmp/hoodie/hudi-test-topic \
--table-name hudi-test-topic \
--schema-file /repo/hudi/docker/demo/config/schema.avsc \
--parallelism 2 \
--spark-memory 1g
```
Async clustering command:
```
spark-submit \
--class org.apache.hudi.utilities.HoodieClusteringJob \
hudi/packaging/hudi-utilities-bundle/target/hudi-utilities-bundle_2.11-0.10.0-SNAPSHOT.jar \
--props clusteringjob.properties \
--mode execute \
--base-path /tmp/hoodie/hudi-test-topic \
--table-name sample_table \
--spark-memory 1g
```
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-973646072
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-975531599
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-976035106
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
}, {
"hash" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
* d9815aef6044a87d9810c0bcfd308f8fc51239b9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-976085582
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
}, {
"hash" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3606",
"triggerID" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d9815aef6044a87d9810c0bcfd308f8fc51239b9 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3606)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
yihua commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-968614948
@nsivabalan @codope for review
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-975534537
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-976036170
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
}, {
"hash" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3606",
"triggerID" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
* d9815aef6044a87d9810c0bcfd308f8fc51239b9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3606)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope merged pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
codope merged pull request #3991:
URL: https://github.com/apache/hudi/pull/3991
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-975592001
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on a change in pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
codope commented on a change in pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#discussion_r751804550
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieClusteringJob.java
##########
@@ -249,4 +263,10 @@ private int handleErrors(HoodieCommitMetadata metadata, String instantTime) {
return -1;
}
+ private HoodieTableMetaClient getMetaClient() {
+ if (metaClient == null) {
+ metaClient = HoodieTableMetaClient.builder().setConf(jsc.hadoopConfiguration()).setBasePath(cfg.basePath).setLoadActiveTimelineOnLoad(true).build();
+ }
+ return metaClient;
+ }
Review comment:
Consider moving this to `UtilHelpers`. We can reuse in `HoodieCompactor` as well.
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieClusteringJob.java
##########
@@ -190,6 +190,20 @@ private String getSchemaFromLatestInstant() throws Exception {
private int doCluster(JavaSparkContext jsc) throws Exception {
String schemaStr = getSchemaFromLatestInstant();
try (SparkRDDWriteClient<HoodieRecordPayload> client = UtilHelpers.createHoodieClient(jsc, cfg.basePath, schemaStr, cfg.parallelism, Option.empty(), props)) {
+ if (cfg.clusteringInstantTime == null) {
+ // Instant time is not specified
+ // Find the earliest scheduled clustering instant for execution
+ Option<HoodieInstant> firstClusteringInstant =
+ getMetaClient().getActiveTimeline().firstInstant(
+ HoodieTimeline.REPLACE_COMMIT_ACTION, HoodieInstant.State.REQUESTED);
+ if (firstClusteringInstant.isPresent()) {
+ cfg.clusteringInstantTime = firstClusteringInstant.get().getTimestamp();
+ LOG.info("Found the earliest scheduled clustering instant which will be executed: "
+ + cfg.clusteringInstantTime);
+ } else {
+ throw new RuntimeException("There is no scheduled clustering in the table.");
Review comment:
How about using the custom `HoodieClusteringException/HoodieCompactionException`?
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java
##########
@@ -134,6 +139,25 @@ private int doCompact(JavaSparkContext jsc) throws Exception {
String schemaStr = UtilHelpers.parseSchema(fs, cfg.schemaFile);
SparkRDDWriteClient<HoodieRecordPayload> client =
UtilHelpers.createHoodieClient(jsc, cfg.basePath, schemaStr, cfg.parallelism, Option.empty(), props);
+ // If no compaction instant is provided by --instant-time, find the earliest scheduled compaction
+ // instant from the active timeline
+ if (cfg.compactionInstantTime == null) {
Review comment:
let's use `StringUtils.isNullOrEmpty`
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieDefaultTimeline.java
##########
@@ -274,6 +274,16 @@ public int countInstants() {
return Option.fromJavaOptional(instants.stream().findFirst());
}
+ @Override
+ public Option<HoodieInstant> firstInstant(String action, State state) {
+ for (HoodieInstant instant : instants) {
+ if (action.equals(instant.getAction()) && state.equals(instant.getState())) {
+ return Option.of(instant);
+ }
+ }
Review comment:
Consider using stream and filter to be in line with other APIs in the timeline.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-975534537
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-968218523
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-968218523
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-973670617
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-976035106
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
}, {
"hash" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
* d9815aef6044a87d9810c0bcfd308f8fc51239b9 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on a change in pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
yihua commented on a change in pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#discussion_r751818466
##########
File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieDefaultTimeline.java
##########
@@ -274,6 +274,16 @@ public int countInstants() {
return Option.fromJavaOptional(instants.stream().findFirst());
}
+ @Override
+ public Option<HoodieInstant> firstInstant(String action, State state) {
+ for (HoodieInstant instant : instants) {
+ if (action.equals(instant.getAction()) && state.equals(instant.getState())) {
+ return Option.of(instant);
+ }
+ }
Review comment:
Good call. Fixed.
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java
##########
@@ -134,6 +139,25 @@ private int doCompact(JavaSparkContext jsc) throws Exception {
String schemaStr = UtilHelpers.parseSchema(fs, cfg.schemaFile);
SparkRDDWriteClient<HoodieRecordPayload> client =
UtilHelpers.createHoodieClient(jsc, cfg.basePath, schemaStr, cfg.parallelism, Option.empty(), props);
+ // If no compaction instant is provided by --instant-time, find the earliest scheduled compaction
+ // instant from the active timeline
+ if (cfg.compactionInstantTime == null) {
Review comment:
Fixed.
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieClusteringJob.java
##########
@@ -249,4 +263,10 @@ private int handleErrors(HoodieCommitMetadata metadata, String instantTime) {
return -1;
}
+ private HoodieTableMetaClient getMetaClient() {
+ if (metaClient == null) {
+ metaClient = HoodieTableMetaClient.builder().setConf(jsc.hadoopConfiguration()).setBasePath(cfg.basePath).setLoadActiveTimelineOnLoad(true).build();
+ }
+ return metaClient;
+ }
Review comment:
Got it. Fixed.
##########
File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieClusteringJob.java
##########
@@ -190,6 +190,20 @@ private String getSchemaFromLatestInstant() throws Exception {
private int doCluster(JavaSparkContext jsc) throws Exception {
String schemaStr = getSchemaFromLatestInstant();
try (SparkRDDWriteClient<HoodieRecordPayload> client = UtilHelpers.createHoodieClient(jsc, cfg.basePath, schemaStr, cfg.parallelism, Option.empty(), props)) {
+ if (cfg.clusteringInstantTime == null) {
+ // Instant time is not specified
+ // Find the earliest scheduled clustering instant for execution
+ Option<HoodieInstant> firstClusteringInstant =
+ getMetaClient().getActiveTimeline().firstInstant(
+ HoodieTimeline.REPLACE_COMMIT_ACTION, HoodieInstant.State.REQUESTED);
+ if (firstClusteringInstant.isPresent()) {
+ cfg.clusteringInstantTime = firstClusteringInstant.get().getTimestamp();
+ LOG.info("Found the earliest scheduled clustering instant which will be executed: "
+ + cfg.clusteringInstantTime);
+ } else {
+ throw new RuntimeException("There is no scheduled clustering in the table.");
Review comment:
Sg. Fixed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-973644881
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-968213197
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-973646072
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-974922055
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-968213587
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yihua commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
yihua commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-973644062
@codope Thanks for the review. I addressed the comments.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-975531599
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-975592001
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-974922055
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-974921664
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-973670617
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-973644881
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-968213587
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-968213197
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 7dc783721ada6cb675f58af0383fcb5d81f5c2db UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-974921664
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484)
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-974954149
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot removed a comment on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot removed a comment on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-974954149
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 2a40db3adb4f3f972f45a84e892164d78b6121b1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] hudi-bot commented on pull request #3991: [HUDI-2737] Use earliest instant for async compaction and clustering jobs
Posted by GitBox <gi...@apache.org>.
hudi-bot commented on pull request #3991:
URL: https://github.com/apache/hudi/pull/3991#issuecomment-976036170
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3356",
"triggerID" : "7dc783721ada6cb675f58af0383fcb5d81f5c2db",
"triggerType" : "PUSH"
}, {
"hash" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3484",
"triggerID" : "6a1b37be3d0e4bd361040b4e1dc59bd3274eb5c3",
"triggerType" : "PUSH"
}, {
"hash" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3555",
"triggerID" : "2a40db3adb4f3f972f45a84e892164d78b6121b1",
"triggerType" : "PUSH"
}, {
"hash" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589",
"triggerID" : "301a278ebf3abf5cc57b3b333c3ecbef9a384e84",
"triggerType" : "PUSH"
}, {
"hash" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"status" : "PENDING",
"url" : "https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3606",
"triggerID" : "d9815aef6044a87d9810c0bcfd308f8fc51239b9",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 301a278ebf3abf5cc57b3b333c3ecbef9a384e84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3589)
* d9815aef6044a87d9810c0bcfd308f8fc51239b9 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=3606)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org