You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "kroushan-nit (via GitHub)" <gi...@apache.org> on 2025/02/02 14:41:49 UTC
[PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent… [hudi]
kroushan-nit opened a new pull request, #12762:
URL: https://github.com/apache/hudi/pull/12762
… OffsetOutOfRange exception
### Change Logs
_Describe context and summary for this change. Highlight if any code was copied._
### Impact
_Describe any public API or user-facing feature change or any performance impact._
### Risk level (write none, low medium or high below)
_If medium or high, explain what verification was done to mitigate the risks._
### Documentation Update
_Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none"._
- _The config description must be updated if new configs are added or the default value of the configs are changed_
- _Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the
ticket number here and follow the [instruction](https://hudi.apache.org/contribute/developer-setup#website) to make
changes to the website._
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2629424704
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 529bb2521f1a45e376c450b47ae3b63bf7ae98a3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2640969106
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ff340738831a25aec9f49015cb94ab95622db65e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2666844978
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 261376b909a9af378b31cd7da4dfcec605f5a05f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470)
* 37ce0b365205c2d465316867005cf113da9cad78 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2669053810
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
}, {
"hash" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* c505f65882d1d53910fd996e1486d82486551cb5 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706)
* 495df92206ed018ec1c4b83a9baa11ee15b65abc UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #12762:
URL: https://github.com/apache/hudi/pull/12762#discussion_r1960678192
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/config/KafkaSourceConfig.java:
##########
@@ -167,6 +167,13 @@ public class KafkaSourceConfig extends HoodieConfig {
.withDocumentation("The class name of the Exception that needs to be retried, separated by commas. "
+ "Default is empty which means retry all the IOException and RuntimeException from KafkaConsumer");
+ public static final ConfigProperty<Long> OFFSET_SKIP_BUFFER_MINUTES = ConfigProperty
+ .key(PREFIX + "offset.skip.buffer.minutes")
+ .defaultValue(-1L)
+ .markAdvanced()
+ .withDocumentation("Time in minutes to move forward from retention time for reading offsets")
Review Comment:
```suggestion
.withDocumentation("Time in minutes to move forward from retention time for reading offsets "
+ "when the checkpoints are not available or out-of-bound to avoid potential "
+ "OffsetOutOfRange exception, as it is possible that the earliest Kafka offsets may "
+ "expire soon while the job is progressing.")
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2677554278
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
}, {
"hash" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710",
"triggerID" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"triggerType" : "PUSH"
}, {
"hash" : "50d898a4c0e7443514aba9735e27d3f90d1accfd",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3847",
"triggerID" : "50d898a4c0e7443514aba9735e27d3f90d1accfd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 50d898a4c0e7443514aba9735e27d3f90d1accfd Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3847)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2642983614
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 261376b909a9af378b31cd7da4dfcec605f5a05f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2666847714
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 261376b909a9af378b31cd7da4dfcec605f5a05f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470)
* 37ce0b365205c2d465316867005cf113da9cad78 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2636899565
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 529bb2521f1a45e376c450b47ae3b63bf7ae98a3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341)
* 615dc041f37a0b2ba8eb4503d89723047f24368e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2642721971
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ff340738831a25aec9f49015cb94ab95622db65e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436)
* 261376b909a9af378b31cd7da4dfcec605f5a05f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2642718411
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* ff340738831a25aec9f49015cb94ab95622db65e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436)
* 261376b909a9af378b31cd7da4dfcec605f5a05f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2640735879
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 615dc041f37a0b2ba8eb4503d89723047f24368e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391)
* ff340738831a25aec9f49015cb94ab95622db65e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2666866627
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 37ce0b365205c2d465316867005cf113da9cad78 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682)
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 3e4b7abb35fa983b7da2f29746eb9a32131bccc3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2668381099
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* c505f65882d1d53910fd996e1486d82486551cb5 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2666858432
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 261376b909a9af378b31cd7da4dfcec605f5a05f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470)
* 37ce0b365205c2d465316867005cf113da9cad78 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682)
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2629461396
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 529bb2521f1a45e376c450b47ae3b63bf7ae98a3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2668009291
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 3e4b7abb35fa983b7da2f29746eb9a32131bccc3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684)
* c505f65882d1d53910fd996e1486d82486551cb5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2636895542
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 529bb2521f1a45e376c450b47ae3b63bf7ae98a3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341)
* 615dc041f37a0b2ba8eb4503d89723047f24368e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2668109288
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 3e4b7abb35fa983b7da2f29746eb9a32131bccc3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684)
* c505f65882d1d53910fd996e1486d82486551cb5 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2666861311
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 37ce0b365205c2d465316867005cf113da9cad78 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682)
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua merged PR #12762:
URL: https://github.com/apache/hudi/pull/12762
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2677415824
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
}, {
"hash" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710",
"triggerID" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"triggerType" : "PUSH"
}, {
"hash" : "50d898a4c0e7443514aba9735e27d3f90d1accfd",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "50d898a4c0e7443514aba9735e27d3f90d1accfd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 495df92206ed018ec1c4b83a9baa11ee15b65abc Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710)
* 50d898a4c0e7443514aba9735e27d3f90d1accfd UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2637298543
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 615dc041f37a0b2ba8eb4503d89723047f24368e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2640739588
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 615dc041f37a0b2ba8eb4503d89723047f24368e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391)
* ff340738831a25aec9f49015cb94ab95622db65e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2667141451
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 3e4b7abb35fa983b7da2f29746eb9a32131bccc3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2669278844
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
}, {
"hash" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710",
"triggerID" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 495df92206ed018ec1c4b83a9baa11ee15b65abc Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent… [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2629425257
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 529bb2521f1a45e376c450b47ae3b63bf7ae98a3 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #12762:
URL: https://github.com/apache/hudi/pull/12762#discussion_r1960660388
##########
hudi-common/src/main/java/org/apache/hudi/common/util/LogicalClock.java:
##########
@@ -0,0 +1,34 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import java.time.Instant;
+
+/**
+ * A clock interface that provides the current time as an {@link Instant}.
+ * Implementations of this interface can define different ways to retrieve time,
+ * such as using the system clock or a custom time source.
+ */
+public interface LogicalClock {
+ Instant now();
+
+ default long currentEpoch() {
+ return now().toEpochMilli();
+ }
+}
Review Comment:
nit: add new line at the end
##########
hudi-common/src/main/java/org/apache/hudi/common/util/SystemClock.java:
##########
@@ -0,0 +1,33 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.hudi.common.util;
+
+import java.time.Instant;
+
+/**
+ * An implementation of {@link LogicalClock} that returns the current
+ * time using {@link Instant#now()}.
+ */
+public class SystemClock implements LogicalClock {
+
+ @Override
+ public Instant now() {
+ return Instant.now();
+ }
+}
Review Comment:
similar here
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #12762:
URL: https://github.com/apache/hudi/pull/12762#discussion_r1960661740
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/config/KafkaSourceConfig.java:
##########
@@ -167,6 +167,13 @@ public class KafkaSourceConfig extends HoodieConfig {
.withDocumentation("The class name of the Exception that needs to be retried, separated by commas. "
+ "Default is empty which means retry all the IOException and RuntimeException from KafkaConsumer");
+ public static final ConfigProperty<Long> OFFSET_SKIP_BUFFER_MINUTES = ConfigProperty
+ .key(PREFIX + "offset.skip.buffer.minutes")
+ .defaultValue(-1L)
+ .markAdvanced()
+ .withDocumentation("Time in minutes to move forward from retention time for reading offsets")
+ .sinceVersion("1.1.0");
Review Comment:
nit: to put `.sinceVersion` before `.withDocumentation`
##########
hudi-utilities/src/test/java/org/apache/hudi/utilities/sources/helpers/TestKafkaOffsetGen.java:
##########
@@ -80,6 +114,12 @@ private TypedProperties getConsumerConfigs(String autoOffsetReset, String kafkaC
return props;
}
+ private TypedProperties getConsumerConfigs(String topicName, String autoOffsetReset, String kafkaCheckpointType) {
+ TypedProperties props = getConsumerConfigs(autoOffsetReset, kafkaCheckpointType);
+ props.put("hoodie.deltastreamer.source.kafka.topic", topicName);
Review Comment:
```suggestion
props.put("hoodie.streamer.source.kafka.topic", topicName);
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2677463689
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
}, {
"hash" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710",
"triggerID" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"triggerType" : "PUSH"
}, {
"hash" : "50d898a4c0e7443514aba9735e27d3f90d1accfd",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3847",
"triggerID" : "50d898a4c0e7443514aba9735e27d3f90d1accfd",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 495df92206ed018ec1c4b83a9baa11ee15b65abc Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710)
* 50d898a4c0e7443514aba9735e27d3f90d1accfd Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3847)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2666951568
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 37ce0b365205c2d465316867005cf113da9cad78 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682)
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* 3e4b7abb35fa983b7da2f29746eb9a32131bccc3 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8955] Resolve Kafka beginning offsets with retention to prevent OffsetOutOfRange exception [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12762:
URL: https://github.com/apache/hudi/pull/12762#issuecomment-2669075921
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3341",
"triggerID" : "529bb2521f1a45e376c450b47ae3b63bf7ae98a3",
"triggerType" : "PUSH"
}, {
"hash" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3391",
"triggerID" : "615dc041f37a0b2ba8eb4503d89723047f24368e",
"triggerType" : "PUSH"
}, {
"hash" : "ff340738831a25aec9f49015cb94ab95622db65e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3436",
"triggerID" : "ff340738831a25aec9f49015cb94ab95622db65e",
"triggerType" : "PUSH"
}, {
"hash" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3470",
"triggerID" : "261376b909a9af378b31cd7da4dfcec605f5a05f",
"triggerType" : "PUSH"
}, {
"hash" : "37ce0b365205c2d465316867005cf113da9cad78",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3682",
"triggerID" : "37ce0b365205c2d465316867005cf113da9cad78",
"triggerType" : "PUSH"
}, {
"hash" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "f00947a8c65777e5ce703530ebcadc4a56af8622",
"triggerType" : "PUSH"
}, {
"hash" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3684",
"triggerID" : "3e4b7abb35fa983b7da2f29746eb9a32131bccc3",
"triggerType" : "PUSH"
}, {
"hash" : "c505f65882d1d53910fd996e1486d82486551cb5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706",
"triggerID" : "c505f65882d1d53910fd996e1486d82486551cb5",
"triggerType" : "PUSH"
}, {
"hash" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710",
"triggerID" : "495df92206ed018ec1c4b83a9baa11ee15b65abc",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* f00947a8c65777e5ce703530ebcadc4a56af8622 UNKNOWN
* c505f65882d1d53910fd996e1486d82486551cb5 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3706)
* 495df92206ed018ec1c4b83a9baa11ee15b65abc Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=3710)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org