You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "usberkeley (via GitHub)" <gi...@apache.org> on 2024/11/11 06:46:32 UTC
[PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
usberkeley opened a new pull request, #12232:
URL: https://github.com/apache/hudi/pull/12232
### Change Logs
Optimize the OverwriteNonDefaultsWithLatestAvroPayload code
### Impact
none
### Risk level (write none, low medium or high below)
none
### Documentation Update
none
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Change Logs and Impact were stated clearly
- [x] Adequate tests were added if applicable
- [x] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2473565629
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 0fb04928352a07a6a46352556a9fda70e480a104 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592)
* ed7ef303cbe1c127c6ddc199ceacfb4010739057 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2487252089
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
}, {
"hash" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761",
"triggerID" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"triggerType" : "PUSH"
}, {
"hash" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 04499d5a2289ddbe011cdedb6d06cc3adf3725aa Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645)
* 3485a1bb0b8b3a5eb614d058d58487c211c438ef Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761)
* ed10d2cfa81625f468405ac416af79c864e8b359 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "yihua (via GitHub)" <gi...@apache.org>.
yihua commented on code in PR #12232:
URL: https://github.com/apache/hudi/pull/12232#discussion_r1883346110
##########
hudi-common/src/main/java/org/apache/hudi/common/model/PartialUpdateAvroPayload.java:
##########
@@ -130,23 +130,17 @@ public PartialUpdateAvroPayload(Option<GenericRecord> record) {
}
@Override
- public PartialUpdateAvroPayload preCombine(OverwriteWithLatestAvroPayload oldValue, Schema schema, Properties properties) {
+ public PartialUpdateAvroPayload preCombine(OverwriteWithLatestAvroPayload oldValue, Schema schema, Properties properties) throws IOException {
if (oldValue.recordBytes.length == 0) {
// use natural order for deleted record
return this;
}
// pick the payload with greater ordering value as insert record
final boolean shouldPickOldRecord = oldValue.orderingVal.compareTo(orderingVal) > 0;
- try {
- GenericRecord oldRecord = HoodieAvroUtils.bytesToAvro(oldValue.recordBytes, schema);
- Option<IndexedRecord> mergedRecord = mergeOldRecord(oldRecord, schema, shouldPickOldRecord, true);
- if (mergedRecord.isPresent()) {
- return new PartialUpdateAvroPayload((GenericRecord) mergedRecord.get(),
- shouldPickOldRecord ? oldValue.orderingVal : this.orderingVal);
- }
- } catch (Exception ex) {
- LOG.warn("PartialUpdateAvroPayload precombine failed with ", ex);
- return this;
+ GenericRecord oldRecord = HoodieAvroUtils.bytesToAvro(oldValue.recordBytes, schema);
+ Option<IndexedRecord> mergedRecord = mergeOldRecord(oldRecord, schema, shouldPickOldRecord, true);
+ if (mergedRecord.isPresent()) {
+ return new PartialUpdateAvroPayload((GenericRecord) mergedRecord.get(), shouldPickOldRecord ? oldValue.orderingVal : this.orderingVal);
Review Comment:
+1. Let's add a unit test on the error/exception handling.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2473792054
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* ed7ef303cbe1c127c6ddc199ceacfb4010739057 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2470583215
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b0c76848c3df3ed1606e05b5a889cb95defb62a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586)
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 2f3b70f430373ec81bb6301402f2c6ec70efb37a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2470958746
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 2f3b70f430373ec81bb6301402f2c6ec70efb37a Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2472177051
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 2f3b70f430373ec81bb6301402f2c6ec70efb37a Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594)
* 0fb04928352a07a6a46352556a9fda70e480a104 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "usberkeley (via GitHub)" <gi...@apache.org>.
usberkeley commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2474015841
It's so strange, the local CI is OK (`testSecondaryIndexWithClusteringAndCleaning`).
Additionally, the line numbers for `TestSecondaryIndexPruning#testSecondaryIndexWithClusteringAndCleaning` in the CI don't match those in the master branch, indicating that the CI is using an outdated version.
`TestSecondaryIndexPruning#testSecondaryIndexWithClusteringAndCleaning`
1) the line number in master : 974
2) the line number in CI: 1080 (**See below**)
``` java
Error: [1] tableType=COPY_ON_WRITE(testSecondaryIndexWithClusteringAndCleaning(HoodieTableType)) Time elapsed: 12.415 s <<< ERROR!
org.scalatest.exceptions.TestFailedException: Expected Array([cde$row2,false], [def$row3,false], [fgh$row2,false], [xyz$row1,false]), but got Array([def$row3,false], [efg$row2,false], [fgh$row2,false], [xyz$row1,false])
at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
at org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1231)
at org.scalatest.Assertions.assertResult(Assertions.scala:867)
at org.scalatest.Assertions.assertResult$(Assertions.scala:863)
at org.scalatest.Assertions$.assertResult(Assertions.scala:1231)
at org.apache.hudi.functional.TestSecondaryIndexPruning.checkAnswer(TestSecondaryIndexPruning.scala:1180)
at
// See Here, the line number in CI is 1080
org.apache.hudi.functional.TestSecondaryIndexPruning.testSecondaryIndexWithClusteringAndCleaning(TestSecondaryIndexPruning.scala:1080)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:725)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2487447367
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
}, {
"hash" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761",
"triggerID" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"triggerType" : "PUSH"
}, {
"hash" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1763",
"triggerID" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* ed10d2cfa81625f468405ac416af79c864e8b359 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2470741951
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b0c76848c3df3ed1606e05b5a889cb95defb62a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586)
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 2f3b70f430373ec81bb6301402f2c6ec70efb37a Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2470574088
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b0c76848c3df3ed1606e05b5a889cb95defb62a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586)
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2469956211
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b0c76848c3df3ed1606e05b5a889cb95defb62a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "usberkeley (via GitHub) via commits" <co...@hudi.apache.org>.
usberkeley closed pull request #12232: [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine
URL: https://github.com/apache/hudi/pull/12232
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2487284294
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
}, {
"hash" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761",
"triggerID" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"triggerType" : "PUSH"
}, {
"hash" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1763",
"triggerID" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 3485a1bb0b8b3a5eb614d058d58487c211c438ef Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761)
* ed10d2cfa81625f468405ac416af79c864e8b359 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1763)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2472205873
what kind of exceptions do we have then?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "usberkeley (via GitHub)" <gi...@apache.org>.
usberkeley commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2472267102
> what kind of exceptions do we have then?
An IOException should be directly thrown.
The preCombine of this payload needs to decode AVRO records to perform partial merging of records, so an IOException might be thrown. Previously, the exception was ignored, which I think could cause problems.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2470578797
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b0c76848c3df3ed1606e05b5a889cb95defb62a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586)
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2469794095
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5c3a1075bfc1d86815fcbd10bba6230aba62e025 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567)
* b0c76848c3df3ed1606e05b5a889cb95defb62a5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2472180994
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 0fb04928352a07a6a46352556a9fda70e480a104 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2475613170
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* ed7ef303cbe1c127c6ddc199ceacfb4010739057 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620)
* 04499d5a2289ddbe011cdedb6d06cc3adf3725aa UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2487254152
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
}, {
"hash" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761",
"triggerID" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"triggerType" : "PUSH"
}, {
"hash" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "ed10d2cfa81625f468405ac416af79c864e8b359",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 3485a1bb0b8b3a5eb614d058d58487c211c438ef Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761)
* ed10d2cfa81625f468405ac416af79c864e8b359 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2475697902
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* ed7ef303cbe1c127c6ddc199ceacfb4010739057 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620)
* 04499d5a2289ddbe011cdedb6d06cc3adf3725aa Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2473569881
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 0fb04928352a07a6a46352556a9fda70e480a104 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592)
* ed7ef303cbe1c127c6ddc199ceacfb4010739057 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "usberkeley (via GitHub)" <gi...@apache.org>.
usberkeley commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2473584098
Many current PRs are throwing errors in CI, such as #12242, #12241
I discovered that the Hudi Spark-related packages in the CI environment are using the 1.1.0-SNAPSHOT version compiled from the latest code on the Master branch, which conflicts with the current PR version
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "usberkeley (via GitHub)" <gi...@apache.org>.
usberkeley commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2472667977
@danny0405
Many current PRs are throwing errors. Could there be an issue with the HoodieTableMetadataUtil (1.1.0-SNAPSHOT) that the test-spark integration tests depend on?
Similar PRs include: [PR 12242](https://github.com/apache/hudi/pull/12242), [PR 12241](https://github.com/apache/hudi/pull/12241)
``` java
// HoodieTableMetadataUtil#translateWriteStatToFileStats buffer is -1
return getFileStatsRangeMetadata(writeStat.getPartitionPath(), getFileNameFromPath(filePath), datasetMetaClient, columnsToIndex, false, -1);
}
```
Exception Messageļ¼
``` java
[Executor task launch worker for task 0.0 in stage 63.0 (TID 153)] ERROR org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader [] - Got exception when reading log file
java.lang.IllegalArgumentException: Buffer size <= 0
at java.io.BufferedInputStream.<init>(BufferedInputStream.java:199) ~[?:?]
at org.apache.hadoop.fs.BufferedFSInputStream.<init>(BufferedFSInputStream.java:56) ~[hadoop-client-api-3.3.4.jar:?]
at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:275) ~[hadoop-client-api-3.3.4.jar:?]
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(ChecksumFileSystem.java:161) ~[hadoop-client-api-3.3.4.jar:?]
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:372) ~[hadoop-client-api-3.3.4.jar:?]
at org.apache.hudi.hadoop.fs.HoodieWrapperFileSystem.open(HoodieWrapperFileSystem.java:208) ~[hudi-hadoop-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.hadoop.fs.HadoopFSUtils.getFSDataInputStream(HadoopFSUtils.java:222) ~[hudi-hadoop-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.storage.hadoop.HoodieHadoopStorage.openSeekable(HoodieHadoopStorage.java:155) ~[hudi-hadoop-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.common.table.log.HoodieLogFileReader.getDataInputStream(HoodieLogFileReader.java:475) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.common.table.log.HoodieLogFileReader.<init>(HoodieLogFileReader.java:111) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.common.table.log.HoodieLogFormatReader.<init>(HoodieLogFormatReader.java:62) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scanInternalV1(AbstractHoodieLogRecordReader.java:243) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.common.table.log.AbstractHoodieLogRecordReader.scanInternal(AbstractHoodieLogRecordReader.java:221) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.common.table.log.HoodieUnMergedLogRecordScanner.scan(HoodieUnMergedLogRecordScanner.java:65) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.common.table.log.HoodieUnMergedLogRecordScanner.scan(HoodieUnMergedLogRecordScanner.java:61) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.metadata.HoodieTableMetadataUtil.getLogFileColumnRangeMetadata(HoodieTableMetadataUtil.java:1298) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.metadata.HoodieTableMetadataUtil.readColumnRangeMetadataFrom(HoodieTableMetadataUtil.java:1263) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.metadata.HoodieTableMetadataUtil.getFileStatsRangeMetadata(HoodieTableMetadataUtil.java:2201) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.metadata.HoodieTableMetadataUtil.translateWriteStatToFileStats(HoodieTableMetadataUtil.java:2334) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.metadata.HoodieTableMetadataUtil.lambda$convertMetadataToPartitionStatsRecords$58(HoodieTableMetadataUtil.java:2249) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197) ~[?:?]
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625) ~[?:?]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
at org.apache.hudi.metadata.HoodieTableMetadataUtil.lambda$convertMetadataToPartitionStatsRecords$c7c33f8a$1(HoodieTableMetadataUtil.java:2250) ~[hudi-common-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.hudi.data.HoodieJavaRDD.lambda$flatMap$a6598fcb$1(HoodieJavaRDD.java:160) ~[hudi-spark-client-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
at org.apache.spark.api.java.JavaRDDLike.$anonfun$flatMap$1(JavaRDDLike.scala:125) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at scala.collection.Iterator$$anon$11.nextCur(Iterator.scala:486) ~[scala-library-2.12.18.jar:?]
at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:492) ~[scala-library-2.12.18.jar:?]
at scala.collection.Iterator$$anon$10.hasNext(Iterator.scala:460) ~[scala-library-2.12.18.jar:?]
at org.apache.spark.storage.memory.MemoryStore.putIterator(MemoryStore.scala:223) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.storage.memory.MemoryStore.putIteratorAsBytes(MemoryStore.scala:352) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.storage.BlockManager.$anonfun$doPutIterator$1(BlockManager.scala:1614) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.storage.BlockManager.org$apache$spark$storage$BlockManager$$doPut(BlockManager.scala:1524) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.storage.BlockManager.doPutIterator(BlockManager.scala:1588) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.storage.BlockManager.getOrElseUpdate(BlockManager.scala:1389) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.storage.BlockManager.getOrElseUpdateRDDBlock(BlockManager.scala:1343) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.RDD.getOrCompute(RDD.scala:379) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.RDD.iterator(RDD.scala:329) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:367) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.RDD.iterator(RDD.scala:331) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:367) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.rdd.RDD.iterator(RDD.scala:331) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:104) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:54) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.TaskContext.runTaskWithListeners(TaskContext.scala:166) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.scheduler.Task.run(Task.scala:141) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$4(Executor.scala:620) ~[spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally(SparkErrorUtils.scala:64) [spark-common-utils_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.util.SparkErrorUtils.tryWithSafeFinally$(SparkErrorUtils.scala:61) [spark-common-utils_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:94) [spark-core_2.12-3.5.3.jar:3.5.3]
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:623) [spark-core_2.12-3.5.3.jar:3.5.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
at java.lang.Thread.run(Thread.java:840) [?:?]
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2475927021
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 04499d5a2289ddbe011cdedb6d06cc3adf3725aa Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2487221370
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
}, {
"hash" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761",
"triggerID" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 04499d5a2289ddbe011cdedb6d06cc3adf3725aa Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645)
* 3485a1bb0b8b3a5eb614d058d58487c211c438ef Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1761)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2487219290
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
}, {
"hash" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a73a1a4084caf13d6b5dd0307277e066e07cba64",
"triggerType" : "PUSH"
}, {
"hash" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "09fbe6124b1fef01e8607847b13b93d9f9caaf80",
"triggerType" : "PUSH"
}, {
"hash" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1594",
"triggerID" : "2f3b70f430373ec81bb6301402f2c6ec70efb37a",
"triggerType" : "PUSH"
}, {
"hash" : "0fb04928352a07a6a46352556a9fda70e480a104",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1592",
"triggerID" : "0fb04928352a07a6a46352556a9fda70e480a104",
"triggerType" : "PUSH"
}, {
"hash" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1620",
"triggerID" : "ed7ef303cbe1c127c6ddc199ceacfb4010739057",
"triggerType" : "PUSH"
}, {
"hash" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645",
"triggerID" : "04499d5a2289ddbe011cdedb6d06cc3adf3725aa",
"triggerType" : "PUSH"
}, {
"hash" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3485a1bb0b8b3a5eb614d058d58487c211c438ef",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* a73a1a4084caf13d6b5dd0307277e066e07cba64 UNKNOWN
* 09fbe6124b1fef01e8607847b13b93d9f9caaf80 UNKNOWN
* 04499d5a2289ddbe011cdedb6d06cc3adf3725aa Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1645)
* 3485a1bb0b8b3a5eb614d058d58487c211c438ef UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2467367477
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5c3a1075bfc1d86815fcbd10bba6230aba62e025 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2467365284
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5c3a1075bfc1d86815fcbd10bba6230aba62e025 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2467460663
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5c3a1075bfc1d86815fcbd10bba6230aba62e025 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Optimize the OverwriteNonDefaultsWithLatestAvroPayload code [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-2469796622
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567",
"triggerID" : "5c3a1075bfc1d86815fcbd10bba6230aba62e025",
"triggerType" : "PUSH"
}, {
"hash" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586",
"triggerID" : "b0c76848c3df3ed1606e05b5a889cb95defb62a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 5c3a1075bfc1d86815fcbd10bba6230aba62e025 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1567)
* b0c76848c3df3ed1606e05b5a889cb95defb62a5 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=1586)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "voonhous (via GitHub) via commits" <co...@hudi.apache.org>.
voonhous closed pull request #12232: [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine
URL: https://github.com/apache/hudi/pull/12232
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8502] Fix the potential data loss issue in PartialUpdateAvroPayload#preCombine [hudi]
Posted by "voonhous (via GitHub) via commits" <co...@hudi.apache.org>.
voonhous commented on PR #12232:
URL: https://github.com/apache/hudi/pull/12232#issuecomment-6700420960
Temporarily closing this PR while we debug a GitHub settings error on master (#20471); it will be reopened shortly, no action needed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org