You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "nsivabalan (via GitHub)" <gi...@apache.org> on 2025/09/22 21:32:58 UTC
[PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
nsivabalan opened a new pull request, #13964:
URL: https://github.com/apache/hudi/pull/13964
### Describe the issue this Pull Request addresses
Took over https://github.com/apache/hudi/pull/13952/ and adding fixes on top.
<!-- Either describe the issue inline here with motivation behind the changes
(or) link to an issue by including `Closes #<issue-number>` for context.
If this PR includes changes to the storage format, public APIs,
or has breaking changes, use `!` (e.g., feat!: ...) -->
### Summary and Changelog
<!-- Short, plain-English summary of what users gain or what changed in behavior.
Followed by a detailed log of all the changes. Highlight if any code was copied. -->
### Impact
<!-- Describe any public API or user-facing feature change or any performance impact. -->
### Risk Level
<!-- Accepted values: none, low, medium or high. Other than `none`, explain the risk.
If medium or high, explain what verification was done to mitigate the risks. -->
### Documentation Update
<!-- Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".
- The config description must be updated if new configs are added or the default value of the configs are changed.
- Any new feature or user-facing change requires updating the Hudi website. Please follow the
[instruction](https://hudi.apache.org/contribute/developer-setup#website) to make changes to the website. -->
### Contributor's checklist
- [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Enough context is provided in the sections above
- [ ] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3341283067
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 58a30322486be23174f8ca9337ec4613d6c6e646 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845)
* d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2387150272
##########
hudi-common/src/main/java/org/apache/hudi/avro/AvroRecordContext.java:
##########
@@ -136,6 +136,15 @@ public IndexedRecord extractDataFromRecord(HoodieRecord record, Schema schema, P
}
}
+ @Override
+ public IndexedRecord extractDeflatedDataFromRecord(HoodieRecord record, Schema schema, Properties properties) {
Review Comment:
can we get rid of this in this patch?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3324609312
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756)
* 125315c6d78ec281ee15dd1e78ab9dc944ff801f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325125807
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 125315c6d78ec281ee15dd1e78ab9dc944ff801f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769)
* 6e7ef04d30b4001dbd697b4339318f4f10b054f2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2370868769
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/buffer/FileGroupRecordBuffer.java:
##########
@@ -238,6 +241,10 @@ protected Option<Pair<Function<T, T>, Schema>> composeEvolvedSchemaTransformer(
protected boolean hasNextBaseRecord(T baseRecord, BufferedRecord<T> logRecordInfo) throws IOException {
if (logRecordInfo != null) {
+ if (inflateRecordsBeforeMerging && !logRecordInfo.isDelete()) {
+ T logRecord = readerContext.getRecordContext().inflateRecord(logRecordInfo.getRecord(), incomingRecordsSchema);
Review Comment:
not sure why we need this, in `StreamingFileGroupRecordBufferLoader`, we already execute `#recordContext.extractDataFromRecord` per record to decode the engine row, that should where the schema been injected in? And within the `HoodieAvroIndexedRecord`, the decode of the record is already lazy.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3327494082
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 70f6653bb94252ecbfa5c20fb9158b8d3493ebe1 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788)
* 67c5910f80d41415065729fe5ed6a1bf6ee3ec42 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3323081295
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3336229566
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 7875225c0de95b5fffd5fe0d0fc8576e699d5999 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3336989310
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 7875225c0de95b5fffd5fe0d0fc8576e699d5999 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827)
* 95db468a7b092cab13e7968ea163c09725206229 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3324579845
high level update:
I am first looking to fix the COW write path to get to see CI green. and then will remove the special casing to fix all paths (i..e `HoodieAvroIndexedRecord.getData()` will return the `SerializableIndexedRecord` instead of `GenericRecord`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3324767364
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756)
* 125315c6d78ec281ee15dd1e78ab9dc944ff801f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386437506
##########
hudi-common/src/main/java/org/apache/hudi/common/engine/RecordContext.java:
##########
@@ -92,6 +92,10 @@ public T extractDataFromRecord(HoodieRecord record, Schema schema, Properties pr
return (T) record.getData();
}
+ public T extractDeflatedDataFromRecord(HoodieRecord record, Schema schema, Properties properties) {
Review Comment:
Similarly, can we clean this up now?
##########
hudi-hadoop-common/src/test/java/org/apache/hudi/common/functional/TestHoodieLogFormat.java:
##########
@@ -742,8 +743,14 @@ private void testBasicAppendAndScanMultipleFiles(ExternalSpillableMap.DiskMapTyp
.build();
List<IndexedRecord> scannedRecords = new ArrayList<>();
+ int counter = 0;
Review Comment:
Is this used?
##########
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/model/HoodieFlinkRecord.java:
##########
@@ -103,7 +103,7 @@ protected Comparable<?> doGetOrderingValue(Schema recordSchema, Properties props
if (recordSchema.getField(field) == null) {
return OrderingValues.getDefault();
}
- return (Comparable<?>) getColumnValue(recordSchema, field, props);
Review Comment:
Is this intentional?
##########
hudi-common/src/test/java/org/apache/hudi/common/table/read/buffer/TestKeyBasedFileGroupRecordBuffer.java:
##########
@@ -233,7 +235,9 @@ void readWithCommitTimeOrderingWithRecords() throws IOException {
testRecord5, testRecord6).iterator()));
List<IndexedRecord> actualRecords = getActualRecords(fileGroupRecordBuffer);
- assertEquals(Arrays.asList(testRecord1UpdateWithSameTime, testRecord2Update, testRecord3Update, testRecord4EarlierUpdate, testRecord7), actualRecords);
+ assertEquals(Arrays.asList(testRecord1UpdateWithSameTime, testRecord2Update,
Review Comment:
Instead of `Arrays.asList(..).stream()``` you can just use `Stream.of(...)`
##########
hudi-hadoop-common/src/test/java/org/apache/hudi/common/functional/TestHoodieLogFormat.java:
##########
@@ -742,8 +743,14 @@ private void testBasicAppendAndScanMultipleFiles(ExternalSpillableMap.DiskMapTyp
.build();
List<IndexedRecord> scannedRecords = new ArrayList<>();
+ int counter = 0;
for (HoodieRecord record : scanner) {
- scannedRecords.add(record.toIndexedRecord(schema, CollectionUtils.emptyProps()).get().getData());
+ Object data = record.toIndexedRecord(schema, CollectionUtils.emptyProps()).get().getData();
+ if (data instanceof SerializableIndexedRecord) {
+ scannedRecords.add((GenericRecord)((SerializableIndexedRecord)data).getData());
+ } else {
+ scannedRecords.add((GenericRecord)data);
Review Comment:
Style: Add space after casting
##########
hudi-common/src/main/java/org/apache/hudi/avro/AvroRecordContext.java:
##########
@@ -136,6 +136,15 @@ public IndexedRecord extractDataFromRecord(HoodieRecord record, Schema schema, P
}
}
+ @Override
+ public IndexedRecord extractDeflatedDataFromRecord(HoodieRecord record, Schema schema, Properties properties) {
Review Comment:
bump on this
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -44,7 +44,18 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
T data = recordContext.extractDataFromRecord(record, schema, props);
String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
Integer schemaId = recordContext.encodeAvroSchema(schema);
- Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
+ Comparable orderingValue = record.getCachedOrderingValue() != null ? record.getCachedOrderingValue() : recordContext.getOrderingValue(data, schema, orderingFields);
Review Comment:
The `record.getOrderingValue` should give you the same value and handle the caching of the result as well.
##########
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/index/HoodieIndexUtils.java:
##########
@@ -536,6 +536,8 @@ public static <R> HoodieData<HoodieRecord<R>> mergeForPartitionUpdatesAndDeletio
// define the buffered record merger.
TypedProperties properties = readerContext.getMergeProps(updatedConfig.getProps());
RecordContext<R> incomingRecordContext = readerContext.getRecordContext();
+
+
Review Comment:
nitpick: remove the spacing changes in this file
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344412887
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344389935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* adbc485a41fdc5392360c9ded7fa04da7931c607 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897)
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3345203850
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
}, {
"hash" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913",
"triggerID" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* a52d2791a8483c5501ae120190b90e0ac7d35d62 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344115041
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* adbc485a41fdc5392360c9ded7fa04da7931c607 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan closed pull request #13964: Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes
URL: https://github.com/apache/hudi/pull/13964
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "cshuo (via GitHub)" <gi...@apache.org>.
cshuo commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386542121
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -244,6 +244,10 @@ public Comparable<?> getOrderingValue(Schema recordSchema, Properties props, Str
return orderingValue;
}
+ public Comparable<?> getCachedOrderingValue() {
Review Comment:
The method seems not necessary.
IIUC, The intention is trying not to inflate SerializableIndexedRecord when get ordering value by best effort. Currently, `getOrderingValue` will first fetch ordering value from internal cache, and do extracting logic only when cache value is null, so it will be ok to call `getOrderingValue` directly.
##########
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/model/HoodieFlinkRecord.java:
##########
@@ -103,7 +103,7 @@ protected Comparable<?> doGetOrderingValue(Schema recordSchema, Properties props
if (recordSchema.getField(field) == null) {
return OrderingValues.getDefault();
}
- return (Comparable<?>) getColumnValue(recordSchema, field, props);
+ return (Comparable<?>) getColumnValueAsJava(recordSchema, field, props, false);
Review Comment:
We currently return ordering value as engine type for `getOrderingValue`, so we should not make this change.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322129652
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735)
* 56c0576bb3743be284434523bc3e036c97f6c566 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322127257
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735)
* 56c0576bb3743be284434523bc3e036c97f6c566 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373817877
##########
hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroReaderContext.java:
##########
@@ -192,8 +192,8 @@ public Option<HoodieRecordMerger> getRecordMerger(RecordMergeMode mergeMode, Str
}
@Override
- public SizeEstimator<BufferedRecord<IndexedRecord>> getRecordSizeEstimator() {
- return new AvroRecordSizeEstimator(getSchemaHandler().getRequiredSchema());
+ public SizeEstimator<BufferedRecord<IndexedRecord>> getRecordSizeEstimator(Option<Schema> recordSchemaOpt) {
+ return new AvroRecordSizeEstimator(recordSchemaOpt.orElse(getSchemaHandler().getRequiredSchema()));
Review Comment:
yeah, it may work, but the change is still not necessary and also error-prone, for avro size estimation, the schema is already there, just calculating the schema size lazily should be fine already.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373843033
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -48,6 +48,21 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
}
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props, String[] orderingFields) {
+ boolean isDelete = record.isDelete(schema, props);
+ return fromHoodieRecordWithDeflatedRecord(record, schema, recordContext, props, orderingFields, isDelete);
+ }
+
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext,
+ Properties props, String[] orderingFields, boolean isDelete) {
+ HoodieKey hoodieKey = record.getKey();
+ T data = recordContext.extractDeflatedDataFromRecord(record, schema, props);
+ String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
+ Integer schemaId = recordContext.encodeAvroSchema(schema);
+ Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
+ return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
+ }
+
Review Comment:
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3327253990
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* b07a282d45dff4025bd2f2e3106bdd26491bf768 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783)
* 70f6653bb94252ecbfa5c20fb9158b8d3493ebe1 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3328418675
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 67c5910f80d41415065729fe5ed6a1bf6ee3ec42 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790)
* 1b3672a0842b888793293deb28e24991a5b87c57 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3341294293
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 58a30322486be23174f8ca9337ec4613d6c6e646 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845)
* d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325606430
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* da6d43b45d4f2dd38b936d1bb7ace8921e6dafab Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772)
* 0f82a608f29ef52c87b4e947fd1859f31705b6c5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2370874591
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieCreateRecordUtils.scala:
##########
@@ -130,9 +131,12 @@ object HoodieCreateRecordUtils {
DataSourceWriteOptions.KEYGENERATOR_CONSISTENT_LOGICAL_TIMESTAMP_ENABLED.key(),
DataSourceWriteOptions.KEYGENERATOR_CONSISTENT_LOGICAL_TIMESTAMP_ENABLED.defaultValue()).toBoolean
val requiresPayload = isChangingRecords(operation) && !config.isFileGroupReaderBasedMergeHandle
+ val mergeProps = ConfigUtils.getMergeProps(config.getProps, args.tableConfig.getProps)
+ val deleteContext = new DeleteContext(mergeProps, writerSchema).withReaderSchema(writerSchema);
// handle dropping partition columns
it.map { avroRec =>
+ val isDelete: Boolean = AvroRecordContext.getFieldAccessorInstance.isDeleteRecord(avroRec, deleteContext)
Review Comment:
what is the reason we must instantiate the `isDelete` flag eagerly here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3321594935
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322520337
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8f961e5a5947fcee2bb4ad0392473489fd8db83e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751)
* 9c886d5fe2b8f30a4d1ecd6c306da816b03865aa UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325294277
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 6e7ef04d30b4001dbd697b4339318f4f10b054f2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771)
* da6d43b45d4f2dd38b936d1bb7ace8921e6dafab Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2372760827
##########
hudi-common/src/main/java/org/apache/hudi/avro/AvroRecordContext.java:
##########
@@ -136,6 +136,15 @@ public IndexedRecord extractDataFromRecord(HoodieRecord record, Schema schema, P
}
}
+ @Override
+ public IndexedRecord extractDeflatedDataFromRecord(HoodieRecord record, Schema schema, Properties properties) {
Review Comment:
ack
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3341435092
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875)
* 282804d33e9cec336d88371907581dc270d4a37e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344081098
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 282804d33e9cec336d88371907581dc270d4a37e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882)
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* adbc485a41fdc5392360c9ded7fa04da7931c607 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344076586
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 282804d33e9cec336d88371907581dc270d4a37e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882)
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3337881065
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 58a30322486be23174f8ca9337ec4613d6c6e646 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3327058344
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* b07a282d45dff4025bd2f2e3106bdd26491bf768 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783)
* 70f6653bb94252ecbfa5c20fb9158b8d3493ebe1 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3330762126
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 822040b9d5efeeeb6291d363eadf3de3ea3fd495 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799)
* a052805897188c39e5302f45708a3aa16f8f2f28 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3327474415
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 70f6653bb94252ecbfa5c20fb9158b8d3493ebe1 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788)
* 67c5910f80d41415065729fe5ed6a1bf6ee3ec42 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2371302761
##########
hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroReaderContext.java:
##########
@@ -192,8 +192,8 @@ public Option<HoodieRecordMerger> getRecordMerger(RecordMergeMode mergeMode, Str
}
@Override
- public SizeEstimator<BufferedRecord<IndexedRecord>> getRecordSizeEstimator() {
- return new AvroRecordSizeEstimator(getSchemaHandler().getRequiredSchema());
+ public SizeEstimator<BufferedRecord<IndexedRecord>> getRecordSizeEstimator(Option<Schema> recordSchemaOpt) {
+ return new AvroRecordSizeEstimator(recordSchemaOpt.orElse(getSchemaHandler().getRequiredSchema()));
Review Comment:
we don't really need this, like the changes in this PR: https://github.com/apache/hudi/pull/13896/files, just support multiple schemas in `AvroRecordSizeEstimator`, and actually passing a explicitly schema does not work because for COW threre are always two schemas: one with meta fields and one without.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2383018506
##########
hudi-common/src/main/java/org/apache/hudi/avro/AvroRecordContext.java:
##########
@@ -136,6 +136,15 @@ public IndexedRecord extractDataFromRecord(HoodieRecord record, Schema schema, P
}
}
+ @Override
+ public IndexedRecord extractDeflatedDataFromRecord(HoodieRecord record, Schema schema, Properties properties) {
Review Comment:
Can this be removed now?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386551744
##########
hudi-common/src/main/java/org/apache/hudi/common/engine/RecordContext.java:
##########
@@ -92,6 +92,10 @@ public T extractDataFromRecord(HoodieRecord record, Schema schema, Properties pr
return (T) record.getData();
}
+ public T extractDeflatedDataFromRecord(HoodieRecord record, Schema schema, Properties properties) {
Review Comment:
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322158781
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56c0576bb3743be284434523bc3e036c97f6c566 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322995985
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d3ce913eca977fc177353a4d58284e03ef307e79 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325913987
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 0f82a608f29ef52c87b4e947fd1859f31705b6c5 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774)
* 7173c6de4bd7430ce9857e879960bc8b64145348 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373822836
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/HoodieStreamerUtils.java:
##########
@@ -124,12 +127,13 @@ public static Option<JavaRDD<HoodieRecord>> createHoodieRecords(HoodieStreamer.C
}
HoodieKey hoodieKey = new HoodieKey(builtinKeyGenerator.getRecordKey(genRec), builtinKeyGenerator.getPartitionPath(genRec));
GenericRecord gr = isDropPartitionColumns(props) ? HoodieAvroUtils.removeFields(genRec, partitionColumns) : genRec;
+ boolean isDelete = AvroRecordContext.getFieldAccessorInstance().isDeleteRecord(gr, deleteContext);
Review Comment:
we better instantiate the record context based on the record type otherwise the other records may not work, like Spark record.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3345351249
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
}, {
"hash" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913",
"triggerID" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"triggerType" : "PUSH"
}, {
"hash" : "b45738a389dd34965ac070778e2d2eae59dc428a",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b45738a389dd34965ac070778e2d2eae59dc428a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* a52d2791a8483c5501ae120190b90e0ac7d35d62 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913)
* b45738a389dd34965ac070778e2d2eae59dc428a UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386553243
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -44,7 +44,18 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
T data = recordContext.extractDataFromRecord(record, schema, props);
String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
Integer schemaId = recordContext.encodeAvroSchema(schema);
- Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
+ Comparable orderingValue = record.getCachedOrderingValue() != null ? record.getCachedOrderingValue() : recordContext.getOrderingValue(data, schema, orderingFields);
Review Comment:
+1, as long as the T is extracted, we could have fetched the value directly from `HoodieRecord`. And after all, extracting values from T would also deserialize the record.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344085026
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 282804d33e9cec336d88371907581dc270d4a37e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882)
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* adbc485a41fdc5392360c9ded7fa04da7931c607 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386552787
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieRecord.java:
##########
@@ -244,6 +244,10 @@ public Comparable<?> getOrderingValue(Schema recordSchema, Properties props, Str
return orderingValue;
}
+ public Comparable<?> getCachedOrderingValue() {
Review Comment:
+1, let's not add API that is ambiguous, and always returns a non-null ordering value if the ordering field is defined there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344404021
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* adbc485a41fdc5392360c9ded7fa04da7931c607 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897)
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344853139
hey Tim and Danny:
I will let you guys know once the patch is ready for review. As I told before, I am working to get green CI for COW write path. and then will make the lazy deser default. After rebasing w/ latest commit, I see lots of failures. If not, I was hoping to making lazy deser default and opening it up for review, but unfortunately, I need more time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3345403041
hey Tim and Danny: this patch is good to review for COW write paths. my hunch is that, the latest CI run should have all tests green.
To make lazy deser default, I have a stacked patch at https://github.com/apache/hudi/pull/13987 so that I can investigate the test failures from that patch separately. Once we get green CI in 13987, I will pull those changes to this patch and open it up for review. In the mean time, feel free to review COW write path fixes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322522683
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8f961e5a5947fcee2bb4ad0392473489fd8db83e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751)
* 9c886d5fe2b8f30a4d1ecd6c306da816b03865aa Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322382829
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56c0576bb3743be284434523bc3e036c97f6c566 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747)
* 8f961e5a5947fcee2bb4ad0392473489fd8db83e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3330444504
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 1b3672a0842b888793293deb28e24991a5b87c57 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794)
* 822040b9d5efeeeb6291d363eadf3de3ea3fd495 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3341347005
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3345077345
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
}, {
"hash" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913",
"triggerID" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904)
* a52d2791a8483c5501ae120190b90e0ac7d35d62 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386553441
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -44,7 +44,18 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
T data = recordContext.extractDataFromRecord(record, schema, props);
String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
Integer schemaId = recordContext.encodeAvroSchema(schema);
- Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
+ Comparable orderingValue = record.getCachedOrderingValue() != null ? record.getCachedOrderingValue() : recordContext.getOrderingValue(data, schema, orderingFields);
+ return new BufferedRecord<>(recordKey, orderingValue, data, schemaId, inferOperation(isDelete, record.getOperation()));
+ }
+
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props,
Review Comment:
can you get rid of this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386553243
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -44,7 +44,18 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
T data = recordContext.extractDataFromRecord(record, schema, props);
String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
Integer schemaId = recordContext.encodeAvroSchema(schema);
- Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
+ Comparable orderingValue = record.getCachedOrderingValue() != null ? record.getCachedOrderingValue() : recordContext.getOrderingValue(data, schema, orderingFields);
Review Comment:
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386575266
##########
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/model/HoodieFlinkRecord.java:
##########
@@ -103,7 +103,7 @@ protected Comparable<?> doGetOrderingValue(Schema recordSchema, Properties props
if (recordSchema.getField(field) == null) {
return OrderingValues.getDefault();
}
- return (Comparable<?>) getColumnValue(recordSchema, field, props);
+ return (Comparable<?>) getColumnValueAsJava(recordSchema, field, props, false);
Review Comment:
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3341434208
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875)
* 282804d33e9cec336d88371907581dc270d4a37e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3330834841
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 822040b9d5efeeeb6291d363eadf3de3ea3fd495 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799)
* a052805897188c39e5302f45708a3aa16f8f2f28 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3330973290
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* a052805897188c39e5302f45708a3aa16f8f2f28 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3321568498
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3324774181
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 125315c6d78ec281ee15dd1e78ab9dc944ff801f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3323069883
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d3ce913eca977fc177353a4d58284e03ef307e79 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755)
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3327530349
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 67c5910f80d41415065729fe5ed6a1bf6ee3ec42 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373691589
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -48,6 +48,24 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
}
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props,
+ String[] orderingFields, DeleteContext deleteContext) {
Review Comment:
once we get COW write paths CI green, will remove these special handling.
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -48,6 +48,24 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
}
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props,
+ String[] orderingFields, DeleteContext deleteContext) {
+ HoodieOperation hoodieOperation = record.getIgnoreIndexUpdate() ? HoodieOperation.UPDATE_BEFORE : record.getOperation();
Review Comment:
down the line, we are using inferOperation. will check it out anyways on whats going on.
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala:
##########
@@ -508,11 +508,16 @@ class HoodieSparkSqlWriterInternal {
throw new UnsupportedOperationException(s"${writeConfig.getRecordMerger.getClass.getName} only support parquet log.")
}
instantTime = client.startCommit(commitActionType)
+ // if table has undergone upgrade, we need to reload table config
+ tableConfig = HoodieTableMetaClient.builder()
Review Comment:
proper fix will be part of https://github.com/apache/hudi/pull/13979
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -48,6 +48,24 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
}
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props,
+ String[] orderingFields, DeleteContext deleteContext) {
+ HoodieOperation hoodieOperation = record.getIgnoreIndexUpdate() ? HoodieOperation.UPDATE_BEFORE : record.getOperation();
+ boolean isDelete = record.isDelete(deleteContext, props);
+ return fromHoodieRecordWithDeflatedRecord(record, schema, recordContext, props, orderingFields, isDelete, hoodieOperation);
+ }
+
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext,
Review Comment:
yes, I will be removing these additional methods @danny0405 . as of now, I was targetting to get to green CI just for COW writes and we are in green state now.
I will be looking to make this generic across the board in subsequent patches.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325143220
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 6e7ef04d30b4001dbd697b4339318f4f10b054f2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771)
* da6d43b45d4f2dd38b936d1bb7ace8921e6dafab UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325632421
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* da6d43b45d4f2dd38b936d1bb7ace8921e6dafab Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772)
* 0f82a608f29ef52c87b4e947fd1859f31705b6c5 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325138880
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 125315c6d78ec281ee15dd1e78ab9dc944ff801f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769)
* 6e7ef04d30b4001dbd697b4339318f4f10b054f2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771)
* da6d43b45d4f2dd38b936d1bb7ace8921e6dafab UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373816071
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/StreamSync.java:
##########
@@ -911,8 +911,9 @@ private WriteClientWriteResult writeToSink(InputBatch inputBatch, String instant
BaseDatasetBulkInsertCommitActionExecutor executor = new HoodieStreamerDatasetBulkInsertCommitActionExecutor(hoodieWriteConfig, writeClient);
writeClientWriteResult = new WriteClientWriteResult(executor.execute(df, !HoodieStreamerUtils.getPartitionColumns(props).isEmpty()).getWriteStatuses());
} else {
- HoodieRecordType recordType = createRecordMerger(props).getRecordType();
- Option<JavaRDD<HoodieRecord>> recordsOption = HoodieStreamerUtils.createHoodieRecords(cfg, props, inputBatch.getBatch(), inputBatch.getSchemaProvider(),
+ TypedProperties mergeProps = ConfigUtils.getMergeProps(props, metaClient.getTableConfig());
Review Comment:
extra space between `= ConfigUtils...`
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala:
##########
@@ -508,11 +508,16 @@ class HoodieSparkSqlWriterInternal {
throw new UnsupportedOperationException(s"${writeConfig.getRecordMerger.getClass.getName} only support parquet log.")
}
instantTime = client.startCommit(commitActionType)
+ // if table has undergone upgrade, we need to reload table config
+ tableConfig = HoodieTableMetaClient.builder()
Review Comment:
Can we use `tableMetaClient.reloadTableConfig()` for this instead?
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -48,6 +48,24 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
}
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props,
+ String[] orderingFields, DeleteContext deleteContext) {
+ HoodieOperation hoodieOperation = record.getIgnoreIndexUpdate() ? HoodieOperation.UPDATE_BEFORE : record.getOperation();
Review Comment:
This needs to use `inferOperation` to ensure consistency with the current path. That may explain the flink failure.
##########
hudi-common/src/test/java/org/apache/hudi/common/table/read/buffer/TestKeyBasedFileGroupRecordBuffer.java:
##########
@@ -168,7 +168,8 @@ void readWithEventTimeOrderingWithRecords() throws IOException {
// update for 4 is ignored due to lower ordering value.
// record5 is deleted.
// delete for 6 is ignored due to lower ordering value.
- assertEquals(Arrays.asList(testRecord1UpdateWithSameTime, testRecord2Update, testRecord3Update, testRecord4, testRecord6, testRecord7), actualRecords);
+ assertEquals(Arrays.asList(getSerializableIndexedRecord(testRecord1UpdateWithSameTime), getSerializableIndexedRecord(testRecord2Update),
Review Comment:
nitpick: you can use `Stream.of(...).map(getSerializableIndexedRecord)...` to make it a bit less verbose here and below
##########
hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/source/TestStreamReadMonitoringFunction.java:
##########
@@ -462,7 +462,7 @@ public void testStopWithSavepointAndRestore() throws Exception {
}
}
- @Test
+ // @Test disabling due to flakiness
Review Comment:
If this needs to be disabled, let's use `@Disabled(GH-XYZ)` to track it
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373822836
##########
hudi-utilities/src/main/java/org/apache/hudi/utilities/streamer/HoodieStreamerUtils.java:
##########
@@ -124,12 +127,13 @@ public static Option<JavaRDD<HoodieRecord>> createHoodieRecords(HoodieStreamer.C
}
HoodieKey hoodieKey = new HoodieKey(builtinKeyGenerator.getRecordKey(genRec), builtinKeyGenerator.getPartitionPath(genRec));
GenericRecord gr = isDropPartitionColumns(props) ? HoodieAvroUtils.removeFields(genRec, partitionColumns) : genRec;
+ boolean isDelete = AvroRecordContext.getFieldAccessorInstance().isDeleteRecord(gr, deleteContext);
Review Comment:
we better instantiate the record context based on the record type otherwise the other records may not work, like Spark record.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2376694170
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala:
##########
@@ -508,11 +508,16 @@ class HoodieSparkSqlWriterInternal {
throw new UnsupportedOperationException(s"${writeConfig.getRecordMerger.getClass.getName} only support parquet log.")
}
instantTime = client.startCommit(commitActionType)
+ // if table has undergone upgrade, we need to reload table config
+ tableConfig = HoodieTableMetaClient.builder()
Review Comment:
yes, sure.
Will follow this
```
tableMetaClient.reloadTableConfig()
tableConfig = tableMetaClient.getTableConfig
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3330284075
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 1b3672a0842b888793293deb28e24991a5b87c57 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794)
* 822040b9d5efeeeb6291d363eadf3de3ea3fd495 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2377370506
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -45,7 +45,7 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
Integer schemaId = recordContext.encodeAvroSchema(schema);
Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
- return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
Review Comment:
the value fetched in `HoodieRecord` is already engine type.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3326624791
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 7173c6de4bd7430ce9857e879960bc8b64145348 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778)
* b07a282d45dff4025bd2f2e3106bdd26491bf768 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2374762925
##########
hudi-common/src/test/java/org/apache/hudi/common/table/read/buffer/TestKeyBasedFileGroupRecordBuffer.java:
##########
@@ -168,7 +168,8 @@ void readWithEventTimeOrderingWithRecords() throws IOException {
// update for 4 is ignored due to lower ordering value.
// record5 is deleted.
// delete for 6 is ignored due to lower ordering value.
- assertEquals(Arrays.asList(testRecord1UpdateWithSameTime, testRecord2Update, testRecord3Update, testRecord4, testRecord6, testRecord7), actualRecords);
+ assertEquals(Arrays.asList(getSerializableIndexedRecord(testRecord1UpdateWithSameTime), getSerializableIndexedRecord(testRecord2Update),
Review Comment:
not every record is expected to be `SerializableIndexedRecord`. based on whether record from base file is chosen or from the incoming records.
So, can't really go w/ `Stream.of(...).map`
but I can employ this below wherever applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3337056871
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 95db468a7b092cab13e7968ea163c09725206229 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3345814725
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
}, {
"hash" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913",
"triggerID" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"triggerType" : "PUSH"
}, {
"hash" : "b45738a389dd34965ac070778e2d2eae59dc428a",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8918",
"triggerID" : "b45738a389dd34965ac070778e2d2eae59dc428a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* b45738a389dd34965ac070778e2d2eae59dc428a Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8918)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3345752414
The other patch is good to review now. We can probably ignore this patch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386937106
##########
hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/functional/TestNewHoodieParquetFileFormat.java:
##########
@@ -51,8 +49,8 @@ private static Stream<Arguments> testArgs() {
return b.build();
}
- @ParameterizedTest
- @MethodSource("testArgs")
+ //@ParameterizedTest
+ //@MethodSource("testArgs") Disabling to target green CI w/o this flaky test. Will revert before opening it up for review.
Review Comment:
Will be reverting this back, once we get a green CI.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2370359635
##########
hudi-common/src/main/java/org/apache/hudi/common/model/SerializableIndexedRecord.java:
##########
@@ -46,6 +46,7 @@ public class SerializableIndexedRecord implements GenericRecord, KryoSerializabl
private static final long serialVersionUID = 1L;
private IndexedRecord record;
+ private Schema schema;
Review Comment:
Note:
for now, we wanted to see end to end all writing paths w/ this solution, where we have schema stored per record just within write handles.
Once we have full handle to all write paths, and fished out all thats required for lazy deser, we wanted to optimize this to see if we can remove `schema` and get it working just w/ schemaId.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2370819261
##########
hudi-common/src/main/java/org/apache/hudi/common/model/SerializableIndexedRecord.java:
##########
@@ -46,6 +46,7 @@ public class SerializableIndexedRecord implements GenericRecord, KryoSerializabl
private static final long serialVersionUID = 1L;
private IndexedRecord record;
+ private Schema schema;
Review Comment:
What would be the benefit? The schema object should be the same and it is not serialized as part of the object so I'm not sure what we would gain with this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2371466164
##########
hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroReaderContext.java:
##########
@@ -192,8 +192,8 @@ public Option<HoodieRecordMerger> getRecordMerger(RecordMergeMode mergeMode, Str
}
@Override
- public SizeEstimator<BufferedRecord<IndexedRecord>> getRecordSizeEstimator() {
- return new AvroRecordSizeEstimator(getSchemaHandler().getRequiredSchema());
+ public SizeEstimator<BufferedRecord<IndexedRecord>> getRecordSizeEstimator(Option<Schema> recordSchemaOpt) {
+ return new AvroRecordSizeEstimator(recordSchemaOpt.orElse(getSchemaHandler().getRequiredSchema()));
Review Comment:
this size estimator is only used for external spillable map.
we have 2 use-cases for it.
1. COW merges.
2. MOR compaction.
for 1: incoming records will not contain meta fields
for 2: log records will contain meta fields.
for (2), we can afford to use schemaHandler.getRequriedSchema(), where as for (1), we can't do that. And so we are overriding it here.
can you help me understand why cur fix may not work ?
##########
hudi-common/src/main/java/org/apache/hudi/common/model/SerializableIndexedRecord.java:
##########
@@ -46,6 +46,7 @@ public class SerializableIndexedRecord implements GenericRecord, KryoSerializabl
private static final long serialVersionUID = 1L;
private IndexedRecord record;
+ private Schema schema;
Review Comment:
My plan was to use the default serializer only and do away w/ custom serializer.
bcoz, if we look at BufferedRecord, its going to contain `SerializedIndexedRecord` which is only going to contain `byte[]` w/o the actual generic record.
But the new `inflate` api that I introduced does not look elegant and might complicate things across all diff write paths.
so, we can keep the `schema` here.
##########
hudi-common/src/main/java/org/apache/hudi/common/model/SerializableIndexedRecord.java:
##########
@@ -59,17 +60,17 @@ private SerializableIndexedRecord(IndexedRecord record) {
@Override
public void put(int i, Object v) {
- record.put(i, v);
+ getData().put(i, v);
}
@Override
public Object get(int i) {
- return record.get(i);
+ return getData().get(i);
Review Comment:
yes, that also need to be fixed
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroIndexedRecord.java:
##########
@@ -126,6 +126,8 @@ private HoodieAvroIndexedRecord(
this.newLocation = record.getNewLocation();
this.ignoreIndexUpdate = record.getIgnoreIndexUpdate();
this.binaryRecord = (SerializableIndexedRecord) this.data;
+ this.isDelete = record.isDelete;
Review Comment:
Note To Reviewer:
this fixes correct rendering of `ordering values` to write handles.
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieCreateRecordUtils.scala:
##########
@@ -130,9 +131,12 @@ object HoodieCreateRecordUtils {
DataSourceWriteOptions.KEYGENERATOR_CONSISTENT_LOGICAL_TIMESTAMP_ENABLED.key(),
DataSourceWriteOptions.KEYGENERATOR_CONSISTENT_LOGICAL_TIMESTAMP_ENABLED.defaultValue()).toBoolean
val requiresPayload = isChangingRecords(operation) && !config.isFileGroupReaderBasedMergeHandle
+ val mergeProps = ConfigUtils.getMergeProps(config.getProps, args.tableConfig.getProps)
+ val deleteContext = new DeleteContext(mergeProps, writerSchema).withReaderSchema(writerSchema);
// handle dropping partition columns
it.map { avroRec =>
+ val isDelete: Boolean = AvroRecordContext.getFieldAccessorInstance.isDeleteRecord(avroRec, deleteContext)
Review Comment:
essentially, we need all components of `BufferedRecord` like ordering value, isDeleted to be part of `HoodieRecord` itself.
So, that w/n write handles, we an afford to lazily deserialize the `SerializedIndexedRecord`.
Infact, for commit time ordering and event time ordering we may not even need to deser and get away with it
and hence we are looking to fix all record creation code snippets to account for custom deletes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322380179
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 56c0576bb3743be284434523bc3e036c97f6c566 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747)
* 8f961e5a5947fcee2bb4ad0392473489fd8db83e UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2372715530
##########
hudi-common/src/main/java/org/apache/hudi/avro/AvroRecordContext.java:
##########
@@ -136,6 +136,15 @@ public IndexedRecord extractDataFromRecord(HoodieRecord record, Schema schema, P
}
}
+ @Override
+ public IndexedRecord extractDeflatedDataFromRecord(HoodieRecord record, Schema schema, Properties properties) {
Review Comment:
Let's remove this based on our offline conversation
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroIndexedRecord.java:
##########
@@ -376,4 +378,8 @@ static void updateMetadataValuesInternal(GenericRecord avroRecord, MetadataValue
public IndexedRecord getData() {
return binaryRecord.getRecord();
Review Comment:
This should return binaryRecord, check out my original draft
##########
hudi-common/src/main/java/org/apache/hudi/common/model/SerializableIndexedRecord.java:
##########
@@ -59,17 +62,17 @@ private SerializableIndexedRecord(IndexedRecord record) {
@Override
public void put(int i, Object v) {
- record.put(i, v);
+ getData().put(i, v);
}
@Override
public Object get(int i) {
- return record.get(i);
+ return getData().get(i);
}
@Override
public Schema getSchema() {
- return record.getSchema();
+ return getData().getSchema();
Review Comment:
We should update this to return `schema` if it is non-null and then `record.getSchema()` otherwise so we don't eagerly deserialize just to return the schema.
##########
hudi-common/src/main/java/org/apache/hudi/common/model/HoodieAvroIndexedRecord.java:
##########
@@ -376,4 +378,8 @@ static void updateMetadataValuesInternal(GenericRecord avroRecord, MetadataValue
public IndexedRecord getData() {
return binaryRecord.getRecord();
}
+
+ public IndexedRecord getSerializableIndexedRecord() {
Review Comment:
Let's remove this and just use `getData`
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -48,6 +48,21 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
}
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props, String[] orderingFields) {
+ boolean isDelete = record.isDelete(schema, props);
+ return fromHoodieRecordWithDeflatedRecord(record, schema, recordContext, props, orderingFields, isDelete);
+ }
+
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext,
+ Properties props, String[] orderingFields, boolean isDelete) {
+ HoodieKey hoodieKey = record.getKey();
+ T data = recordContext.extractDeflatedDataFromRecord(record, schema, props);
+ String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
+ Integer schemaId = recordContext.encodeAvroSchema(schema);
+ Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
+ return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
+ }
+
Review Comment:
This is no different from the `fromHoodieRecord` methods it seems once the fixes are made that I mention above
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3321564372
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322398440
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 8f961e5a5947fcee2bb4ad0392473489fd8db83e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322880836
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c886d5fe2b8f30a4d1ecd6c306da816b03865aa Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753)
* d3ce913eca977fc177353a4d58284e03ef307e79 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322876081
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c886d5fe2b8f30a4d1ecd6c306da816b03865aa Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753)
* d3ce913eca977fc177353a4d58284e03ef307e79 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325390574
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* da6d43b45d4f2dd38b936d1bb7ace8921e6dafab Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325024073
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 125315c6d78ec281ee15dd1e78ab9dc944ff801f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769)
* 6e7ef04d30b4001dbd697b4339318f4f10b054f2 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325835333
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 0f82a608f29ef52c87b4e947fd1859f31705b6c5 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3337797773
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 95db468a7b092cab13e7968ea163c09725206229 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838)
* 58a30322486be23174f8ca9337ec4613d6c6e646 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3328564811
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 67c5910f80d41415065729fe5ed6a1bf6ee3ec42 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790)
* 1b3672a0842b888793293deb28e24991a5b87c57 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "the-other-tim-brown (via GitHub)" <gi...@apache.org>.
the-other-tim-brown commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2375863855
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -45,7 +45,7 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
String recordKey = hoodieKey == null ? recordContext.getRecordKey(data, schema) : hoodieKey.getRecordKey();
Integer schemaId = recordContext.encodeAvroSchema(schema);
Comparable orderingValue = record.getOrderingValue(schema, props, orderingFields);
- return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
Review Comment:
This seems wrong, the ordering value needs to be in the engine specific type but we're removing that here. Is it being added elsewhere?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3330624968
Since there were a boatload of test failures in spark, for now reverting the commits from danny while we work to get lazy deser or avro indexed record fully ready. will sync up w/ danny on changes he pushed out later today.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3330603286
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 822040b9d5efeeeb6291d363eadf3de3ea3fd495 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3337684187
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 95db468a7b092cab13e7968ea163c09725206229 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838)
* 58a30322486be23174f8ca9337ec4613d6c6e646 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3336099788
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* a052805897188c39e5302f45708a3aa16f8f2f28 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807)
* 7875225c0de95b5fffd5fe0d0fc8576e699d5999 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344381032
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* adbc485a41fdc5392360c9ded7fa04da7931c607 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897)
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3345451576
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
}, {
"hash" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913",
"triggerID" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"triggerType" : "PUSH"
}, {
"hash" : "b45738a389dd34965ac070778e2d2eae59dc428a",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8918",
"triggerID" : "b45738a389dd34965ac070778e2d2eae59dc428a",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* a52d2791a8483c5501ae120190b90e0ac7d35d62 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8913)
* b45738a389dd34965ac070778e2d2eae59dc428a Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8918)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2370872970
##########
hudi-common/src/main/java/org/apache/hudi/common/model/SerializableIndexedRecord.java:
##########
@@ -59,17 +60,17 @@ private SerializableIndexedRecord(IndexedRecord record) {
@Override
public void put(int i, Object v) {
- record.put(i, v);
+ getData().put(i, v);
}
@Override
public Object get(int i) {
- return record.get(i);
+ return getData().get(i);
Review Comment:
what about the other getter/setters like `#get(String key)`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3322539727
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 9c886d5fe2b8f30a4d1ecd6c306da816b03865aa Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3325924769
hey @the-other-tim-brown : for COW writes, the patch is ready. I see some flink related test failure, but otherwise all spark tests are green.
While I receive feedback on this patch, I am attempting to enforce lazy across all code paths here https://github.com/apache/hudi/pull/13980. Once I feel the other patch is in some reviewable shape(fixing test failures), I will cherry pick to this patch.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3326015563
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 0f82a608f29ef52c87b4e947fd1859f31705b6c5 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774)
* 7173c6de4bd7430ce9857e879960bc8b64145348 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3326581689
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 7173c6de4bd7430ce9857e879960bc8b64145348 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778)
* b07a282d45dff4025bd2f2e3106bdd26491bf768 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3326173799
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 7173c6de4bd7430ce9857e879960bc8b64145348 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373813246
##########
hudi-common/src/main/java/org/apache/hudi/common/table/read/BufferedRecords.java:
##########
@@ -48,6 +48,24 @@ public static <T> BufferedRecord<T> fromHoodieRecord(HoodieRecord record, Schema
return new BufferedRecord<>(recordKey, recordContext.convertOrderingValueToEngineType(orderingValue), data, schemaId, inferOperation(isDelete, record.getOperation()));
}
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext, Properties props,
+ String[] orderingFields, DeleteContext deleteContext) {
+ HoodieOperation hoodieOperation = record.getIgnoreIndexUpdate() ? HoodieOperation.UPDATE_BEFORE : record.getOperation();
+ boolean isDelete = record.isDelete(deleteContext, props);
+ return fromHoodieRecordWithDeflatedRecord(record, schema, recordContext, props, orderingFields, isDelete, hoodieOperation);
+ }
+
+ public static <T> BufferedRecord<T> fromHoodieRecordWithDeflatedRecord(HoodieRecord record, Schema schema, RecordContext<T> recordContext,
Review Comment:
I didn't see why we need this, can we get rid of it if `#extractDeflatedDataFromRecord` is no longer needed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2373820775
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala:
##########
@@ -508,11 +508,16 @@ class HoodieSparkSqlWriterInternal {
throw new UnsupportedOperationException(s"${writeConfig.getRecordMerger.getClass.getName} only support parquet log.")
}
instantTime = client.startCommit(commitActionType)
+ // if table has undergone upgrade, we need to reload table config
+ tableConfig = HoodieTableMetaClient.builder()
Review Comment:
we have the `HoodieTableConfig.realod` that can be used here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3326701845
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* b07a282d45dff4025bd2f2e3106bdd26491bf768 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3327432308
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 70f6653bb94252ecbfa5c20fb9158b8d3493ebe1 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3328641882
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 1b3672a0842b888793293deb28e24991a5b87c57 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3323047072
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* d3ce913eca977fc177353a4d58284e03ef307e79 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755)
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3336019895
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* a052805897188c39e5302f45708a3aa16f8f2f28 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807)
* 7875225c0de95b5fffd5fe0d0fc8576e699d5999 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3337027833
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 7875225c0de95b5fffd5fe0d0fc8576e699d5999 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827)
* 95db468a7b092cab13e7968ea163c09725206229 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [draft] Lazy deserializization of avro indexed record within write handles [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2370359635
##########
hudi-common/src/main/java/org/apache/hudi/common/model/SerializableIndexedRecord.java:
##########
@@ -46,6 +46,7 @@ public class SerializableIndexedRecord implements GenericRecord, KryoSerializabl
private static final long serialVersionUID = 1L;
private IndexedRecord record;
+ private Schema schema;
Review Comment:
Note:
for now, we wanted to see end to end all writing paths w/ this solution, where we have schema stored per record just within write handles.
Once we have full handle to all write paths, and fished out all thats required for lazy deser, we wanted to optimize this to see if we can remove `schema` and get it working just w/ schemaId.
For now, I can think of creating a HoodieRecord from BufferedRecord and then calling decode(Schema) which does not seem the right way to go. But will come back to this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3341459568
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* 282804d33e9cec336d88371907581dc270d4a37e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #13964:
URL: https://github.com/apache/hudi/pull/13964#issuecomment-3344938737
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8735",
"triggerID" : "3d8883e9e7a0ec5a46d5a55fd9036f6c6b53b53d",
"triggerType" : "PUSH"
}, {
"hash" : "56c0576bb3743be284434523bc3e036c97f6c566",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8747",
"triggerID" : "56c0576bb3743be284434523bc3e036c97f6c566",
"triggerType" : "PUSH"
}, {
"hash" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8751",
"triggerID" : "8f961e5a5947fcee2bb4ad0392473489fd8db83e",
"triggerType" : "PUSH"
}, {
"hash" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8753",
"triggerID" : "9c886d5fe2b8f30a4d1ecd6c306da816b03865aa",
"triggerType" : "PUSH"
}, {
"hash" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8755",
"triggerID" : "d3ce913eca977fc177353a4d58284e03ef307e79",
"triggerType" : "PUSH"
}, {
"hash" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "71796e4df077154c4c445495c5c7aef5c5c48d06",
"triggerType" : "PUSH"
}, {
"hash" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8756",
"triggerID" : "9731144f99a1675d5c5e24fd6f6ba8ee5b4267ad",
"triggerType" : "PUSH"
}, {
"hash" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8769",
"triggerID" : "125315c6d78ec281ee15dd1e78ab9dc944ff801f",
"triggerType" : "PUSH"
}, {
"hash" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8771",
"triggerID" : "6e7ef04d30b4001dbd697b4339318f4f10b054f2",
"triggerType" : "PUSH"
}, {
"hash" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8772",
"triggerID" : "da6d43b45d4f2dd38b936d1bb7ace8921e6dafab",
"triggerType" : "PUSH"
}, {
"hash" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8774",
"triggerID" : "0f82a608f29ef52c87b4e947fd1859f31705b6c5",
"triggerType" : "PUSH"
}, {
"hash" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8778",
"triggerID" : "7173c6de4bd7430ce9857e879960bc8b64145348",
"triggerType" : "PUSH"
}, {
"hash" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8783",
"triggerID" : "b07a282d45dff4025bd2f2e3106bdd26491bf768",
"triggerType" : "PUSH"
}, {
"hash" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8788",
"triggerID" : "70f6653bb94252ecbfa5c20fb9158b8d3493ebe1",
"triggerType" : "PUSH"
}, {
"hash" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8790",
"triggerID" : "67c5910f80d41415065729fe5ed6a1bf6ee3ec42",
"triggerType" : "PUSH"
}, {
"hash" : "1b3672a0842b888793293deb28e24991a5b87c57",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8794",
"triggerID" : "1b3672a0842b888793293deb28e24991a5b87c57",
"triggerType" : "PUSH"
}, {
"hash" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8799",
"triggerID" : "822040b9d5efeeeb6291d363eadf3de3ea3fd495",
"triggerType" : "PUSH"
}, {
"hash" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8807",
"triggerID" : "a052805897188c39e5302f45708a3aa16f8f2f28",
"triggerType" : "PUSH"
}, {
"hash" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8827",
"triggerID" : "7875225c0de95b5fffd5fe0d0fc8576e699d5999",
"triggerType" : "PUSH"
}, {
"hash" : "95db468a7b092cab13e7968ea163c09725206229",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8838",
"triggerID" : "95db468a7b092cab13e7968ea163c09725206229",
"triggerType" : "PUSH"
}, {
"hash" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8845",
"triggerID" : "58a30322486be23174f8ca9337ec4613d6c6e646",
"triggerType" : "PUSH"
}, {
"hash" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8875",
"triggerID" : "d72a0525fb306eb4bafd2d039f6be3a4fc9a2f36",
"triggerType" : "PUSH"
}, {
"hash" : "282804d33e9cec336d88371907581dc270d4a37e",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8882",
"triggerID" : "282804d33e9cec336d88371907581dc270d4a37e",
"triggerType" : "PUSH"
}, {
"hash" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "bba8ccfa2eef3a73015920f35c172d69fc20d60b",
"triggerType" : "PUSH"
}, {
"hash" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8897",
"triggerID" : "adbc485a41fdc5392360c9ded7fa04da7931c607",
"triggerType" : "PUSH"
}, {
"hash" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "9395be0c49c482e3660367ba83c848b0da4afbc3",
"triggerType" : "PUSH"
}, {
"hash" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904",
"triggerID" : "c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f",
"triggerType" : "PUSH"
}, {
"hash" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "a52d2791a8483c5501ae120190b90e0ac7d35d62",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 71796e4df077154c4c445495c5c7aef5c5c48d06 UNKNOWN
* bba8ccfa2eef3a73015920f35c172d69fc20d60b UNKNOWN
* 9395be0c49c482e3660367ba83c848b0da4afbc3 UNKNOWN
* c5c6b0364c8c453d3b26cb00a54d7dc5e12f221f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8904)
* a52d2791a8483c5501ae120190b90e0ac7d35d62 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] Perf: Lazy deserialization of indexed record (within HoodieAvroIndexedRecord) for COW writes [hudi]
Posted by "nsivabalan (via GitHub)" <gi...@apache.org>.
nsivabalan commented on code in PR #13964:
URL: https://github.com/apache/hudi/pull/13964#discussion_r2386945408
##########
hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/model/HoodieFlinkRecord.java:
##########
@@ -103,7 +103,7 @@ protected Comparable<?> doGetOrderingValue(Schema recordSchema, Properties props
if (recordSchema.getField(field) == null) {
return OrderingValues.getDefault();
}
- return (Comparable<?>) getColumnValue(recordSchema, field, props);
Review Comment:
nope. fixed it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org