You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "TheR1sing3un (via GitHub)" <gi...@apache.org> on 2025/01/20 10:03:02 UTC
[PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
TheR1sing3un opened a new pull request, #12677:
URL: https://github.com/apache/hudi/pull/12677
Consider following case when we perform snapshot-read on MoR table:
1. full schema: (`A`, `B`, `C`, `D`)
2. primary key field: `A`
3. pre-combine key field: `B`
4. query with `select D from table`
> for each file group
| data file | log files | operation | payload allow projection pushdown | actual read schema|
|---|---|---|---|---|
| exist | empty | ... | ... | (`_hoodie_record_key`, `B`, `D`) |
| empty | exist | ... | ... | (`_hoodie_record_key`, `B`, `D`) |
| exist | exist | skip_merge | ... | (`_hoodie_record_key`, `B`, `D`) |
| exist | exist | payload_combine | Y | (`_hoodie_record_key`, `B`, `D`) |
| exist | exist | payload_combine | N | (`_hoodie_record_key`, `A`, `B`, `D`) |
However, except for the last two case, we only need to read column `D` on the file in other cases.
### Change Logs
1. Trim unnecessary columns during MoR snapshot read
### Impact
Improves performance when MoR snapshot-read with not actually merged
### Risk level (write none, low medium or high below)
low
### Documentation Update
none
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Change Logs and Impact were stated clearly
- [x] Adequate tests were added if applicable
- [x] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2601968346
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b006fb03f0f55f180c0ed2edb897562702759f58 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974)
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2602124043
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b006fb03f0f55f180c0ed2edb897562702759f58 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974)
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 1f6e7dcd1a4b1c19155cc6ab23c654f182953f88 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2603546086
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 1f6e7dcd1a4b1c19155cc6ab23c654f182953f88 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976)
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 18c1648e3918f2081a75b459f92a27498c4cd77b Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2603940936
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
}, {
"hash" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988",
"triggerID" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 2ad28a1029707e9cedc2ea784c677fa82cb2609c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2603528499
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 1f6e7dcd1a4b1c19155cc6ab23c654f182953f88 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976)
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 18c1648e3918f2081a75b459f92a27498c4cd77b UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2604356422
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
}, {
"hash" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988",
"triggerID" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"triggerType" : "PUSH"
}, {
"hash" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2991",
"triggerID" : "2604042738",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 2ad28a1029707e9cedc2ea784c677fa82cb2609c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988) Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2991)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2602042259
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "CANCELED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b006fb03f0f55f180c0ed2edb897562702759f58 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974)
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 1f6e7dcd1a4b1c19155cc6ab23c654f182953f88 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2603684512
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
}, {
"hash" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 18c1648e3918f2081a75b459f92a27498c4cd77b Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980)
* 2ad28a1029707e9cedc2ea784c677fa82cb2609c UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "TheR1sing3un (via GitHub)" <gi...@apache.org>.
TheR1sing3un closed pull request #12677: [HUDI-8889] Trim unnecessary columns during MoR snapshot read
URL: https://github.com/apache/hudi/pull/12677
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "TheR1sing3un (via GitHub)" <gi...@apache.org>.
TheR1sing3un commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2604042738
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #12677:
URL: https://github.com/apache/hudi/pull/12677#discussion_r1928005959
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##########
@@ -278,13 +278,21 @@ abstract class HoodieBaseRelation(val sqlContext: SQLContext,
/**
* Columns that relation has to read from the storage to properly execute on its semantic: for ex,
- * for Merge-on-Read tables key fields as well and precombine field comprise mandatory set of columns,
+ * for performing incremental read, the {@link HoodieRecord.COMMIT_TIME_METADATA_FIELD} is required for filtering the out-of-range records
+ *
+ * @VisibleInTests
+ */
+ lazy val mandatoryFields: Seq[String] = Seq.empty
+
+ /**
+ * Columns that relation may need to read from the storage to properly execute on its semantic: for ex,
+ * for Merge-on-Read tables key fields as well and pre-combine field comprise mandatory set of columns,
* meaning that regardless of whether this columns are being requested by the query they will be fetched
- * regardless so that relation is able to combine records properly (if necessary)
+ * regardless so that relation is able to combine records properly (when performing Snapshot-Read on the file-groups with log files)
*
* @VisibleInTests
*/
- val mandatoryFields: Seq[String]
+ lazy val optionalExtraFields: Seq[String] = Seq.empty
Review Comment:
Not sure how the fields got set up and whether they are required or not.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2602346536
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 1f6e7dcd1a4b1c19155cc6ab23c654f182953f88 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2601960383
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b006fb03f0f55f180c0ed2edb897562702759f58 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "TheR1sing3un (via GitHub)" <gi...@apache.org>.
TheR1sing3un commented on code in PR #12677:
URL: https://github.com/apache/hudi/pull/12677#discussion_r1928007792
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##########
@@ -278,13 +278,21 @@ abstract class HoodieBaseRelation(val sqlContext: SQLContext,
/**
* Columns that relation has to read from the storage to properly execute on its semantic: for ex,
- * for Merge-on-Read tables key fields as well and precombine field comprise mandatory set of columns,
+ * for performing incremental read, the {@link HoodieRecord.COMMIT_TIME_METADATA_FIELD} is required for filtering the out-of-range records
+ *
+ * @VisibleInTests
+ */
+ lazy val mandatoryFields: Seq[String] = Seq.empty
+
+ /**
+ * Columns that relation may need to read from the storage to properly execute on its semantic: for ex,
+ * for Merge-on-Read tables key fields as well and pre-combine field comprise mandatory set of columns,
* meaning that regardless of whether this columns are being requested by the query they will be fetched
- * regardless so that relation is able to combine records properly (if necessary)
+ * regardless so that relation is able to combine records properly (when performing Snapshot-Read on the file-groups with log files)
*
* @VisibleInTests
*/
- val mandatoryFields: Seq[String]
+ lazy val optionalExtraFields: Seq[String] = Seq.empty
Review Comment:
> Not sure how the fields got set up and whether they are required or not.
`mandatory` is for fields that are required to be read regardless of any read behavior, such as `_hoodie_commit_time` in incremental-read, and `optional` is for fields that are required to be merged during snapshot reads, such as `_hoodie_record_key` and `precombine-key`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2604050129
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
}, {
"hash" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988",
"triggerID" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"triggerType" : "PUSH"
}, {
"hash" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2991",
"triggerID" : "2604042738",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 2ad28a1029707e9cedc2ea784c677fa82cb2609c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988) Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2991)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2603667086
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 18c1648e3918f2081a75b459f92a27498c4cd77b Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2603515396
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "SUCCESS",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 1f6e7dcd1a4b1c19155cc6ab23c654f182953f88 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976)
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on code in PR #12677:
URL: https://github.com/apache/hudi/pull/12677#discussion_r1928109346
##########
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##########
@@ -278,13 +278,21 @@ abstract class HoodieBaseRelation(val sqlContext: SQLContext,
/**
* Columns that relation has to read from the storage to properly execute on its semantic: for ex,
- * for Merge-on-Read tables key fields as well and precombine field comprise mandatory set of columns,
+ * for performing incremental read, the {@link HoodieRecord.COMMIT_TIME_METADATA_FIELD} is required for filtering the out-of-range records
+ *
+ * @VisibleInTests
+ */
+ lazy val mandatoryFields: Seq[String] = Seq.empty
+
+ /**
+ * Columns that relation may need to read from the storage to properly execute on its semantic: for ex,
+ * for Merge-on-Read tables key fields as well and pre-combine field comprise mandatory set of columns,
* meaning that regardless of whether this columns are being requested by the query they will be fetched
- * regardless so that relation is able to combine records properly (if necessary)
+ * regardless so that relation is able to combine records properly (when performing Snapshot-Read on the file-groups with log files)
*
* @VisibleInTests
*/
- val mandatoryFields: Seq[String]
+ lazy val optionalExtraFields: Seq[String] = Seq.empty
Review Comment:
So why name the fields optional?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2601964423
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* b006fb03f0f55f180c0ed2edb897562702759f58 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974)
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-2603758606
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2974",
"triggerID" : "b006fb03f0f55f180c0ed2edb897562702759f58",
"triggerType" : "PUSH"
}, {
"hash" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "39f927a86d3c445aa1131281d6997ff758a01e34",
"triggerType" : "PUSH"
}, {
"hash" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"status" : "DELETED",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2976",
"triggerID" : "1f6e7dcd1a4b1c19155cc6ab23c654f182953f88",
"triggerType" : "PUSH"
}, {
"hash" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "484215158747fb20f90130a6e2dd7d923aaf0c9f",
"triggerType" : "PUSH"
}, {
"hash" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980",
"triggerID" : "18c1648e3918f2081a75b459f92a27498c4cd77b",
"triggerType" : "PUSH"
}, {
"hash" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988",
"triggerID" : "2ad28a1029707e9cedc2ea784c677fa82cb2609c",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* 39f927a86d3c445aa1131281d6997ff758a01e34 UNKNOWN
* 484215158747fb20f90130a6e2dd7d923aaf0c9f UNKNOWN
* 18c1648e3918f2081a75b459f92a27498c4cd77b Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2980)
* 2ad28a1029707e9cedc2ea784c677fa82cb2609c Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2988)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [HUDI-8889] Trim unnecessary columns during MoR snapshot read [hudi]
Posted by "TheR1sing3un (via GitHub)" <gi...@apache.org>.
TheR1sing3un commented on PR #12677:
URL: https://github.com/apache/hudi/pull/12677#issuecomment-3678534827
> @TheR1sing3un The MOR snapshot read goes through the new `HadoopFsRelation` and FGReader-based implementation which should project columns. Is this PR still relevant?
closed～
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org