You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "TheR1sing3un (via GitHub)" <gi...@apache.org> on 2025/12/28 07:53:07 UTC
[PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
TheR1sing3un opened a new pull request, #17730:
URL: https://github.com/apache/hudi/pull/17730
### Describe the issue this Pull Request addresses
closes #17729
<!-- Either describe the issue inline here with motivation behind the changes
(or) link to an issue by including `Closes #<issue-number>` for context.
If this PR includes changes to the storage format, public APIs,
or has breaking changes, use `!` (e.g., feat!: ...) -->
### Summary and Changelog
1. Support splitting tasks based on file size when reading the cow table
### Impact
reduce reading time consumption
### Risk Level
low
### Documentation Update
none
### Contributor's checklist
- [x] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute)
- [x] Enough context is provided in the sections above
- [x] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3694547605
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c36236c5febeab0a403168461ea9551a282793a5",
"status" : "PENDING",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615",
"triggerID" : "c36236c5febeab0a403168461ea9551a282793a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c36236c5febeab0a403168461ea9551a282793a5 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "TheR1sing3un (via GitHub)" <gi...@apache.org>.
TheR1sing3un commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3694624730
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 merged PR #17730:
URL: https://github.com/apache/hudi/pull/17730
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3694625087
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c36236c5febeab0a403168461ea9551a282793a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615",
"triggerID" : "c36236c5febeab0a403168461ea9551a282793a5",
"triggerType" : "PUSH"
}, {
"hash" : "c36236c5febeab0a403168461ea9551a282793a5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "3694624730",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* c36236c5febeab0a403168461ea9551a282793a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "TheR1sing3un (via GitHub)" <gi...@apache.org>.
TheR1sing3un commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3694636916
@danny0405 hi, Danny, could u help me to retrigger Azure CI checks and review my changes? It seems that my trigger command doesn't take effect. Thank you! :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3694546227
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c36236c5febeab0a403168461ea9551a282793a5",
"status" : "UNKNOWN",
"url" : "TBD",
"triggerID" : "c36236c5febeab0a403168461ea9551a282793a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c36236c5febeab0a403168461ea9551a282793a5 UNKNOWN
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3694625955
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c36236c5febeab0a403168461ea9551a282793a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615",
"triggerID" : "c36236c5febeab0a403168461ea9551a282793a5",
"triggerType" : "PUSH"
}, {
"hash" : "c36236c5febeab0a403168461ea9551a282793a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615",
"triggerID" : "3694624730",
"triggerType" : "MANUAL"
} ]
}-->
## CI report:
* c36236c5febeab0a403168461ea9551a282793a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "hudi-bot (via GitHub)" <gi...@apache.org>.
hudi-bot commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3694569293
<!--
Meta data
{
"version" : 1,
"metaDataEntries" : [ {
"hash" : "c36236c5febeab0a403168461ea9551a282793a5",
"status" : "FAILURE",
"url" : "https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615",
"triggerID" : "c36236c5febeab0a403168461ea9551a282793a5",
"triggerType" : "PUSH"
} ]
}-->
## CI report:
* c36236c5febeab0a403168461ea9551a282793a5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=10615)
<details>
<summary>Bot commands</summary>
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the last Azure build
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: Support splitting tasks based on file size when reading the cow table [hudi]
Posted by "TheR1sing3un (via GitHub)" <gi...@apache.org>.
TheR1sing3un commented on PR #17730:
URL: https://github.com/apache/hudi/pull/17730#issuecomment-3717784535
@danny0405 Hi,Danny,could u help me？ 🫡
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org