You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "leaves12138 (via GitHub)" <gi...@apache.org> on 2026/08/11 12:34:20 UTC
[PR] [core] Compact adjacent overlapping blob ranges together [paimon]
leaves12138 opened a new pull request, #9175:
URL: https://github.com/apache/paimon/pull/9175
### Purpose
The blob compact planner currently schedules every overlapping row-range group as a standalone task. When adjacent ranges both contain original and updated blob files, this produces multiple undersized compacted files instead of grouping them according to the target file size.
This change treats each overlapping group as an atomic unit while accumulating contiguous ranges. It adds the whole group before checking the target size, never splits overlapping files across tasks, and uses the merged row-range boundary when deciding whether the next group is contiguous. Large non-overlapping files keep the existing skip behavior.
### Tests
- `mvn spotless:apply`
- `mvn -pl paimon-core -am -Dtest=DataEvolutionCompactCoordinatorTest -Dsurefire.failIfNoSpecifiedTests=false test` (22 tests passed)
- `mvn -pl paimon-core -am -DskipTests install`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] Compact adjacent overlapping blob ranges together [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #9175:
URL: https://github.com/apache/paimon/pull/9175#issuecomment-5253987275
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core] Compact adjacent overlapping blob ranges together [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #9175:
URL: https://github.com/apache/paimon/pull/9175
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org