You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "Zouxxyy (via GitHub)" <gi...@apache.org> on 2026/08/06 07:28:03 UTC
[PR] [core][flink][spark] Use default bucket number for postpone writes [paimon]
Zouxxyy opened a new pull request, #9067:
URL: https://github.com/apache/paimon/pull/9067
### Purpose
- Make `postpone.default-bucket-num` optional and use its configured value exactly for the first real-bucket layout and overwrite writes.
- Let Spark directly write fixed buckets for overwrite and snapshots without real buckets, skipping staged bucket `-2` files.
- Keep existing real-bucket appends on the staged rescale path. For mixed batches, apply the configured default only to new partitions.
- Preserve the existing Flink compact fallback when the option is not configured.
### Tests
- `PostponeUtilsTest`: 16 passed
- Spark 3.5 `PostponeBucketTableTest`: 30 passed
- Flink `CompactAction#testWriteThenCompact`: 1 passed
- Spotless, generated documentation and `git diff --check`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core][flink][spark] Support default bucket number for postpone writes [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi commented on PR #9067:
URL: https://github.com/apache/paimon/pull/9067#issuecomment-5205859060
+1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [core][flink][spark] Support default bucket number for postpone writes [paimon]
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #9067:
URL: https://github.com/apache/paimon/pull/9067
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org