You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2022/04/01 04:29:13 UTC
[GitHub] [flink-table-store] JingsongLi opened a new pull request #70: [FLINK-26971] UniversalCompaction should pick by size ratio after picking by file num
JingsongLi opened a new pull request #70:
URL: https://github.com/apache/flink-table-store/pull/70
This way we can avoid the problem of oversized first files
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink-table-store] tsreaper commented on a change in pull request #70: [FLINK-26971] UniversalCompaction should pick by size ratio after picking by file num
Posted by GitBox <gi...@apache.org>.
tsreaper commented on a change in pull request #70:
URL: https://github.com/apache/flink-table-store/pull/70#discussion_r840435301
##########
File path: flink-table-store-core/src/main/java/org/apache/flink/table/store/file/mergetree/compact/UniversalCompaction.java
##########
@@ -63,7 +63,8 @@ public UniversalCompaction(int maxSizeAmp, int sizeRatio, int maxRunNum) {
// 3 checking for file num
if (runs.size() > maxRunNum) {
Review comment:
Sorry for misleading. They're actually the same option.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink-table-store] tsreaper commented on a change in pull request #70: [FLINK-26971] UniversalCompaction should pick by size ratio after picking by file num
Posted by GitBox <gi...@apache.org>.
tsreaper commented on a change in pull request #70:
URL: https://github.com/apache/flink-table-store/pull/70#discussion_r840271261
##########
File path: flink-table-store-core/src/main/java/org/apache/flink/table/store/file/mergetree/compact/UniversalCompaction.java
##########
@@ -63,7 +63,8 @@ public UniversalCompaction(int maxSizeAmp, int sizeRatio, int maxRunNum) {
// 3 checking for file num
if (runs.size() > maxRunNum) {
Review comment:
Trigger number for this compaction and other compactions should be different (see [rocksdb wiki](https://github.com/facebook/rocksdb/wiki/Universal-Compaction#4-compaction-triggered-by-number-of-sorted-runs-without-respecting-size_ratio)). Add a new option.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [flink-table-store] JingsongLi merged pull request #70: [FLINK-26971] UniversalCompaction should pick by size ratio after picking by file num
Posted by GitBox <gi...@apache.org>.
JingsongLi merged pull request #70:
URL: https://github.com/apache/flink-table-store/pull/70
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org