You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2022/07/04 12:12:03 UTC

[GitHub] [flink-table-store] LadyForest commented on pull request #182: [FLINK-27708] Add background compaction task for append-only table when ingesting

LadyForest commented on PR #182:
URL: https://github.com/apache/flink-table-store/pull/182#issuecomment-1173746816

   **Update**
   
   After discussion with @JingsongLi, the implementation details have the following changes.
   - **On how to define the compaction trigger moment** 
      If there exist **adjacent small files** whose size exceeds a threshold(configured by the option key), then the compaction is triggered.
   
   - **On how to rewrite files**
      Reuse `RollingFileWriter` instead of manually grouping and calculating the sum of file size.
   
   - **On auto-compaction under streaming mode**
      New files are continuously added to `toCompact`, `toCompact` is cleared iff after a **truly triggered** compaction. If the last generated compacted file is still smaller than the target file size, it will be added back to `toCompact`(on the top)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@flink.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org