You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "bithw1 (via GitHub)" <gi...@apache.org> on 2024/11/01 11:40:18 UTC

[I] [SUPPORT] What's the difference between compaction service and log compaction service [hudi]

bithw1 opened a new issue, #12190:
URL: https://github.com/apache/hudi/issues/12190

   HI,
   
   I am reading Hudi 0.15.0 source code,  find there are two compaction inline options, one is `hoodie.compact.inline`,the other is `hoodie.log.compaction.inline`,
   
   Both of them say that the compaction/log compaction service will be triggered after each write, I would ask what't the difference between these two services.
   
   
   The defintion of the two options are as follows:
   
   
   ```
     public static final ConfigProperty<String> INLINE_COMPACT = ConfigProperty
         .key("hoodie.compact.inline")
         .defaultValue("false")
         .withDocumentation("When set to true, compaction service is triggered after each write. While being "
             + " simpler operationally, this adds extra latency on the write path.");
   ```
   
   and 
   
   ```
     public static final ConfigProperty<String> INLINE_LOG_COMPACT = ConfigProperty
         .key("hoodie.log.compaction.inline")
         .defaultValue("false")
         .markAdvanced()
         .sinceVersion("0.13.0")
         .withDocumentation("When set to true, log compaction service is triggered after each write. While being "
             + " simpler operationally, this adds extra latency on the write path.");
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [SUPPORT] What's the difference between compaction service and log compaction service [hudi]

Posted by "danny0405 (via GitHub)" <gi...@apache.org>.
danny0405 commented on issue #12190:
URL: https://github.com/apache/hudi/issues/12190#issuecomment-2452752503

   log compaction is used for merging multiple log blocks into a larger one(also a log block); while compaction merges all the log files of the current version into a parquet file, also rolls over the current file slice version into new. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [SUPPORT] What's the difference between compaction service and log compaction service [hudi]

Posted by "ad1happy2go (via GitHub)" <gi...@apache.org>.
ad1happy2go closed issue #12190: [SUPPORT] What's the difference between compaction service and log compaction service
URL: https://github.com/apache/hudi/issues/12190


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org