[GitHub] [druid] stevenchen3 commented on issue #9132: how auto compaction work?

[GitBox <gi...@apache.org>]

stevenchen3 commented on issue #9132:
URL: https://github.com/apache/druid/issues/9132#issuecomment-698072553


   Encountered the same here. I am using Druid `0.16.0` and below is my automatic compaction config:
   
   ```yaml
   {
     "compactionConfigs":[
       {
         "dataSource":"mydatasource",
         "taskPriority":25,
         "inputSegmentSizeBytes":500000000,
         "targetCompactionSizeBytes":500000000,
         "maxRowsPerSegment":null,
         "maxNumSegmentsToCompact":1000,
         "skipOffsetFromLatest":"P1D",
         "tuningConfig":null,
         "taskContext":null
       }
     ],
     "compactionTaskSlotRatio":0.75,
     "maxCompactionTaskSlots":2147483647
   }
   
   # I have a total 20 task slots
   ```
   
   I was trying to enable auto-compact to merge small segments (about 100KB per segment) to bigger ones. The segment size of the same interval does not exceed above `500000000` and the total number of small segments is about 900 (this number for my test env, it will be much bigger in production env).
   
   However, I did not see any compaction task running, nor observe any logs (related to https://github.com/apache/druid/issues/9132#issuecomment-576832985).
   
   Wondering anyone has any idea to resolve this?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org