You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Dumitru-Nicolae Marasoui <ni...@ovoenergy.com> on 2020/05/11 16:15:39 UTC

how can I manually do a compaction?

Hi, how can I manually do a compaction? (in a local laptop setup)
Is there a command line for this, or certain broker settings to look for?
Thank you,

-- 
Thank you,
Nicolae Marasoiu
Scala Engineer
Orion, OVO Group

Re: how can I manually do a compaction?

Posted by Liam Clarke-Hutchinson <li...@adscale.co.nz>.
Hi Nicolae,

Nope, the log cleaner is a thread that runs in the background periodically.
Also be aware that it only compacts log segments that are no longer being
written to - and the default size for a log segment and default log roll
time are both very high, so you won't be seeing log compaction in a testing
environment without changing those broker settings: log.segment.bytes and
log.roll.ms

You'd probably also want to set log.cleaner.max.compaction.lag.ms to a low
figure to allow the log cleaner to aggressively clean in a testing
situation.

Cheers,

Liam Clarke-Hutchinson

On Tue, May 12, 2020 at 4:16 AM Dumitru-Nicolae Marasoui <
nicolae.marasoiu@ovoenergy.com> wrote:

> Hi, how can I manually do a compaction? (in a local laptop setup)
> Is there a command line for this, or certain broker settings to look for?
> Thank you,
>
> --
> Thank you,
> Nicolae Marasoiu
> Scala Engineer
> Orion, OVO Group
>