Re: manually trigger log compaction

[Brett Rann <br...@zendesk.com.INVALID>]

There's no way to "trigger compaction" per se, but you can use multiple
configs to
compel it. I've documented it in this ticket:
https://issues.apache.org/jira/browse/KAFKA-7137

Essentially you can set min.cleanable.dirty.ratio=0 and segment.ms to make
sure  a new segment is rolled (compaction won't happen on the active
segment and if you care about that segment.ms lets you compel a new one)

And then it needs a message to come in to trigger the segment roll and
the compaction evaulation.



On Thu, Sep 27, 2018 at 2:00 AM M. Manna <ma...@gmail.com> wrote:

> This is possible using kafka-configs script. You need 'topics' as entity
> type and --alter directive. The changes are made cluster-wide.
>
> Try the help documentation for kafka-configs.
>
> Regards,
>
> On Wed, 26 Sep 2018 at 16:16, Xu, Nan <nx...@baml.com.invalid> wrote:
>
> > Hi,
> >
> > Wondering is there a way to manually trigger a log compaction for a
> > certain topic?
> >
> > Thanks,
> > Nan
> >
> > ----------------------------------------------------------------------
> > This message, and any attachments, is for the intended recipient(s) only,
> > may contain information that is privileged, confidential and/or
> proprietary
> > and subject to important terms and conditions available at
> > http://www.bankofamerica.com/emaildisclaimer
> <http://www.bankofamerica.com/emaildisclaimer>. If you are
> not the
> > intended recipient, please delete this message.
> >
>




-- 

Brett Rann

Senior DevOps Engineer


Zendesk International Ltd

395 Collins Street, Melbourne VIC 3000 Australia

Mobile: +61 (0) 418 826 017