You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by David Yu <gu...@gmail.com> on 2016/09/01 17:18:07 UTC

Retention on compacted topics

Hi,

Does Kafka "log.retention.bytes" or "log.retention.ms" apply to compaction
enabled topic? I'll be surprised it does not, since this means that a
compacted topic will potentially grow unbounded if deletion is not
happening quickly enough (if we do deletion at all).

Thanks,
David

Re: Retention on compacted topics

Posted by David Yu <gu...@gmail.com>.

Ok, thanks for confirming.

On Thu, Sep 1, 2016 at 12:21 PM Tom Crayford <tc...@heroku.com> wrote:

> It is not applied. An upcoming release will have the ability to combine the
> two, but right now they are mutually exclusive.
>
> On Thu, Sep 1, 2016 at 6:18 PM, David Yu <gu...@gmail.com> wrote:
>
> > Hi,
> >
> > Does Kafka "log.retention.bytes" or "log.retention.ms" apply to
> compaction
> > enabled topic? I'll be surprised it does not, since this means that a
> > compacted topic will potentially grow unbounded if deletion is not
> > happening quickly enough (if we do deletion at all).
> >
> > Thanks,
> > David
> >
>

Re: Retention on compacted topics

Posted by Tom Crayford <tc...@heroku.com>.

It is not applied. An upcoming release will have the ability to combine the
two, but right now they are mutually exclusive.

On Thu, Sep 1, 2016 at 6:18 PM, David Yu <gu...@gmail.com> wrote:

> Hi,
>
> Does Kafka "log.retention.bytes" or "log.retention.ms" apply to compaction
> enabled topic? I'll be surprised it does not, since this means that a
> compacted topic will potentially grow unbounded if deletion is not
> happening quickly enough (if we do deletion at all).
>
> Thanks,
> David
>