You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by David Espinosa <es...@gmail.com> on 2018/07/30 09:06:54 UTC
How set properly infinite retention
Hi all,
I would like to set infinite retention for all topics created in the
cluster by default.
I have tried with:
*log.retention.ms <http://log.retention.ms>=-1* at *server.properties*
But messages get deleted approx after 10 days.
Which configuration at broker level should I use for infinite retention?
Thanks in advance,
David
Re: How set properly infinite retention
Posted by David Espinosa <es...@gmail.com>.
Thanks a lot! I will try that!
David
El lun., 30 jul. 2018 a las 13:26, Kamal Chandraprakash (<
kamal.chandraprakash@gmail.com>) escribió:
> log.retention.ms = 9223372036854775807 (Long.MAX_VALUE)
>
>
> On Mon, Jul 30, 2018 at 3:04 PM David Espinosa <es...@gmail.com> wrote:
>
> > Hi thanks a lot for the reply.
> >
> > The thing is that I need compaction to delete some messages (for GDPR
> > purposes), and for that I need the log cleaner to be enabled (with
> > policy=compact).
> >
> > David
> >
> >
> > El lun., 30 jul. 2018 a las 11:27, M. Manna (<ma...@gmail.com>)
> > escribió:
> >
> > > I believe you can simply disable log cleaner.
> > >
> > > On Mon, 30 Jul 2018, 10:07 David Espinosa, <es...@gmail.com> wrote:
> > >
> > > > Hi all,
> > > > I would like to set infinite retention for all topics created in the
> > > > cluster by default.
> > > > I have tried with:
> > > >
> > > > *log.retention.ms <http://log.retention.ms>=-1* at
> *server.properties*
> > > >
> > > > But messages get deleted approx after 10 days.
> > > >
> > > > Which configuration at broker level should I use for infinite
> > retention?
> > > >
> > > > Thanks in advance,
> > > > David
> > > >
> > >
> >
>
Re: How set properly infinite retention
Posted by Kamal Chandraprakash <ka...@gmail.com>.
log.retention.ms = 9223372036854775807 (Long.MAX_VALUE)
On Mon, Jul 30, 2018 at 3:04 PM David Espinosa <es...@gmail.com> wrote:
> Hi thanks a lot for the reply.
>
> The thing is that I need compaction to delete some messages (for GDPR
> purposes), and for that I need the log cleaner to be enabled (with
> policy=compact).
>
> David
>
>
> El lun., 30 jul. 2018 a las 11:27, M. Manna (<ma...@gmail.com>)
> escribió:
>
> > I believe you can simply disable log cleaner.
> >
> > On Mon, 30 Jul 2018, 10:07 David Espinosa, <es...@gmail.com> wrote:
> >
> > > Hi all,
> > > I would like to set infinite retention for all topics created in the
> > > cluster by default.
> > > I have tried with:
> > >
> > > *log.retention.ms <http://log.retention.ms>=-1* at *server.properties*
> > >
> > > But messages get deleted approx after 10 days.
> > >
> > > Which configuration at broker level should I use for infinite
> retention?
> > >
> > > Thanks in advance,
> > > David
> > >
> >
>
Re: How set properly infinite retention
Posted by David Espinosa <es...@gmail.com>.
Hi thanks a lot for the reply.
The thing is that I need compaction to delete some messages (for GDPR
purposes), and for that I need the log cleaner to be enabled (with
policy=compact).
David
El lun., 30 jul. 2018 a las 11:27, M. Manna (<ma...@gmail.com>) escribió:
> I believe you can simply disable log cleaner.
>
> On Mon, 30 Jul 2018, 10:07 David Espinosa, <es...@gmail.com> wrote:
>
> > Hi all,
> > I would like to set infinite retention for all topics created in the
> > cluster by default.
> > I have tried with:
> >
> > *log.retention.ms <http://log.retention.ms>=-1* at *server.properties*
> >
> > But messages get deleted approx after 10 days.
> >
> > Which configuration at broker level should I use for infinite retention?
> >
> > Thanks in advance,
> > David
> >
>
Re: How set properly infinite retention
Posted by "M. Manna" <ma...@gmail.com>.
I believe you can simply disable log cleaner.
On Mon, 30 Jul 2018, 10:07 David Espinosa, <es...@gmail.com> wrote:
> Hi all,
> I would like to set infinite retention for all topics created in the
> cluster by default.
> I have tried with:
>
> *log.retention.ms <http://log.retention.ms>=-1* at *server.properties*
>
> But messages get deleted approx after 10 days.
>
> Which configuration at broker level should I use for infinite retention?
>
> Thanks in advance,
> David
>