You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Nilesh Chhapru <ni...@ugamsolutions.com> on 2014/11/21 10:58:26 UTC

Out Of Disk Space Issues

Hi All,

Can anyone give some inputs about retention policy as I am trying to save larger data in the topics and hence going out of disk space.

Regards,
Nilesh Chhapru.

---------------------------------------------------------------------------------------Disclaimer----------------------------------------------------------------------------------------------

****Opinions expressed in this e-mail are those of the author and do not necessarily represent those of Ugam. Ugam does not accept any responsibility or liability for it. This e-mail message may contain proprietary, confidential or legally privileged information for the sole use of the person or entity to whom this message was originally addressed. Any review, re-transmission, dissemination or other use of or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you have received this e-mail in error, please delete it and all attachments from any servers, hard drives or any other media.

Warning: Sufficient measures have been taken to scan any presence of viruses however the recipient should check this email and any attachments for the presence of viruses. Ugam accepts no liability for any damage caused by any virus transmitted by this email. ****

Re: Out Of Disk Space Issues

Posted by David Corley <da...@gmail.com>.
See the description of log.retention.bytes here:
https://kafka.apache.org/08/configuration.html

You can set a basic value per log-partition, but you'll need to do some
math to work out an appropriate value based on:
1. The number of partitions per topic
2. The number of topics
3. The capacity of the disks used by the cluster nodes

On Fri, Nov 21, 2014 at 9:58 AM, Nilesh Chhapru <
nilesh.chhapru@ugamsolutions.com> wrote:

> Hi All,
>
> Can anyone give some inputs about retention policy as I am trying to save
> larger data in the topics and hence going out of disk space.
>
> Regards,
> Nilesh Chhapru.
>
>
> ---------------------------------------------------------------------------------------Disclaimer----------------------------------------------------------------------------------------------
>
> ****Opinions expressed in this e-mail are those of the author and do not
> necessarily represent those of Ugam. Ugam does not accept any
> responsibility or liability for it. This e-mail message may contain
> proprietary, confidential or legally privileged information for the sole
> use of the person or entity to whom this message was originally addressed.
> Any review, re-transmission, dissemination or other use of or taking of any
> action in reliance upon this information by persons or entities other than
> the intended recipient is prohibited. If you have received this e-mail in
> error, please delete it and all attachments from any servers, hard drives
> or any other media.
>
> Warning: Sufficient measures have been taken to scan any presence of
> viruses however the recipient should check this email and any attachments
> for the presence of viruses. Ugam accepts no liability for any damage
> caused by any virus transmitted by this email. ****
>