You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Raghav <ra...@gmail.com> on 2017/11/23 00:04:22 UTC
Question about disks and log.dirs
Hi
If I give several locations with smaller capacity for log.dirs vs one large
drive for log.dirs, are there any PROS or CONS between the two (assuming
total storage is same in both cases).
I don't have access to one drive for log.dirs, but several smaller
directories. I just want to ensure that there are no issues.
Thanks.
--
Raghav
Re: Question about disks and log.dirs
Posted by Manikumar <ma...@gmail.com>.
All the data log files for a given topic-partition are stored under a
topic-partition directory in a particular data.dir.
So a topic-partition directory can grow up to the capacity of the log.dir
director. And there can be multiple
topic-partition directories in a data.dir. It depends topic-partitions
retention size and the disk capacity.
After JBOD improvements (KAFKA-4763) and with multiple disks, broker will
continue to work even after disk failures.
On Fri, Dec 1, 2017 at 6:16 AM, Raghav <ra...@gmail.com> wrote:
> Can someone please help here ?
>
> On Thu, Nov 23, 2017 at 10:42 AM, Raghav <ra...@gmail.com> wrote:
>
> > Anyone here ?
> >
> > On Wed, Nov 22, 2017 at 4:04 PM, Raghav <ra...@gmail.com> wrote:
> >
> >> Hi
> >>
> >> If I give several locations with smaller capacity for log.dirs vs one
> >> large drive for log.dirs, are there any PROS or CONS between the two
> >> (assuming total storage is same in both cases).
> >>
> >> I don't have access to one drive for log.dirs, but several smaller
> >> directories. I just want to ensure that there are no issues.
> >>
> >> Thanks.
> >>
> >> --
> >> Raghav
> >>
> >
> >
> >
> > --
> > Raghav
> >
>
>
>
> --
> Raghav
>
Re: Question about disks and log.dirs
Posted by Raghav <ra...@gmail.com>.
Can someone please help here ?
On Thu, Nov 23, 2017 at 10:42 AM, Raghav <ra...@gmail.com> wrote:
> Anyone here ?
>
> On Wed, Nov 22, 2017 at 4:04 PM, Raghav <ra...@gmail.com> wrote:
>
>> Hi
>>
>> If I give several locations with smaller capacity for log.dirs vs one
>> large drive for log.dirs, are there any PROS or CONS between the two
>> (assuming total storage is same in both cases).
>>
>> I don't have access to one drive for log.dirs, but several smaller
>> directories. I just want to ensure that there are no issues.
>>
>> Thanks.
>>
>> --
>> Raghav
>>
>
>
>
> --
> Raghav
>
--
Raghav
Re: Question about disks and log.dirs
Posted by Raghav <ra...@gmail.com>.
Anyone here ?
On Wed, Nov 22, 2017 at 4:04 PM, Raghav <ra...@gmail.com> wrote:
> Hi
>
> If I give several locations with smaller capacity for log.dirs vs one
> large drive for log.dirs, are there any PROS or CONS between the two
> (assuming total storage is same in both cases).
>
> I don't have access to one drive for log.dirs, but several smaller
> directories. I just want to ensure that there are no issues.
>
> Thanks.
>
> --
> Raghav
>
--
Raghav