You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Igor Kuzmenko <f1...@gmail.com> on 2017/05/12 17:05:15 UTC

Rebalance topic partitions over HDD

My kafka broker v0.10.1 failed with exception, because no disk space was
left:

[root@queue001 log]# df -h
Filesystem                              Size  Used Avail Use% Mounted on



*/dev/mapper/ol-queue00103-data_3  1.1T  1.1T     0 100%
/data/3/dev/mapper/ol-queue00101-data_1  1.1T  628G  417G  61%
/data/1/dev/mapper/ol-queue00102-data_2  1.1T  836G  209G  81%
/data/2/dev/mapper/ol-queue00100-data_0  1.1T  837G  208G  81% /data/0*


*/data/0 - /data/3 *are set as kafka log.dirs. In /data/3 kafka created 5
out 16 partitions of large topic and only 3 in /data/1. Total space left on
server was fine so monitoring system didn't alarm.
Is there any way to distribute partitions evenly between disks?