You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by Somasundaram Sekar <so...@tigeranalytics.com> on 2018/02/20 13:33:56 UTC
Kafka with EBS on AWS : Raid-0 striping or multiple dirs in log.dirs
AWS confluent quickstart
<https://aws.amazon.com/quickstart/architecture/confluent-platform/> configures
Kafka log.dirs with 4 - 512GB EBS block devices with RAID-0 striping for
higher throughput and also helps bypass the 1TB limit of block devices
without provisioned IOPS. I have just come across a statement that “*losing
a block device in the RAID will causing all the data of all of the other
block devices”*, can someone help clarify this!!
Now that Kafka allows multiple directories under log.dirs, *can we mount
each block device under a different mount point and configure them as a
list of directories under log.dirs?*
If that is possible(which it is, I guess), what are the trade-offs?
Thanks,
Somasundaram S
--
*Disclaimer*: This e-mail is intended to be delivered only to the named
addressee(s). If this information is received by anyone other than the
named addressee(s), the recipient(s) should immediately notify
info@tigeranalytics.com and promptly delete the transmitted material from
your computer and server. In no event shall this material be read, used,
stored, or retained by anyone other than the named addressee(s) without the
express written consent of the sender or the named addressee(s). Computer
viruses can be transmitted viaemail. The recipient should check this email and
any attachments for viruses. The company accepts no liability for any
damage caused by any virus transmitted by this email.