You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Daniel Nägele <ka...@danieln.de> on 2019/05/07 09:22:42 UTC

Setting log.dir to a tmpfs

Hello,

I'm currently running a Kafka Cluster with a retention policy of 30mins
and 10min log segments. In practice, this uses less than 20GB of file
system space. Thus, I've been thinking about having no persistent
storage at all.

In the worst case, I do not mind losing the last 30min of historic
messages, as long as the live availability is given.

It is very hard to find any documentation regarding a setup like this,
but I hesitate to just go ahead and configure log.dir to point to a
tmpfs mount.

1. Does anyone have experience with a setup like this?
2. How does Kafka like starting up with a empty log.dir? (after a reboot)
3. Does it make a difference if the whole Cluster starts empty vs a
single node?

Thanks,
Daniel