You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by kant kodali <ka...@gmail.com> on 2016/09/22 23:54:42 UTC

Does Kafka Sync/persist every message from a publisher by default?

Does Kafka Sync/persist every message from a publisher by default? If not, What
settings should I change so I Sync every message?

RE: Does Kafka Sync/persist every message from a publisher by default?

Posted by "Tauzell, Dave" <Da...@surescripts.com>.
If by "sync" you mean "fsync" then, no it does not.   There are some properties:

log.flush.interval.messages
log.flush.interval.ms

In theory you could set log.flush.interval.messages to 1 to fsync with each write.  I haven't tried this to see what happens but I expect performance will drop quite  a bit.

-Dave

-----Original Message-----
From: kant kodali [mailto:kanth909@gmail.com]
Sent: Thursday, September 22, 2016 6:55 PM
To: users@kafka.apache.org
Subject: Does Kafka Sync/persist every message from a publisher by default?

Does Kafka Sync/persist every message from a publisher by default? If not, What settings should I change so I Sync every message?
This e-mail and any files transmitted with it are confidential, may contain sensitive information, and are intended solely for the use of the individual or entity to whom they are addressed. If you have received this e-mail in error, please notify the sender by reply e-mail immediately and destroy all copies of the e-mail and any attachments.