You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Antony Stubbs (JIRA)" <ji...@apache.org> on 2017/11/19 19:45:00 UTC
[jira] [Created] (KAFKA-6235) Kafka should have an emergency
retention setting for max disk used
Antony Stubbs created KAFKA-6235:
------------------------------------
Summary: Kafka should have an emergency retention setting for max disk used
Key: KAFKA-6235
URL: https://issues.apache.org/jira/browse/KAFKA-6235
Project: Kafka
Issue Type: New Feature
Reporter: Antony Stubbs
Kafka should have an emergency retention setting for max disk used to prevent the broker running out of disk and partitions going off line. When this max is reached, Kafka could perhaps delete segments from the largest topics.. Would have to be used with care as current behaviour is to preserve data at the cost of availability. This would favour availability over data retention.
At the moment it's quite hard to reason about disk usage and Kafka as the max byte settings are all per partition, and the math can get complicated when you have lots of topics of different use cases and sizes..
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)