[jira] [Created] (KAFKA-1489) Global threshold on data retention size

["Andras Sereny (JIRA)" <ji...@apache.org>]

Andras Sereny created KAFKA-1489:
------------------------------------

             Summary: Global threshold on data retention size
                 Key: KAFKA-1489
                 URL: https://issues.apache.org/jira/browse/KAFKA-1489
             Project: Kafka
          Issue Type: Bug
          Components: log
    Affects Versions: 0.8.1.1
            Reporter: Andras Sereny
            Assignee: Jay Kreps


Currently, Kafka has per topic settings to control the size of one single log (log.retention.bytes). With lots of topics of different volume and as they grow in number, it could become tedious to maintain topic level settings applying to a single log. 

Often, a chunk of disk space is dedicated to Kafka that hosts all logs stored, so it'd make sense to have a configurable threshold to control how much space *all* data in Kafka can take up.

See also:
http://mail-archives.apache.org/mod_mbox/kafka-users/201406.mbox/browser
http://mail-archives.apache.org/mod_mbox/kafka-users/201311.mbox/%3C20131107015125.GC9718@jkoshy-ld.linkedin.biz%3E



--
This message was sent by Atlassian JIRA
(v6.2#6252)