You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kafka.apache.org by "Jason Weiss (JIRA)" <ji...@apache.org> on 2013/05/23 21:47:20 UTC

[jira] [Created] (KAFKA-918) Change log.retention.hours to be log.retention.mins

Jason Weiss created KAFKA-918:
---------------------------------

             Summary: Change log.retention.hours to be log.retention.mins
                 Key: KAFKA-918
                 URL: https://issues.apache.org/jira/browse/KAFKA-918
             Project: Kafka
          Issue Type: New Feature
          Components: config
    Affects Versions: 0.7.2
            Reporter: Jason Weiss


We stood up a cluster that is processing over 350,000 events per second, with each event a fixed payload size of 2K. The storage required to process that much data over an hour is beyond what we wanted to pay for at AWS. Additionally, we don't have a requirement to keep the files around for an extended period after processing.

It would be tremendously valuable for us to be able to define the log.retention in minutes, not hours. For example, we would prefer to only keep 30 minutes of logs around.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira