You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Badai Aqrandista (Jira)" <ji...@apache.org> on 2021/07/06 23:07:00 UTC
[jira] [Updated] (KAFKA-13040) Increase minimum value of segment.ms
and segment.bytes
[ https://issues.apache.org/jira/browse/KAFKA-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Badai Aqrandista updated KAFKA-13040:
-------------------------------------
Description:
Raised for KIP-760 (linked).
Many times, Kafka brokers in production crash with "Too many open files" error or "Out of memory" errors because some Kafka topics have a lot of segment files as a result of small {{segment.ms}} or {{segment.bytes}}. These two configuration can be set by any user who is authorized to create topic or modify topic configuration.
To prevent these two configuration from causing Kafka broker crash, they should have a minimum value that is big enough.
was:
Many times, Kafka brokers in production crash with "Too many open files" error or "Out of memory" errors because some Kafka topics have a lot of segment files as a result of small {{segment.ms}} or {{segment.bytes}}. These two configuration can be set by any user who is authorized to create topic or modify topic configuration.
To prevent these two configuration from causing Kafka broker crash, they should have a minimum value that is big enough.
> Increase minimum value of segment.ms and segment.bytes
> ------------------------------------------------------
>
> Key: KAFKA-13040
> URL: https://issues.apache.org/jira/browse/KAFKA-13040
> Project: Kafka
> Issue Type: Improvement
> Reporter: Badai Aqrandista
> Assignee: Badai Aqrandista
> Priority: Minor
>
> Raised for KIP-760 (linked).
> Many times, Kafka brokers in production crash with "Too many open files" error or "Out of memory" errors because some Kafka topics have a lot of segment files as a result of small {{segment.ms}} or {{segment.bytes}}. These two configuration can be set by any user who is authorized to create topic or modify topic configuration.
> To prevent these two configuration from causing Kafka broker crash, they should have a minimum value that is big enough.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)