You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Matthias J. Sax (Jira)" <ji...@apache.org> on 2025/12/13 00:39:00 UTC
[jira] [Created] (KAFKA-19992) Allow to configure max memory for restore path
Matthias J. Sax created KAFKA-19992:
---------------------------------------
Summary: Allow to configure max memory for restore path
Key: KAFKA-19992
URL: https://issues.apache.org/jira/browse/KAFKA-19992
Project: Kafka
Issue Type: Improvement
Components: streams
Reporter: Matthias J. Sax
Kafka Streams allows users to configure many different memory limits, to pro-actively manage memory usage to avoid OutOfMemory errors.
However, on the restore code path, there is no such memory management. The `StoreChangelogReader` fetches a batch of message, and buffers them inside `ChangelogMetadata`, and there is no limit enforced on this buffer.
We could either re-use the existing config for input topic buffer (`
buffered.records.per.partition`) or introduce a new config (this would require a KIP though). – Even if we re-use the existing config, not 100% sure if we would need a KIP or not?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)