You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Kamal Chandraprakash (Jira)" <ji...@apache.org> on 2023/08/16 05:28:00 UTC
[jira] [Created] (KAFKA-15352) Ensure consistency while deleting the remote log segments
Kamal Chandraprakash created KAFKA-15352:
--------------------------------------------
Summary: Ensure consistency while deleting the remote log segments
Key: KAFKA-15352
URL: https://issues.apache.org/jira/browse/KAFKA-15352
Project: Kafka
Issue Type: Task
Reporter: Kamal Chandraprakash
In Kafka-14888, the remote log segments are deleted which breaches the retention time/size before updating the log-start-offset. In middle of deletion, if the consumer starts to read from the beginning of the topic, then it will fail to read the messages and UNKNOWN_SERVER_ERROR will be thrown back to the consumer.
To ensure consistency, similar to local log segments where the actual segments are deleted after {{segment.delete.delay.ms}}, we should update the log-start-offset first before deleting the remote log segment.
See the [PR#13561|https://github.com/apache/kafka/pull/13561] and [comment|https://github.com/apache/kafka/pull/13561#discussion_r1293086543] for more details.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)