You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "PoAn Yang (Jira)" <ji...@apache.org> on 2024/11/12 16:03:00 UTC
[jira] [Commented] (KAFKA-17995) Large value for `retention.ms` could prevent remote data cleanup in Tiered Storage
[ https://issues.apache.org/jira/browse/KAFKA-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897625#comment-17897625 ]
PoAn Yang commented on KAFKA-17995:
-----------------------------------
Hi [~divijv], if you're not working on this, may I take it? Thank you.
> Large value for `retention.ms` could prevent remote data cleanup in Tiered Storage
> ----------------------------------------------------------------------------------
>
> Key: KAFKA-17995
> URL: https://issues.apache.org/jira/browse/KAFKA-17995
> Project: Kafka
> Issue Type: Bug
> Components: Tiered-Storage
> Affects Versions: 3.8.1
> Reporter: Divij Vaidya
> Priority: Major
> Labels: newbie
>
> If a user has configured value of "retention.ms" to a value > current unix timestamp epoch, then at this line of code [1] , cleanupUntilMs becomes negative. This is because cleanupUntilMs is calculated as (current unix epoch ms - retention.ms) [1].
> This leads to cleaner failures at [https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L2218] and hence, all cleaning for that topic partition stops.
> [1] [https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L1397]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)