[jira] [Resolved] (KAFKA-17995) Large value for `retention.ms` could prevent remote data cleanup in Tiered Storage

["Divij Vaidya (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KAFKA-17995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Divij Vaidya resolved KAFKA-17995.
----------------------------------
      Reviewer: Divij Vaidya
    Resolution: Fixed

> Large value for `retention.ms` could prevent remote data cleanup in Tiered Storage
> ----------------------------------------------------------------------------------
>
>                 Key: KAFKA-17995
>                 URL: https://issues.apache.org/jira/browse/KAFKA-17995
>             Project: Kafka
>          Issue Type: Bug
>          Components: Tiered-Storage
>    Affects Versions: 3.8.1
>            Reporter: Divij Vaidya
>            Assignee: PoAn Yang
>            Priority: Major
>              Labels: newbie
>             Fix For: 4.0.0, 3.9.1
>
>
> If a user has configured value of "retention.ms" to a value > current unix timestamp epoch, then at this line of code [1] , cleanupUntilMs becomes negative. This is because cleanupUntilMs is calculated as (current unix epoch ms - retention.ms) [1]. 
> This leads to cleaner failures at [https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L2218] and hence, all cleaning for that topic partition stops.
> [1] [https://github.com/apache/kafka/blob/5a5239770ff3565233e5cbecf11446e76339f8fe/core/src/main/java/kafka/log/remote/RemoteLogManager.java#L1397] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)