You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Kamal Chandraprakash (Jira)" <ji...@apache.org> on 2023/10/21 09:09:00 UTC

[jira] [Commented] (KAFKA-15660) File-based Tiered Storage should delete folders upon topic deletion

    [ https://issues.apache.org/jira/browse/KAFKA-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17778040#comment-17778040 ] 

Kamal Chandraprakash commented on KAFKA-15660:
----------------------------------------------

In RemoteStorageManager, we don't have an API to differentiate between deleting remote log segments due to breach by retention (or) by deletion. So, the folder will be left out while deleting the topic in the LocalTieredStorage implementation.

> File-based Tiered Storage should delete folders upon topic deletion
> -------------------------------------------------------------------
>
>                 Key: KAFKA-15660
>                 URL: https://issues.apache.org/jira/browse/KAFKA-15660
>             Project: Kafka
>          Issue Type: Bug
>    Affects Versions: 3.6.0
>            Reporter: Christo Lolov
>            Priority: Minor
>
> We have added a quick-start guide for Tiered Storage as part of Apache Kafka 3.6 - [https://kafka.apache.org/documentation/#tiered_storage_config_ex.]
> When interacting with it, however, it appears that when topics are deleted while remote segments and their indecies are deleted the folders are not:
> {code:java}
> > ls /tmp/kafka-remote-storage/kafka-tiered-storage 
> A-0-ApBdPOE1SOOw-Ie8RQLuAA  B-0-2omLZKw1Tiu2-EUKsIzj9Q  C-0-FXdccGWXQJCj-RQynsOK3Q  D-0-vqfdYtYLSlWEyXp6cwwmpg
> > ls /tmp/kafka-remote-storage/kafka-tiered-storage/A-0-ApBdPOE1SOOw-Ie8RQLuAA
> > bin/kafka-topics.sh --bootstrap-server localhost:9092 --list
> __remote_log_metadata{code}
> I think that the file-based implementation shipping with Kafka should delete the folders as well.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)