You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Dongjin Lee (Jira)" <ji...@apache.org> on 2020/10/08 14:36:00 UTC

[jira] [Commented] (KAFKA-10585) Kafka Streams should clean up the state store directory from cleanup

    [ https://issues.apache.org/jira/browse/KAFKA-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210251#comment-17210251 ] 

Dongjin Lee commented on KAFKA-10585:
-------------------------------------

I inspected this issue a little bit. You mean, all `\{state.dir}/\{application-id}/*` are deleted but `\{state.dir}/\{application-id}` itself does not deleted when cleanup, occupying filesystem resources.

Do I understand correctly?

> Kafka Streams should clean up the state store directory from cleanup
> --------------------------------------------------------------------
>
>                 Key: KAFKA-10585
>                 URL: https://issues.apache.org/jira/browse/KAFKA-10585
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>            Reporter: Rohan Desai
>            Priority: Major
>
> Currently, `KafkaStreams.cleanup` cleans up all the task-level directories and the global directory. However it doesn't clean up the enclosing state store directory, though streams does create this directory when it initializes the state for the streams app. Feels like it should remove this directory when it cleans up.
> We notice this in ksql quite often, since every new query is a new streams app. Over time, we see lots of state store directories left around for old queries.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)