You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Ferlin-Sutton Léo (JIRA)" <ji...@apache.org> on 2019/05/09 12:16:00 UTC

[jira] [Commented] (KAFKA-7362) enable kafka broker to remove orphan partitions automatically

    [ https://issues.apache.org/jira/browse/KAFKA-7362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16836320#comment-16836320 ] 

Ferlin-Sutton Léo commented on KAFKA-7362:
------------------------------------------

I can see the implementation is being worked on and discussed.

In the meantime is there a recommended way to manually delete an orphan partition ? We were thinking of :
 # Stopping the Kafka process on the concerned broker
 # `rm -rf` the directory containing the orphaned partition
 # Turning the kafka broker back on

> enable kafka broker to remove orphan partitions automatically 
> --------------------------------------------------------------
>
>                 Key: KAFKA-7362
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7362
>             Project: Kafka
>          Issue Type: Improvement
>          Components: core, log
>            Reporter: xiongqi wu
>            Assignee: xiongqi wu
>            Priority: Major
>
> When partition reassignment removes topic partitions from a offline broker, those removed partitions become orphan partitions to the broker. When the offline broker comes back online, it is not able to clean up both data and folders that belong to orphan partitions.  Log manager will scan all all dirs during startup, but the time based retention policy on a topic partition will not be kicked out until the broker is either a follower or a leader of the partition.  In addition, we do not have logic to delete folders that belong to orphan partition today. 
> Open this ticket to provide a mechanism (when enabled) to safely remove orphan partitions automatically.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)