You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Guozhang Wang (JIRA)" <ji...@apache.org> on 2016/12/14 20:59:58 UTC
[jira] [Commented] (KAFKA-4540) Suspended tasks that are not
assigned to the StreamThread need to be closed before new active and
standby tasks are created
[ https://issues.apache.org/jira/browse/KAFKA-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15749465#comment-15749465 ]
Guozhang Wang commented on KAFKA-4540:
--------------------------------------
Is this already resolved as part of https://issues.apache.org/jira/browse/KAFKA-4509? In the patch we reorder the operations to first close all the suspended tasks and then try to create new tasks.
> Suspended tasks that are not assigned to the StreamThread need to be closed before new active and standby tasks are created
> ---------------------------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-4540
> URL: https://issues.apache.org/jira/browse/KAFKA-4540
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 0.10.2.0
> Reporter: Damian Guy
> Assignee: Damian Guy
> Fix For: 0.10.2.0
>
>
> When partition assignment happens we first try and add the active tasks and then add the standby tasks. The problem with this is that a new active task might already be an existing suspended standby task. if this is the case then when the active task initialises it will throw an exception from RocksDB:
> {{Caused by: org.rocksdb.RocksDBException: IO error: lock /tmp/kafka-streams-7071/kafka-music-charts/1_1/rocksdb/all-songs/LOCK: No locks available}}
> We need to make sure we have removed an closed any no-longer assigned Suspended tasks before creating new tasks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)