You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Luke Chen (Jira)" <ji...@apache.org> on 2022/03/05 08:13:00 UTC
[jira] [Resolved] (KAFKA-12959) Prioritize assigning standby tasks to threads without any active tasks
[ https://issues.apache.org/jira/browse/KAFKA-12959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luke Chen resolved KAFKA-12959.
-------------------------------
Fix Version/s: 3.2.0
Resolution: Fixed
> Prioritize assigning standby tasks to threads without any active tasks
> ----------------------------------------------------------------------
>
> Key: KAFKA-12959
> URL: https://issues.apache.org/jira/browse/KAFKA-12959
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Affects Versions: 2.8.0
> Reporter: Ravi Bhardwaj
> Priority: Major
> Fix For: 3.2.0
>
> Attachments: app1.log, app2.log
>
>
> Currently while distributing the standby tasks streams does not check if there are threads without any tasks or with less number of tasks. This can lead to few threads getting assigned both active and standby tasks when are threads within the same instance without any tasks assigned.
> Example:
> {code:java}
> App 1:
> [wordcount-lambda-example-client-StreamThread-1] Handle new assignment with:
> New active tasks: [0_1]
> New standby tasks: [1_0]
> Existing active tasks: []
> Existing standby tasks: [1_0]
> [wordcount-lambda-example-client-StreamThread-2] Handle new assignment with:
> New active tasks: [1_1]
> New standby tasks: []
> Existing active tasks: [1_1]
> Existing standby tasks: []
> [wordcount-lambda-example-client-StreamThread-3] Handle new assignment with:
> New active tasks: []
> New standby tasks: []
> Existing active tasks: []
> Existing standby tasks: []
> [wordcount-lambda-example-client-StreamThread-4] Handle new assignment with:
> New active tasks: []
> New standby tasks: []
> Existing active tasks: []
> Existing standby tasks: []
> {code}
>
> {code:java}
> App2:
> [wordcount-lambda-example-client-StreamThread-1] Handle new assignment with:
> New active tasks: [1_0]
> New standby tasks: [1_1]
> Existing active tasks: []
> Existing standby tasks: [1_0, 1_1]
> [wordcount-lambda-example-client-StreamThread-2] Handle new assignment with:
> New active tasks: [0_0]
> New standby tasks: []
> Existing active tasks: []
> Existing standby tasks: []
> [wordcount-lambda-example-client-StreamThread-3] Handle new assignment with:
> New active tasks: []
> New standby tasks: []
> Existing active tasks: []
> Existing standby tasks: []
> [wordcount-lambda-example-client-StreamThread-4] Handle new assignment with:
> New active tasks: []
> New standby tasks: []
> Existing active tasks: []
> Existing standby tasks: []
> {code}
> The standby tasks in both apps is assigned to Thread-1 even though it has an active tasks when Thread-3 and Thread-4 didn't have any tasks assigned.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)