You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/12/14 11:55:58 UTC
[jira] [Commented] (KAFKA-4537) StreamPartitionAssignor incorrectly
adds standby partitions to the partitionsByHostState map
[ https://issues.apache.org/jira/browse/KAFKA-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15748147#comment-15748147 ]
ASF GitHub Bot commented on KAFKA-4537:
---------------------------------------
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/2254
KAFKA-4537: StreamPartitionAssignor incorrectly adds standby partitions to the partitionsByHostState map
If a KafkaStreams app is using Standby Tasks then `StreamPartitionAssignor` will add the standby partitions to the partitionsByHostState map for each host. This is incorrect as the partitionHostState map is used to resolve which host is hosting a particular store for a key.
The result is that doing metadata lookups for interactive queries can return an incorrect host
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka KAFKA-4537
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/2254.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2254
----
commit a29f74642cecb1722bbd785d42c2b0782d01c9d3
Author: Damian Guy <da...@gmail.com>
Date: 2016-12-14T11:53:42Z
dont assign standby tasks to partitionsForHostState
----
> StreamPartitionAssignor incorrectly adds standby partitions to the partitionsByHostState map
> --------------------------------------------------------------------------------------------
>
> Key: KAFKA-4537
> URL: https://issues.apache.org/jira/browse/KAFKA-4537
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 0.10.2.0
> Reporter: Damian Guy
> Assignee: Damian Guy
> Fix For: 0.10.2.0
>
>
> If a KafkaStreams app is using Standby Tasks then StreamPartitionAssignor will add the standby partitions to the partitionsByHostState map for each host. This is incorrect as the partitionHostState map is used to resolve which host is hosting a particular store for a key.
> The result is that doing metadata lookups for interactive queries can return an incorrect host
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)