You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/12/13 18:13:58 UTC
[jira] [Commented] (KAFKA-4532) StateStores can be connected to the
wrong source topic resulting in incorrect metadata returned from IQ
[ https://issues.apache.org/jira/browse/KAFKA-4532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15745809#comment-15745809 ]
ASF GitHub Bot commented on KAFKA-4532:
---------------------------------------
GitHub user dguy opened a pull request:
https://github.com/apache/kafka/pull/2250
KAFKA-4532: StateStores can be connected to the wrong source topic resulting in incorrect metadata returned from Interactive Queries
When building a topology with tables and StateStores, the StateStores are mapped to the source topic names. This map is retrieved via TopologyBuilder.stateStoreNameToSourceTopics() and is used in Interactive Queries to find the source topics and partitions when resolving the partitions that particular keys will be in.
There is an issue where by this mapping for a table that is originally created with builder.table("topic", "table");, and then is subsequently used in a join, is changed to the join topic. This is because the mapping is updated during the call to topology.connectProcessorAndStateStores(..).
In the case that the stateStoreNameToSourceTopics Map already has a value for the state store name it should not update the Map.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dguy/kafka kafka-4532
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/kafka/pull/2250.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #2250
----
commit 45833be3ca1b6f8ac86f516cae4ff1b6571089e8
Author: Damian Guy <da...@gmail.com>
Date: 2016-12-13T18:06:38Z
state store name to topic mapping incorrect
----
> StateStores can be connected to the wrong source topic resulting in incorrect metadata returned from IQ
> -------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-4532
> URL: https://issues.apache.org/jira/browse/KAFKA-4532
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 0.10.1.0, 0.10.1.1, 0.10.2.0
> Reporter: Damian Guy
> Assignee: Damian Guy
> Fix For: 0.10.2.0
>
>
> When building a topology with tables and StateStores, the StateStores are mapped to the source topic names. This map is retrieved via {{TopologyBuilder.stateStoreNameToSourceTopics()}} and is used in Interactive Queries to find the source topics and partitions when resolving the partitions that particular keys will be in.
> There is an issue where by this mapping for a table that is originally created with {{builder.table("topic", "table");}}, and then is subsequently used in a join, is changed to the join topic. This is because the mapping is updated during the call to {{topology.connectProcessorAndStateStores(..)}}.
> In the case that the {{stateStoreNameToSourceTopics}} Map already has a value for the state store name it should not update the Map.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)