You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "hitesh gollahalli bachanna (JIRA)" <ji...@apache.org> on 2018/12/12 22:37:00 UTC
[jira] [Updated] (KAFKA-7640) Kafka stream interactive query not
returning data when state is backed by rocksdb
[ https://issues.apache.org/jira/browse/KAFKA-7640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
hitesh gollahalli bachanna updated KAFKA-7640:
----------------------------------------------
Attachment: intital_data_host.jpeg
rest_api_call_host.jpeg
rest_redirect_host.jpeg
> Kafka stream interactive query not returning data when state is backed by rocksdb
> ---------------------------------------------------------------------------------
>
> Key: KAFKA-7640
> URL: https://issues.apache.org/jira/browse/KAFKA-7640
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Affects Versions: 2.0.0
> Reporter: hitesh gollahalli bachanna
> Priority: Major
> Attachments: intital_data_host.jpeg, rest_api_call_host.jpeg, rest_redirect_host.jpeg
>
>
> I have a kafka stream app running with 36 different instance (one for each partition). Each instance come up one after the other. And I am building rest service on top of the state to access the data.
> Here some code that I use:
> {code:java}
> StreamsMetadata metadata = streams.metadataForKey(store, key, serializer); --> call this find ouy which host has the key
> if (localSelf.host().equals(hostStoreInfo.getHost())) {
> get the key from local store
> }
> else {
> call the remote host using restTemplate
> }{code}
> The problem now is `metadata` object returned has a different host/ip but the data is on a different node. I was able to see using some application logs I printed. This happens every time I start my application.
> The `allMetadata` method in `KafkaStreams` class says the value will be update as when the partition get reassigned. But its not happening in this case.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)