You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "hitesh gollahalli bachanna (JIRA)" <ji...@apache.org> on 2018/12/12 22:37:00 UTC

[jira] [Updated] (KAFKA-7640) Kafka stream interactive query not returning data when state is backed by rocksdb

     [ https://issues.apache.org/jira/browse/KAFKA-7640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

hitesh gollahalli bachanna updated KAFKA-7640:
----------------------------------------------
    Attachment: intital_data_host.jpeg
                rest_api_call_host.jpeg
                rest_redirect_host.jpeg

> Kafka stream interactive query not returning data when state is backed by rocksdb
> ---------------------------------------------------------------------------------
>
>                 Key: KAFKA-7640
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7640
>             Project: Kafka
>          Issue Type: Bug
>          Components: streams
>    Affects Versions: 2.0.0
>            Reporter: hitesh gollahalli bachanna
>            Priority: Major
>         Attachments: intital_data_host.jpeg, rest_api_call_host.jpeg, rest_redirect_host.jpeg
>
>
> I have a kafka stream app running with 36 different instance (one for each partition). Each instance come up one after the other. And I am building rest service on top of the state to access the data.
> Here some code that I use:
> {code:java}
> StreamsMetadata metadata = streams.metadataForKey(store, key, serializer); --> call this find ouy which host has the key
> if (localSelf.host().equals(hostStoreInfo.getHost())) {
> get the key from local store
> }
> else {
> call the remote host using restTemplate
> }{code}
> The problem now is `metadata` object returned has a different host/ip but the data is on a different node. I was able to see using some application logs I printed. This happens every time I start my application.
> The `allMetadata` method in `KafkaStreams` class says the value will be update as when the partition get reassigned. But its not happening in this case. 
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)