You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Navinder Brar (JIRA)" <ji...@apache.org> on 2018/05/21 05:48:00 UTC

[jira] [Updated] (KAFKA-6924) Making state store queryable on replicas

     [ https://issues.apache.org/jira/browse/KAFKA-6924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Navinder Brar updated KAFKA-6924:
---------------------------------
    Description: 
State store in Kafka streams are currently only queryable when StreamTask is in RUNNING state. The idea is to make it queryable even for StandbyTasks to decrease the downtime if client is not able to fetch data from Active machine.

Suppose the coordinator is not able to connect to machine which had active partition due to some reason. So, rather than failing that request we could serve request from replica which could be on some other machine. Although state on replica might be little behind the active but it could still be beneficial in some cases to serve request from replica than failing the request.

It's very important improvement as it could simply improve the availability of microservices developed using kafka streams.

I am working on a patch for this change. Any feedback or comments are welcome.

Also, I have gone thorugh https://issues.apache.org/jira/browse/KAFKA-6031, has this been implemented?

  was:
State store in Kafka streams are currently only queryable when StreamTask is in RUNNING state. The idea is to make it queryable even for StandbyTasks to decrease the downtime if client is not able to fetch data from Active machine.

Suppose the coordinator is not able to connect to machine which had active partition due to some reason. So, rather than failing that request we could serve request from replica which could be on some other machine. Although state on replica might be little behind the active but it could still be beneficial in some cases to serve request from replica than failing the request.

It's very important improvement as it could simply improve the availability of microservices developed using kafka streams.

I am working on a patch for this change. Any feedback or comments are welcome.


> Making state store queryable on replicas
> ----------------------------------------
>
>                 Key: KAFKA-6924
>                 URL: https://issues.apache.org/jira/browse/KAFKA-6924
>             Project: Kafka
>          Issue Type: New Feature
>          Components: streams
>            Reporter: Navinder Brar
>            Priority: Major
>
> State store in Kafka streams are currently only queryable when StreamTask is in RUNNING state. The idea is to make it queryable even for StandbyTasks to decrease the downtime if client is not able to fetch data from Active machine.
> Suppose the coordinator is not able to connect to machine which had active partition due to some reason. So, rather than failing that request we could serve request from replica which could be on some other machine. Although state on replica might be little behind the active but it could still be beneficial in some cases to serve request from replica than failing the request.
> It's very important improvement as it could simply improve the availability of microservices developed using kafka streams.
> I am working on a patch for this change. Any feedback or comments are welcome.
> Also, I have gone thorugh https://issues.apache.org/jira/browse/KAFKA-6031, has this been implemented?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)