You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kafka.apache.org by "Levani Kokhreidze (Jira)" <ji...@apache.org> on 2020/11/05 13:32:00 UTC

[jira] [Created] (KAFKA-10686) Pluggable standby tasks assignor for Kafka Streams

Levani Kokhreidze created KAFKA-10686:
-----------------------------------------

             Summary: Pluggable standby tasks assignor for Kafka Streams
                 Key: KAFKA-10686
                 URL: https://issues.apache.org/jira/browse/KAFKA-10686
             Project: Kafka
          Issue Type: Improvement
          Components: streams
            Reporter: Levani Kokhreidze


In production, Kafka Streams instances often run across different clusters and availability zones. In order to guarantee high availability of the Kafka Streams deployments, users would need more granular control over which on instances standby tasks can be created. 

Idea of this ticket is to expose interface for Kafka Streams which can be implemented by users to control where standby tasks can be created.

Kafka Streams can have RackAware assignment as a default implementation that will take into account `rack.id` of the application and make sure that standby tasks are created on different racks. 

Point of this ticket though is to more flexibility to users on standby task creation, in cases where just rack awareness is not enough. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)