[jira] [Created] (KAFKA-20999) Add rack-aware standby task assignment

["Matthias J. Sax (Jira)" <ji...@apache.org>]

Matthias J. Sax created KAFKA-20999:
---------------------------------------

             Summary: Add rack-aware standby task assignment
                 Key: KAFKA-20999
                 URL: https://issues.apache.org/jira/browse/KAFKA-20999
             Project: Kafka
          Issue Type: Sub-task
          Components: group-coordinator, streams
            Reporter: Matthias J. Sax


In the "classic" protocol, there is "sticky" and "ha_assignor" options, and KIP-1071 defines both assignor options, too. The "sticky" assignor is already available, while the "ha_assignor" is missing.

However, KIP-1071 introduced a different architecture and the class HA-assignor features are not delivered in the same way, instead, "warmup tasks" are injected via a new refiner step, and the HA-assignor does not need to concern itself with it.

The HA-assignor also computes a different assignment compare to "sticky", which we are tracking via it's own sub-task.

This ticket is about adding rack-aware standby task assignment, to make KIP-1017 feature complete with the classic HA-assignor (note, that the classic sticky assignor does not implement rack-aware standby task assignment). To this end, we want to not only close this "ha" feature gap, but implement rack-aware standby task assignment for both "sticky" and "balance" assignor.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)