You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Matthias J. Sax (Jira)" <ji...@apache.org> on 2026/07/21 22:00:00 UTC
[jira] [Updated] (KAFKA-20665) Add warmup task support to reconciler
[ https://issues.apache.org/jira/browse/KAFKA-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matthias J. Sax updated KAFKA-20665:
------------------------------------
Description:
In the "classic" protocol, the HA assignor first computes a "final target" assignment, and second refines it with an incremental "intermediate target" assignment, keeping currently assigned tasks on their previous owner, and only assigning (some) warmup tasks to prepare the actually migration.
With KIP-1071, we can use the reconciler though to take care of warmup tasks (if configures). Ie, an assignor just compute the "final target" assignment, and the reconciler applies it, using warmup tasks (if enabled).
This setup not only make the actual assignor simpler, but also decouples warmup tasks from the assignor, and thus any assignor can benefit from warmup tasks.
was:
In the "classic" protocol, the HA assignor first computes a "final target" assignment, and second refines it with an incremental "intermediate target" assignment, keeping currently assigned tasks on their previous owner, and only assigning (some) warmup tasks to prepare the actually migration.
With KIP-1071, we can use the reconciler though to take care of warmup tasks (if configures). Ie, an assignor just compute the "final target" assignment, and the reconciler applies it, using warmup tasks (if enabled).
This setup not only make the actual assignor simpler, but also decouples warmup tasks from the assignor, and thus any assignor can not benefit from warmup tasks.
> Add warmup task support to reconciler
> --------------------------------------
>
> Key: KAFKA-20665
> URL: https://issues.apache.org/jira/browse/KAFKA-20665
> Project: Kafka
> Issue Type: Sub-task
> Components: group-coordinator, streams
> Reporter: Matthias J. Sax
> Assignee: Matthias J. Sax
> Priority: Major
>
> In the "classic" protocol, the HA assignor first computes a "final target" assignment, and second refines it with an incremental "intermediate target" assignment, keeping currently assigned tasks on their previous owner, and only assigning (some) warmup tasks to prepare the actually migration.
> With KIP-1071, we can use the reconciler though to take care of warmup tasks (if configures). Ie, an assignor just compute the "final target" assignment, and the reconciler applies it, using warmup tasks (if enabled).
> This setup not only make the actual assignor simpler, but also decouples warmup tasks from the assignor, and thus any assignor can benefit from warmup tasks.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)