[jira] [Created] (KAFKA-17793) Improve kcontroller robustness against long delays

["Colin McCabe (Jira)" <ji...@apache.org>]

Colin McCabe created KAFKA-17793:
------------------------------------

             Summary: Improve kcontroller robustness against long delays
                 Key: KAFKA-17793
                 URL: https://issues.apache.org/jira/browse/KAFKA-17793
             Project: Kafka
          Issue Type: Bug
            Reporter: Colin McCabe
            Assignee: Colin McCabe


As described in KIP-500, the Kafka controller monitors the liveness of each broker in the cluster. It gathers this information from heartbeats sent from the brokers themselves.

In some rare cases, the main controller thread may get blocked for several seconds at a time. In the current code, this will result in the controller being unable to update the last contact times for the brokers during this time.

This PR changes the controller heartbeat handling to be partially lockless. Specifically, the last contact time for each broker will be updated locklessly prior to the rest of the heartbeat handling. This will ensure that heartbeats always get through.

Additionally, this PR adds a PeriodicTaskControlManager to better manage periodic tasks. This should help handle the very common pattern where we want to schedule a background task at some frequency. We also want the background task to be immediately rescheduled if there is too much work to be done in one event.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)