[jira] [Created] (KAFKA-10674) Brokers should know the active controller ApiVersion after enabling KIP-590 forwarding

["Boyang Chen (Jira)" <ji...@apache.org>]

Boyang Chen created KAFKA-10674:
-----------------------------------

             Summary: Brokers should know the active controller ApiVersion after enabling KIP-590 forwarding
                 Key: KAFKA-10674
                 URL: https://issues.apache.org/jira/browse/KAFKA-10674
             Project: Kafka
          Issue Type: Improvement
          Components: clients, core
            Reporter: Boyang Chen


Admin clients send ApiVersions to the broker upon the first connection establishes. The tricky thing after forwarding is enabled is that for forwardable APIs, admin client needs to know a commonly-agreed rang of ApiVersions among handling broker, active controller and itself.

Right now the inter-broker APIs are guaranteed by IBP constraints, but not for forwardable APIs. A compromised solution would be to put all forwardable APIs under IBP, which is brittle and hard to maintain consistency.

Instead, any broker connecting to the active controller should send an ApiVersion request from beginning, so it is easy to compute that information and send back to the admin clients upon ApiVersion request from admin.  Any rolling of the active controller will trigger reconnection between broker and controller, which guarantees a refreshed ApiVersions between the two. This approach avoids the tight bond with IBP and broker could just close the connection between admin client to trigger retry logic and refreshing of the ApiVersions. Since this failure should be rare, two round-trips and timeout delays are well compensated by the less engineering work.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)