[jira] [Created] (KAFKA-7609) Add Protocol Generator for Kafka

["Colin P. McCabe (JIRA)" <ji...@apache.org>]

Colin P. McCabe created KAFKA-7609:
--------------------------------------

             Summary: Add Protocol Generator for Kafka
                 Key: KAFKA-7609
                 URL: https://issues.apache.org/jira/browse/KAFKA-7609
             Project: Kafka
          Issue Type: Improvement
            Reporter: Colin P. McCabe
            Assignee: Colin P. McCabe


Rather than hand-writing the code for sending and receiving all the different versions of the Kafka RPC protocol, we should have a protocol generator which can generate this code from an interface definition language (IDL).

This will make it less labor-intensive and error-prone to add new message types and versions.  It will also make it easier to support these new RPC changes in clients such as librdkafka.

Eventually, we should be able to get rid of the Struct classes and serialize messages directly to byte buffers.  This will greatly reduce the garbage collection overhead of the network stack, especially when handling large messages.

Furthermore, having a formal definition for the Kafka protocol may eventually allow us to expose other transports such as REST without writing lots of glue code to translate back and forth.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)