[jira] [Commented] (KAFKA-7609) Add Protocol Generator for Kafka

["ASF GitHub Bot (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/KAFKA-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680166#comment-16680166 ] 

ASF GitHub Bot commented on KAFKA-7609:
---------------------------------------

cmccabe opened a new pull request #5893: KAFKA-7609: Add Protocol Generator for Kafka
URL: https://github.com/apache/kafka/pull/5893
 
 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Add Protocol Generator for Kafka
> --------------------------------
>
>                 Key: KAFKA-7609
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7609
>             Project: Kafka
>          Issue Type: Improvement
>            Reporter: Colin P. McCabe
>            Assignee: Colin P. McCabe
>            Priority: Major
>
> Rather than hand-writing the code for sending and receiving all the different versions of the Kafka RPC protocol, we should have a protocol generator which can generate this code from an interface definition language (IDL).
> This will make it less labor-intensive and error-prone to add new message types and versions.  It will also make it easier to support these new RPC changes in clients such as librdkafka.
> Eventually, we should be able to get rid of the Struct classes and serialize messages directly to byte buffers.  This will greatly reduce the garbage collection overhead of the network stack, especially when handling large messages.
> Furthermore, having a formal definition for the Kafka protocol may eventually allow us to expose other transports such as REST without writing lots of glue code to translate back and forth.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)