[GitHub] [inlong] jun0315 commented on issue #4976: [Feature][Manager] Support Kafka

[GitBox <gi...@apache.org>]

jun0315 commented on issue #4976:
URL: https://github.com/apache/inlong/issues/4976#issuecomment-1205346584

   # Motivation
   
   Manage module supports Apache Kafka. Apache Kafka is an open-source distributed event streaming platform . We should support Apache Kafka in manage module.
   
   # Design
   
   The design will follow following the document  Manager Plugin
   
   The main modules of Kafka include topic and partition.
   
   <img width="451" alt="image" src="https://user-images.githubusercontent.com/44310040/182873098-c16b61a9-e532-4d3c-b6f3-66fe3bec9ed1.png">
   
   The mapping relationship between inlong and Kafka is: Kafka's topic is group+stream, and the specific rule is: `topic=group_ with_ stream`, where `with` is the separator. The rules can be configured and perceived by users.
   
   # Modification
   
   Creating new file called kafka `inlong-manager/manager-pojo/src/main/java/org/apache/inlong/manager/pojo/group`, Adding new classes into the file:
   
   ```InlongKafkaInfo.java```
   
   ```InlongKafkaDTO.java```
   
   ```InlongKafkaRequest.java```
   
   Creating new file called kafka `inlong-manager/manager-service/src/main/java/org/apache/inlong/manager/service/resource/queue`, Adding new classes into the file:
   
   ```KafkaOperator.java```
   
   ```KafkaResourceOperator.java```
   
   ```KafkaUtils.java```
   
   # Manager plugin
   
   Follow the document Manager Plugin.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org