You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by GitBox <gi...@apache.org> on 2022/08/17 07:24:50 UTC
[GitHub] [inlong] Loveca opened a new pull request, #5582: [INLONG-5043][Manager] Add Apache Doris load node management
Loveca opened a new pull request, #5582:
URL: https://github.com/apache/inlong/pull/5582
### Prepare a Pull Request
- Fix [#5043 ](https://github.com/apache/inlong/issues/5043)
# Motivation
To surport the ability to Doris data integration, we need to add Apache Doris Load Node for management
# Design
The design mainly follows the document [Manager Plugin](https://inlong.apache.org/zh-CN/docs/design_and_concept/how_to_extend_data_node_for_manager)
1. Add corresponding SinkType enumeration in enumeration type org.apache.inlong.manager.common.Enums.
2. In org.apache.inlong.manager.common.Pojo.Sink,create folder path,create the corresponding entity class.
3. In the org.Apache.Inlong.Manager.Service.Sink path, created under the corresponding tools
4. Support data source to LoadNode conversion function, reference code org.Apache. Inlong.Manager.Service.Sort.Util.LoadNodeUtils
# Implementation
1. Add DORIS in enumeration type org.apache.inlong.manager.common.enums.SinkType
2. Create folder "Doris" in org.apache.inlong.manager.common.pojo.sink, and create corresponding entity class:
- DorisSink
- DorisSinkDTO
- DorisSinkRequest
- DorisColumnInfo
- DorisTableInfo
3. Create folder "doris" in org.apache.inlong.manager.service.sink and implement the class:
- DorisSinkOperator
4. Add createLoadNode function in org.apache.inlong.manager.service.sort.util.LoadNodeUtils, it is like as follows:
```
public static DorisLoadNode createLoadNode(DorisSink dorisSink, List<FieldInfo> fieldInfos,
List<FieldRelation> fieldRelations, Map<String, String> properties){
\\TODO
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] lucaspeng12138 commented on pull request #5582: [INLONG-5043][Manager] Add Apache Doris load node management
Posted by GitBox <gi...@apache.org>.
lucaspeng12138 commented on PR #5582:
URL: https://github.com/apache/inlong/pull/5582#issuecomment-1252037165
@dockerzhang @healchow I will resolve the rests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] dockerzhang commented on pull request #5582: [INLONG-5043][Manager] Add Apache Doris load node management
Posted by GitBox <gi...@apache.org>.
dockerzhang commented on PR #5582:
URL: https://github.com/apache/inlong/pull/5582#issuecomment-1254798807
this PR is finished by #5582, so close it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] dockerzhang closed pull request #5582: [INLONG-5043][Manager] Add Apache Doris load node management
Posted by GitBox <gi...@apache.org>.
dockerzhang closed pull request #5582: [INLONG-5043][Manager] Add Apache Doris load node management
URL: https://github.com/apache/inlong/pull/5582
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org