You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by "baomingyu (via GitHub)" <gi...@apache.org> on 2024/09/29 01:32:34 UTC
[PR] [InLong-1012][Doc] Add InLong sort format usage and extend doc [inlong-website]
baomingyu opened a new pull request, #1013:
URL: https://github.com/apache/inlong-website/pull/1013
Fixes #1012
Add InLong sort format usage and extend doc
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [InLong-1012][Doc] Add InLong sort format usage and extend doc [inlong-website]
Posted by "aloyszhang (via GitHub)" <gi...@apache.org>.
aloyszhang commented on code in PR #1013:
URL: https://github.com/apache/inlong-website/pull/1013#discussion_r1779889199
##########
docs/development/extension_sort/inlong_sort_data_organization_and_binary_protocol.md:
##########
@@ -0,0 +1,71 @@
+---
+title: InLong sort format extend
+sidebar_position: 5
+---
+## Overview
+
+This article is aimed at InLong-Sort-Formats data format parsing developers and aims to comprehensively explain the process of developing data parsing for a data format.
+
+The InLong-Sort-Formats module supports two major types of data format parsing, implemented based on the Flink Row and Flink RowData types. These two implementations differ only in the Flink API used. This article will describe the implementation based on the Flink RowData.
+
+Currently, InLong-Sort supports the following formats, including 6 formats encapsulated in the InLongMsg format and 3 original data formats:
+- InLongMsg binlog
+- InLongMSg CSV
+- InLongMsg KV
+- InLongMsg Tlog-CSV
+- InLongMsg Tlog-KV
+- InLongMsg PB
+- CSV
+- KV
+- JSON
+By implementing the data parsing process for these formats, developers can effectively handle and process data in the InLong-Sort module.
+
+## Before Development
+
+- InLongMsg refer to [InLongMsg](img/inlong_msg.md);
Review Comment:
broken link
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [InLong-1012][Doc] Add InLong sort format usage and extend doc [inlong-website]
Posted by "aloyszhang (via GitHub)" <gi...@apache.org>.
aloyszhang commented on code in PR #1013:
URL: https://github.com/apache/inlong-website/pull/1013#discussion_r1779886340
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/development/extension_sort/inlong_sort_data_organization_and_binary_protocol.md:
##########
@@ -0,0 +1,61 @@
+---
+title: InLong 分拣数据组织及协议解析
+sidebar_position: 5
+---
+## 总览
+
+本文面向 InLong-Sort-Formats 数据分拣开发人员, 尝试尽可能全面地阐述开发一个数据格式的数据解析过程。
+InLong-Sort-Formats 模块支持两大类的数据格式解析，分别基于 Flink Row 和 Flink RowData 类型实现，这两类实现仅仅是，使用的 Flink API 不同，本文基于 Flink RowData 方式的实现进行描述。
+目前，InLong-Sort 支持如下几种格式(通过 InLongMsg 格式封装的 6 种，原始的数据格式 3 种):
+- InLongMsg binlog
+- InLongMSg CSV
+- InLongMsg KV
+- InLongMsg Tlog-CSV
+- InLongMsg Tlog-KV
+- InLongMsg PB
+- CSV
+- KV
+- JSON
+
+## 开发之前
+
+- InLongMsg 格式介绍参照 [InLongMsg](img/inlong_msg.md)；
Review Comment:
broken link
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org