You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by GitBox <gi...@apache.org> on 2022/06/07 03:14:47 UTC
[GitHub] [incubator-inlong-website] yunqingmoswu opened a new pull request, #394: [INLONG-393][Sort] Add usage document for MySQL Extract Node, Elasticsearch Load Node
yunqingmoswu opened a new pull request, #394:
URL: https://github.com/apache/incubator-inlong-website/pull/394
Fixes #393
### Motivation
Add usage document for MySQL Extract Node, Elasticsearch Load Node
### Modifications
The usage document for MySQL Extract Node, Elasticsearch Load Node will be added.
### Verifying this change
- [x] Make sure that the change passes the CI checks.
*(Please pick either of the following options)*
This change is a trivial rework / code cleanup without any test coverage.
*(or)*
This change is already covered by existing tests, such as *(please describe tests)*.
*(or)*
This change added tests and can be verified as follows:
*(example:)*
- *Added integration tests for end-to-end deployment with large payloads (10MB)*
- *Extended integration test for recovery after broker failure*
### Documentation
- Does this pull request introduce a new feature? (yes / no)
- If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)
- If a feature is not applicable for documentation, explain why?
- If a feature is not documented yet in this PR, please create a followup issue for adding the documentation
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong-website] dockerzhang merged pull request #394: [INLONG-393][Sort] Add usage document for MySQL Extract Node, Elasticsearch Load Node
Posted by GitBox <gi...@apache.org>.
dockerzhang merged PR #394:
URL: https://github.com/apache/incubator-inlong-website/pull/394
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong-website] yunqingmoswu commented on a diff in pull request #394: [INLONG-393][Sort] Add usage document for MySQL Extract Node, Elasticsearch Load Node
Posted by GitBox <gi...@apache.org>.
yunqingmoswu commented on code in PR #394:
URL: https://github.com/apache/incubator-inlong-website/pull/394#discussion_r891976954
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mysql-cdc.md:
##########
@@ -0,0 +1,605 @@
+---
+title: MySQL
+sidebar_position: 5
+---
+
+## MySQL Extract Node
+
+MySQL Extract 节点允许从 MySQL 数据库中读取快照数据和增量数据。本文档介绍如何设置 MySQL Extract 节点以对 MySQL 数据库运行 SQL 查询。
+
+## 支持的版本
+
+| Extract 节点 | 版本 | Driver |
+|-----------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------|
+| [mysql-cdc](./mysql-cdc.md) | [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x <br/> [RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x <br/> [PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x <br/> [Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x <br/> [MariaDB](https://mariadb.org): 10.x <br/> [PolarDB X](https://github.com/ApsaraDB/galaxysql): 2.0.1 | JDBC Driver: 8.0.21 |
+
+## 依赖
+
+为了设置 MySQL Extract 节点，下表提供了使用构建自动化工具（例如 Maven 或 SBT）和带有 Sort Connectors JAR 包的 SQL 客户端的两个项目的依赖关系信息。
+
+### Maven 依赖
+
+```
+<dependency>
+ <groupId>org.apache.inlong</groupId>
+ <artifactId>sort-connector-mysql-cdc</artifactId>
+ <!-- 选择适合你的 Application 的版本 -->
+ <version>inlong_version</version>
+</dependency>
+```
+
+连接 MySQL 数据库还需要 MySQL 驱动程序依赖项。请下载[mysql-connector-java-8.0.21.jar](https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.21/mysql-connector-java-8.0.21. jar) 并将其放入`FLINK_HOME/lib/`。
Review Comment:
thanks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong-website] healchow commented on a diff in pull request #394: [INLONG-393][Sort] Add usage document for MySQL Extract Node, Elasticsearch Load Node
Posted by GitBox <gi...@apache.org>.
healchow commented on code in PR #394:
URL: https://github.com/apache/incubator-inlong-website/pull/394#discussion_r891901064
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mysql-cdc.md:
##########
@@ -0,0 +1,605 @@
+---
+title: MySQL
+sidebar_position: 5
+---
+
+## MySQL Extract Node
+
+MySQL Extract 节点允许从 MySQL 数据库中读取快照数据和增量数据。本文档介绍如何设置 MySQL Extract 节点以对 MySQL 数据库运行 SQL 查询。
+
+## 支持的版本
+
+| Extract 节点 | 版本 | Driver |
+|-----------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------|
+| [mysql-cdc](./mysql-cdc.md) | [MySQL](https://dev.mysql.com/doc): 5.6, 5.7, 8.0.x <br/> [RDS MySQL](https://www.aliyun.com/product/rds/mysql): 5.6, 5.7, 8.0.x <br/> [PolarDB MySQL](https://www.aliyun.com/product/polardb): 5.6, 5.7, 8.0.x <br/> [Aurora MySQL](https://aws.amazon.com/cn/rds/aurora): 5.6, 5.7, 8.0.x <br/> [MariaDB](https://mariadb.org): 10.x <br/> [PolarDB X](https://github.com/ApsaraDB/galaxysql): 2.0.1 | JDBC Driver: 8.0.21 |
+
+## 依赖
+
+为了设置 MySQL Extract 节点，下表提供了使用构建自动化工具（例如 Maven 或 SBT）和带有 Sort Connectors JAR 包的 SQL 客户端的两个项目的依赖关系信息。
+
+### Maven 依赖
+
+```
+<dependency>
+ <groupId>org.apache.inlong</groupId>
+ <artifactId>sort-connector-mysql-cdc</artifactId>
+ <!-- 选择适合你的 Application 的版本 -->
+ <version>inlong_version</version>
+</dependency>
+```
+
+连接 MySQL 数据库还需要 MySQL 驱动程序依赖项。请下载[mysql-connector-java-8.0.21.jar](https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.21/mysql-connector-java-8.0.21. jar) 并将其放入`FLINK_HOME/lib/`。
Review Comment:
The download path was incorrect, there is an extra space.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong-website] yunqingmoswu commented on a diff in pull request #394: [INLONG-393][Sort] Add usage document for MySQL Extract Node, Elasticsearch Load Node
Posted by GitBox <gi...@apache.org>.
yunqingmoswu commented on code in PR #394:
URL: https://github.com/apache/incubator-inlong-website/pull/394#discussion_r893024871
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/elasticsearch.md:
##########
@@ -0,0 +1,352 @@
+---
+title: Elasticsearch
+sidebar_position: 8
+---
+
+## Elasticsearch Load 节点
+
+Elasticsearch Load 节点允许将数据写入到 Elasticsearch 引擎的索引中。本文档描述运行 SQL 查询时如何设置 Elasticsearch Load 节点。
+
+连接器可以工作在 Upsert 模式，使用 DDL 中定义的主键与外部系统交换 UPDATE/DELETE 消息。
+
+如果 DDL 中没有定义主键，那么连接器只能工作在 Append 模式，只能与外部系统交换 INSERT 消息。
+
+## 支持的版本
+
+| Load 节点 | 版本 |
+|-------------------------------------|----------------------------------------------------|
+| [elasticsearch](./elasticsearch.md) | [ElasticSearch](https://www.elastic.co/): 6.x, 7.x |
Review Comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-inlong-website] healchow commented on a diff in pull request #394: [INLONG-393][Sort] Add usage document for MySQL Extract Node, Elasticsearch Load Node
Posted by GitBox <gi...@apache.org>.
healchow commented on code in PR #394:
URL: https://github.com/apache/incubator-inlong-website/pull/394#discussion_r893017997
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/load_node/elasticsearch.md:
##########
@@ -0,0 +1,352 @@
+---
+title: Elasticsearch
+sidebar_position: 8
+---
+
+## Elasticsearch Load 节点
+
+Elasticsearch Load 节点允许将数据写入到 Elasticsearch 引擎的索引中。本文档描述运行 SQL 查询时如何设置 Elasticsearch Load 节点。
+
+连接器可以工作在 Upsert 模式，使用 DDL 中定义的主键与外部系统交换 UPDATE/DELETE 消息。
+
+如果 DDL 中没有定义主键，那么连接器只能工作在 Append 模式，只能与外部系统交换 INSERT 消息。
+
+## 支持的版本
+
+| Load 节点 | 版本 |
+|-------------------------------------|----------------------------------------------------|
+| [elasticsearch](./elasticsearch.md) | [ElasticSearch](https://www.elastic.co/): 6.x, 7.x |
Review Comment:
The `ElasticSearch` should be `Elasticsearch`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org