You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by GitBox <gi...@apache.org> on 2022/09/07 07:30:24 UTC
[GitHub] [inlong-website] GanfengTan opened a new pull request, #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
GanfengTan opened a new pull request, #538:
URL: https://github.com/apache/inlong-website/pull/538
Add TubeMQ connector docs and update Agent docs.
- Fixes #537
### Motivation
No message
### Modifications
No message
### Verifying this change
- [x] Make sure that the change passes the CI checks.
*(Please pick either of the following options)*
This change is a trivial rework / code cleanup without any test coverage.
*(or)*
This change is already covered by existing tests, such as *(please describe tests)*.
*(or)*
This change added tests and can be verified as follows:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969117989
##########
docs/modules/agent/overview.md:
##########
@@ -25,6 +25,21 @@ User-configured path monitoring, able to monitor the created file information
Directory regular filtering, support YYYYMMDD+regular expression path configuration
Breakpoint retransmission, when InLong-Agent restarts, it can automatically re-read from the last read position to ensure no reread or missed reading.
+#### File options
+| Parameter | Required | Default value | Type | Description |
+| ----------------------------- | -------- | ------------- | ------ | ------------------------------------------------------------ |
+| pattern | required | (none) | String | File pattern. For example: /root/[*].log |
+| timeOffset | optional | (none) | String | File name includes time, for example: *** YYYYMMDDHH *** YYYY represents the year, MM represents the month, DD represents the day, and HH represents the hour, *** is any character. '1m' means one minute after, '-1m' means one minute before. '1h' means one hour after, '-1h' means one hour before. '1d' means one day after, '-1d' means one day before.|
Review Comment:
*** YYYYMMDDHH *** should be ` YYYYMMDDHH ` ？
##########
docs/modules/agent/overview.md:
##########
@@ -25,6 +25,21 @@ User-configured path monitoring, able to monitor the created file information
Directory regular filtering, support YYYYMMDD+regular expression path configuration
Breakpoint retransmission, when InLong-Agent restarts, it can automatically re-read from the last read position to ensure no reread or missed reading.
+#### File options
+| Parameter | Required | Default value | Type | Description |
+| ----------------------------- | -------- | ------------- | ------ | ------------------------------------------------------------ |
+| pattern | required | (none) | String | File pattern. For example: /root/[*].log |
+| timeOffset | optional | (none) | String | File name includes time, for example: *** YYYYMMDDHH *** YYYY represents the year, MM represents the month, DD represents the day, and HH represents the hour, *** is any character. '1m' means one minute after, '-1m' means one minute before. '1h' means one hour after, '-1h' means one hour before. '1d' means one day after, '-1d' means one day before.|
Review Comment:
Please correct the above format errors in the Chinese document in the same time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969114752
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
Review Comment:
what does it means?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969115316
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
+
+## Overview
+
+[Apache InLong TubeMQ](https://inlong.apache.org/docs/modules/tubemq/overview) is a distributed, open source pub-sub messaging and steaming platform for real-time workloads, trillions of massive data precipitation.
+
+## Version
+
+| Extract Node | Version |
+| --------------------- | ------------------------------------------------------------ |
+| [TubeMQ](./tube.md) | [TubeMQ](https://inlong.apache.org/docs/next/modules/tubemq/overview): >=0.1.0<br/> |
Review Comment:
Extra `:`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969115052
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
+
+## Overview
+
+[Apache InLong TubeMQ](https://inlong.apache.org/docs/modules/tubemq/overview) is a distributed, open source pub-sub messaging and steaming platform for real-time workloads, trillions of massive data precipitation.
+
+## Version
+
+| Extract Node | Version |
+| --------------------- | ------------------------------------------------------------ |
+| [TubeMQ](./tube.md) | [TubeMQ](https://inlong.apache.org/docs/next/modules/tubemq/overview): >=0.1.0<br/> |
+
+## Dependencies
+
+In order to set up the `TubeMQ Extract Node`, the following provides dependency information for both projects using a
+build automation tool (such as Maven or SBT) and SQL Client with Sort Connectors JAR bundles.
+
+### Maven dependency
+
+<pre><code parentName="pre">
+{`<dependency>
Review Comment:
wrong format
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969114631
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
Review Comment:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969114752
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
Review Comment:
what does it means?
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
Review Comment:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] dockerzhang commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
dockerzhang commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969299730
##########
docs/modules/sort/quick_start.md:
##########
@@ -14,7 +14,8 @@ Currently, InLong Sort relies on Flink-1.13.5. Chose `flink-1.13.5-bin-scala_2.1
- InLong Sort file, [Download](https://inlong.apache.org/download/) `apache-inlong-[version]-bin.tar.gz`
- Data Nodes Connectors, [Download](https://inlong.apache.org/download/) `apache-inlong-[version]-sort-connectors.tar.gz`
-Notice: Please put required Connectors jars into under `FLINK_HOME/lib/` after download.
+Notice: Please put required Connectors jars into under `FLINK_HOME/lib/` after download.
+Put mysql-connector-java:8.0.21 jar to `FLINK_HOME/lib/` when you use `mysql-cdc-inlong` connector.
Review Comment:
please use [mysql-connector-java-8.0.27.jar](https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.27/mysql-connector-java-8.0.27.jar) and add the link.
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/modules/sort/quick_start.md:
##########
@@ -12,7 +12,8 @@ sidebar_position: 2
- InLong Sort 运行文件，[下载](https://inlong.apache.org/zh-CN/download/) `apache-inlong-[version]-bin.tar.gz`
- 数据节点 Connectors，[下载](https://inlong.apache.org/zh-CN/download/) `apache-inlong-[version]-sort-connectors.tar.gz`
-注意：Connectors 下载后可以将需要的 jars 放到`FLINK_HOME/lib/`下。
+注意：Connectors 下载后可以将需要的 jars 放到`FLINK_HOME/lib/`下。
+如果使用`mysql-cdc-inlong` 连接器，请将 `mysql-connector-java:8.0.21` jar 包放到 `FLINK_HOME/lib/`下。
Review Comment:
ditto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969117480
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
+
+## Overview
+
+[Apache InLong TubeMQ](https://inlong.apache.org/docs/modules/tubemq/overview) is a distributed, open source pub-sub messaging and steaming platform for real-time workloads, trillions of massive data precipitation.
+
+## Version
+
+| Extract Node | Version |
+| --------------------- | ------------------------------------------------------------ |
+| [TubeMQ](./tube.md) | [TubeMQ](https://inlong.apache.org/docs/next/modules/tubemq/overview): >=0.1.0<br/> |
+
+## Dependencies
+
+In order to set up the `TubeMQ Extract Node`, the following provides dependency information for both projects using a
+build automation tool (such as Maven or SBT) and SQL Client with Sort Connectors JAR bundles.
+
+### Maven dependency
+
+<pre><code parentName="pre">
+{`<dependency>
Review Comment:
Please correct the above format errors in the Chinese document in the same time.
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
+
+## Overview
+
+[Apache InLong TubeMQ](https://inlong.apache.org/docs/modules/tubemq/overview) is a distributed, open source pub-sub messaging and steaming platform for real-time workloads, trillions of massive data precipitation.
+
+## Version
+
+| Extract Node | Version |
+| --------------------- | ------------------------------------------------------------ |
+| [TubeMQ](./tube.md) | [TubeMQ](https://inlong.apache.org/docs/next/modules/tubemq/overview): >=0.1.0<br/> |
Review Comment:
Please correct the above format errors in the Chinese document in the same time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] dockerzhang merged pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
dockerzhang merged PR #538:
URL: https://github.com/apache/inlong-website/pull/538
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] thesumery commented on a diff in pull request #538: [INLONG-537][Sort][Agent] Add TubeMQ connector docs and update Agent docs
Posted by GitBox <gi...@apache.org>.
thesumery commented on code in PR #538:
URL: https://github.com/apache/inlong-website/pull/538#discussion_r969117480
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
+
+## Overview
+
+[Apache InLong TubeMQ](https://inlong.apache.org/docs/modules/tubemq/overview) is a distributed, open source pub-sub messaging and steaming platform for real-time workloads, trillions of massive data precipitation.
+
+## Version
+
+| Extract Node | Version |
+| --------------------- | ------------------------------------------------------------ |
+| [TubeMQ](./tube.md) | [TubeMQ](https://inlong.apache.org/docs/next/modules/tubemq/overview): >=0.1.0<br/> |
+
+## Dependencies
+
+In order to set up the `TubeMQ Extract Node`, the following provides dependency information for both projects using a
+build automation tool (such as Maven or SBT) and SQL Client with Sort Connectors JAR bundles.
+
+### Maven dependency
+
+<pre><code parentName="pre">
+{`<dependency>
Review Comment:
Please correct the above format errors in the Chinese document in the same time.
##########
docs/data_node/extract_node/tube.md:
##########
@@ -0,0 +1,70 @@
+---
+title: TubeMQ
+sidebar_position: 11
+---
+
+import {siteVariables} from '../../version';
+
+## Overview
+
+[Apache InLong TubeMQ](https://inlong.apache.org/docs/modules/tubemq/overview) is a distributed, open source pub-sub messaging and steaming platform for real-time workloads, trillions of massive data precipitation.
+
+## Version
+
+| Extract Node | Version |
+| --------------------- | ------------------------------------------------------------ |
+| [TubeMQ](./tube.md) | [TubeMQ](https://inlong.apache.org/docs/next/modules/tubemq/overview): >=0.1.0<br/> |
+
+## Dependencies
+
+In order to set up the `TubeMQ Extract Node`, the following provides dependency information for both projects using a
+build automation tool (such as Maven or SBT) and SQL Client with Sort Connectors JAR bundles.
+
+### Maven dependency
+
+<pre><code parentName="pre">
+{`<dependency>
Review Comment:
wrong format
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org