You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@inlong.apache.org by "e-mhui (via GitHub)" <gi...@apache.org> on 2023/03/12 14:43:44 UTC
[GitHub] [inlong-website] e-mhui opened a new pull request, #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
e-mhui opened a new pull request, #710:
URL: https://github.com/apache/inlong-website/pull/710
### Prepare a Pull Request
*(Change the title refer to the following example)*
- Title Example: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
- Fixes #707
### Motivation
Add parameter description for enabling incremental snapshot for MongoDB CDC
### Modifications
1. Add description.
2. pls see the pr https://github.com/apache/inlong/pull/7570 .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
Posted by "healchow (via GitHub)" <gi...@apache.org>.
healchow commented on code in PR #710:
URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422201
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md:
##########
@@ -126,11 +126,15 @@ TODO: 未来会支持
| collection | 必须 | (none) | String | 数据库中要监视更改的集合的名称。 |
| connection.options | 可选 | (none) | String | MongoDB的 & 分隔[连接选项](https://docs.mongodb.com/manual/reference/connection-string/#std-label-connections-connection-options)。例如。`replicaSet=test&connectTimeoutMS=300000` |
| copy.existing | 可选 | true | Boolean | 是否从源集合中复制现有数据。 |
-| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程数。 |
+| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程。数。 |
Review Comment:
```suggestion
| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程数。 |
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] dockerzhang merged pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
Posted by "dockerzhang (via GitHub)" <gi...@apache.org>.
dockerzhang merged PR #710:
URL: https://github.com/apache/inlong-website/pull/710
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
Posted by "healchow (via GitHub)" <gi...@apache.org>.
healchow commented on code in PR #710:
URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422455
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md:
##########
@@ -126,11 +126,15 @@ TODO: 未来会支持
| collection | 必须 | (none) | String | 数据库中要监视更改的集合的名称。 |
| connection.options | 可选 | (none) | String | MongoDB的 & 分隔[连接选项](https://docs.mongodb.com/manual/reference/connection-string/#std-label-connections-connection-options)。例如。`replicaSet=test&connectTimeoutMS=300000` |
| copy.existing | 可选 | true | Boolean | 是否从源集合中复制现有数据。 |
-| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程数。 |
+| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程。数。 |
+| batch.size | 可选 | 1024 | Integer | Cursor 批次大小。 |
| poll.max.batch.size | 可选 | 1024 | Integer | 轮询新数据时，单个批次中包含的最大更改流文档数。 |
| poll.await.time.ms | 可选 | 1000 | Integer | 在更改流上检查新结果之前等待的时间量。 |
| heartbeat.interval.ms | 可选 | 0 | Integer | 发送心跳消息之间的时间长度（以毫秒为单位）。使用 0 禁用。 |
| inlong.metric.labels | 可选 | (none) | String | inlong metric 的标签值，该值的构成为groupId=`{groupId}`&streamId=`{streamId}`&nodeId=`{nodeId}`。|
+| scan.incremental.snapshot.enabled | 可选 | false | Boolean | 是否启用增量快照。增量快照功能仅支持MongoDB 4.0之后的版本。 |
Review Comment:
```suggestion
| scan.incremental.snapshot.enabled | 可选 | false | Boolean | 是否启用增量快照。增量快照功能仅支持 MongoDB 4.0之后的版本。 |
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
Posted by "healchow (via GitHub)" <gi...@apache.org>.
healchow commented on code in PR #710:
URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422952
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md:
##########
@@ -126,11 +126,15 @@ TODO: 未来会支持
| collection | 必须 | (none) | String | 数据库中要监视更改的集合的名称。 |
| connection.options | 可选 | (none) | String | MongoDB的 & 分隔[连接选项](https://docs.mongodb.com/manual/reference/connection-string/#std-label-connections-connection-options)。例如。`replicaSet=test&connectTimeoutMS=300000` |
| copy.existing | 可选 | true | Boolean | 是否从源集合中复制现有数据。 |
-| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程数。 |
+| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程。数。 |
+| batch.size | 可选 | 1024 | Integer | Cursor 批次大小。 |
| poll.max.batch.size | 可选 | 1024 | Integer | 轮询新数据时，单个批次中包含的最大更改流文档数。 |
| poll.await.time.ms | 可选 | 1000 | Integer | 在更改流上检查新结果之前等待的时间量。 |
| heartbeat.interval.ms | 可选 | 0 | Integer | 发送心跳消息之间的时间长度（以毫秒为单位）。使用 0 禁用。 |
| inlong.metric.labels | 可选 | (none) | String | inlong metric 的标签值，该值的构成为groupId=`{groupId}`&streamId=`{streamId}`&nodeId=`{nodeId}`。|
+| scan.incremental.snapshot.enabled | 可选 | false | Boolean | 是否启用增量快照。增量快照功能仅支持MongoDB 4.0之后的版本。 |
+| scan.incremental.snapshot.chunk.size.mb | 可选 | 64 | Integer | 增量快照的块大小 mb。 |
Review Comment:
```suggestion
| scan.incremental.snapshot.enabled | 可选 | false | Boolean | 是否启用增量快照。增量快照功能仅支持 MongoDB 4.0之后的版本。 |
| scan.incremental.snapshot.chunk.size.mb | 可选 | 64 | Integer | 增量快照的块大小，单位：mb。 |
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] healchow commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
Posted by "healchow (via GitHub)" <gi...@apache.org>.
healchow commented on code in PR #710:
URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133422201
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md:
##########
@@ -126,11 +126,15 @@ TODO: 未来会支持
| collection | 必须 | (none) | String | 数据库中要监视更改的集合的名称。 |
| connection.options | 可选 | (none) | String | MongoDB的 & 分隔[连接选项](https://docs.mongodb.com/manual/reference/connection-string/#std-label-connections-connection-options)。例如。`replicaSet=test&connectTimeoutMS=300000` |
| copy.existing | 可选 | true | Boolean | 是否从源集合中复制现有数据。 |
-| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程数。 |
+| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程。数。 |
Review Comment:
```suggestion
| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程。 |
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong-website] e-mhui commented on a diff in pull request #710: [INLONG-707][Doc] Add parameter description for enabling incremental snapshot for MongoDB CDC
Posted by "e-mhui (via GitHub)" <gi...@apache.org>.
e-mhui commented on code in PR #710:
URL: https://github.com/apache/inlong-website/pull/710#discussion_r1133841864
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md:
##########
@@ -126,11 +126,15 @@ TODO: 未来会支持
| collection | 必须 | (none) | String | 数据库中要监视更改的集合的名称。 |
| connection.options | 可选 | (none) | String | MongoDB的 & 分隔[连接选项](https://docs.mongodb.com/manual/reference/connection-string/#std-label-connections-connection-options)。例如。`replicaSet=test&connectTimeoutMS=300000` |
| copy.existing | 可选 | true | Boolean | 是否从源集合中复制现有数据。 |
-| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程数。 |
+| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程。数。 |
+| batch.size | 可选 | 1024 | Integer | Cursor 批次大小。 |
| poll.max.batch.size | 可选 | 1024 | Integer | 轮询新数据时，单个批次中包含的最大更改流文档数。 |
| poll.await.time.ms | 可选 | 1000 | Integer | 在更改流上检查新结果之前等待的时间量。 |
| heartbeat.interval.ms | 可选 | 0 | Integer | 发送心跳消息之间的时间长度（以毫秒为单位）。使用 0 禁用。 |
| inlong.metric.labels | 可选 | (none) | String | inlong metric 的标签值，该值的构成为groupId=`{groupId}`&streamId=`{streamId}`&nodeId=`{nodeId}`。|
+| scan.incremental.snapshot.enabled | 可选 | false | Boolean | 是否启用增量快照。增量快照功能仅支持MongoDB 4.0之后的版本。 |
+| scan.incremental.snapshot.chunk.size.mb | 可选 | 64 | Integer | 增量快照的块大小 mb。 |
Review Comment:
done.
##########
i18n/zh-CN/docusaurus-plugin-content-docs/current/data_node/extract_node/mongodb-cdc.md:
##########
@@ -126,11 +126,15 @@ TODO: 未来会支持
| collection | 必须 | (none) | String | 数据库中要监视更改的集合的名称。 |
| connection.options | 可选 | (none) | String | MongoDB的 & 分隔[连接选项](https://docs.mongodb.com/manual/reference/connection-string/#std-label-connections-connection-options)。例如。`replicaSet=test&connectTimeoutMS=300000` |
| copy.existing | 可选 | true | Boolean | 是否从源集合中复制现有数据。 |
-| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程数。 |
+| copy.existing.queue.size | 可选 | 10240 | Integer | 执行数据复制时使用的线程。数。 |
Review Comment:
done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org