You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@rocketmq.apache.org by zh...@apache.org on 2022/03/02 03:20:29 UTC
[rocketmq-connect] 21/43: update readme
This is an automated email from the ASF dual-hosted git repository.
zhoubo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/rocketmq-connect.git
commit 8a266e862ffc8ffd96586a4e7e4c43c7080d8390
Author: yuchenlichuck <yu...@126.com>
AuthorDate: Sat Aug 17 10:37:32 2019 +0800
update readme
---
README.md | 48 ++++++++++++++++++++++++++++++++++++++++--------
1 file changed, 40 insertions(+), 8 deletions(-)
diff --git a/README.md b/README.md
index 32da4b5..1970378 100644
--- a/README.md
+++ b/README.md
@@ -127,11 +127,7 @@ storePathRootDir=/home/connect/storeRoot
httpPort=8081
```
-
-
-
-
-- b、日志相关配置在logback.xml中修改
+b、日志相关配置在logback.xml中修改
```
注：rocketmq需要先创建cluster-topic，config-topic，offset-topic，position-topic
@@ -179,9 +175,9 @@ java -cp .;./conf/;./lib/* org.apache.rocketmq.connect.runtime.ConnectStartup -c
mvn dependency:copy-dependencies
```
+#### Bulk查询方法，在http中输入Get 请求（目前仅适配过MYSQL）
-
-已实现Bulk查询方法，在http中输入Get 请求（目前仅适配过MYSQL）
+请将jdbcUrl, jdbcUsername, jdbcPassword，改为所连接数据库的配置
```http
http://127.0.0.1:8081/connectors/testSourceConnector1?config={"connector-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","jdbcUrl":"127.0.0.1:3306","jdbcUsername":"root","jdbcPassword":"123456","task-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","rocketmqTopic":"jdbcTopic","mode":"bulk","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}
@@ -198,6 +194,42 @@ http://127.0.0.1:8081/connectors/testSourceConnector1?config={"connector-class":
2019-08-09 11:33:27 INFO pool-9-thread-1 - schema load successful
2019-08-09 11:33:27 INFO pool-9-thread-1 - querier.poll
+#### Incrementing and / or Timestamp Querier
+
+- 要使用的时间戳和/或自增列必须在连接器处理的所有表上。如果不同的表具有不同名称的时间戳/自增列，则需要创建单独的连接器配置；
+- 可以结合使用这些方法中的（时间戳/自增）或两者（时间戳+自增）；
+
+##### Incrementing Querier （自增列查询）
+
+注：表中需要含递增的一列，如果只使用自增列，则不会捕获对数据的更新，除非每次更新时自增列也会增加。
+
+```http
+http://127.0.0.1:8081/connectors/testSourceConnector1?config={"connector-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","jdbcUrl":"127.0.0.1:3306","jdbcUsername":"root","jdbcPassword":"123456","task-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","rocketmqTopic":"jdbcTopic","mode":"incrementing","incrementingColumnName":"id,"source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}
+```
+
+##### Timestamp Querier （时间戳查询）
+
+
+```http
+http://127.0.0.1:8081/connectors/testSourceConnector1?config={"connector-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","jdbcUrl":"127.0.0.1:3306","jdbcUsername":"root","jdbcPassword":"123456","task-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","rocketmqTopic":"jdbcTopic","mode":"timestamp":"timestampColumnName","id","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}
+```
+
+##### Incrementing + Timestamp Querier (自增列+时间戳查询)
+
+
+```http
+http://127.0.0.1:8081/connectors/testSourceConnector1?config={"connector-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","jdbcUrl":"127.0.0.1:3306","jdbcUsername":"root","jdbcPassword":"123456","task-class":"org.apache.rocketmq.connect.jdbc.connector.JdbcSourceConnector","rocketmqTopic":"jdbcTopic","mode":"incrementing+timestamp","timestampColumnName":"timestamp","incrementingColumnName":"id","source-record-converter":"org.apache.rocketmq.connect.runtime.converter [...]
+```
+
+日志如果显示为如下，则connect成功。
+
+2019-08-15 14:09:43 INFO RebalanceService - JdbcSourceConnector verifyAndSetConfig enter
+2019-08-15 14:09:44 INFO pool-14-thread-1 - Config.load.start
+2019-08-15 14:09:44 INFO pool-14-thread-1 - config load successfully
+2019-08-15 14:09:44 INFO pool-14-thread-1 - map start,199812160
+2019-08-15 14:09:44 INFO pool-14-thread-1 - {password=199812160, validationQuery=SELECT 1 FROM DUAL, testWhileIdle=true, timeBetweenEvictionRunsMillis=60000, minEvictableIdleTimeMillis=300000, initialSize=2, driverClassName=com.mysql.cj.jdbc.Driver, maxWait=60000, url=jdbc:mysql://127.0.0.1:3306?useSSL=true&verifyServerCertificate=false&serverTimezone=GMT%2B8, username=root, maxActive=2}config read successfully
+
3、启动sinkConnector
-To Be Continued.
\ No newline at end of file
+To Be Continued.
+