You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@paimon.apache.org by lz...@apache.org on 2023/07/24 14:53:03 UTC
[incubator-paimon] branch master updated: [doc] Document single table for mysql cdc table sync
This is an automated email from the ASF dual-hosted git repository.
lzljs3620320 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-paimon.git
The following commit(s) were added to refs/heads/master by this push:
new 9faa556bb [doc] Document single table for mysql cdc table sync
9faa556bb is described below
commit 9faa556bb599b1561a766efce5272d0feb0dcf20
Author: Jingsong <ji...@gmail.com>
AuthorDate: Mon Jul 24 22:45:55 2023 +0800
[doc] Document single table for mysql cdc table sync
---
docs/content/how-to/cdc-ingestion.md | 5 ++++-
.../paimon/flink/action/cdc/mysql/MySqlSyncTableActionFactory.java | 2 +-
2 files changed, 5 insertions(+), 2 deletions(-)
diff --git a/docs/content/how-to/cdc-ingestion.md b/docs/content/how-to/cdc-ingestion.md
index 9c49ea285..c3bf9270d 100644
--- a/docs/content/how-to/cdc-ingestion.md
+++ b/docs/content/how-to/cdc-ingestion.md
@@ -88,7 +88,7 @@ Example
--mysql-conf username=root \
--mysql-conf password=123456 \
--mysql-conf database-name=source_db \
- --mysql-conf table-name='source_table_.*' \
+ --mysql-conf table-name='source_table' \
--catalog-conf metastore=hive \
--catalog-conf uri=thrift://hive-metastore:9083 \
--table-conf bucket=4 \
@@ -96,6 +96,9 @@ Example
--table-conf sink.parallelism=4
```
+The mysql-conf table-name also supports regular expressions to monitor multiple tables that satisfy
+the regular expressions.
+
### Synchronizing Databases
By using [MySqlSyncDatabaseAction](/docs/{{< param Branch >}}/api/java/org/apache/paimon/flink/action/cdc/mysql/MySqlSyncDatabaseAction) in a Flink DataStream job or directly through `flink run`, users can synchronize the whole MySQL database into one Paimon database.
diff --git a/paimon-flink/paimon-flink-common/src/main/java/org/apache/paimon/flink/action/cdc/mysql/MySqlSyncTableActionFactory.java b/paimon-flink/paimon-flink-common/src/main/java/org/apache/paimon/flink/action/cdc/mysql/MySqlSyncTableActionFactory.java
index 442ec5a8e..e2e17c153 100644
--- a/paimon-flink/paimon-flink-common/src/main/java/org/apache/paimon/flink/action/cdc/mysql/MySqlSyncTableActionFactory.java
+++ b/paimon-flink/paimon-flink-common/src/main/java/org/apache/paimon/flink/action/cdc/mysql/MySqlSyncTableActionFactory.java
@@ -147,7 +147,7 @@ public class MySqlSyncTableActionFactory implements ActionFactory {
+ " --mysql-conf username=root \\\n"
+ " --mysql-conf password=123456 \\\n"
+ " --mysql-conf database-name=source_db \\\n"
- + " --mysql-conf table-name='source_table_.*' \\\n"
+ + " --mysql-conf table-name='source_table' \\\n"
+ " --catalog-conf metastore=hive \\\n"
+ " --catalog-conf uri=thrift://hive-metastore:9083 \\\n"
+ " --table-conf bucket=4 \\\n"