You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@seatunnel.apache.org by arjun s <ar...@gmail.com> on 2023/06/01 10:02:15 UTC

Mysql CDC on LOAD data

Hi team,

I'm new to Apache Seatunnel and currently experimenting with CDC between my
two MySQL servers. I have successfully installed and set up Seatunnel, and
it is functioning properly.

During my testing, I noticed that when I run the "load data" command in the
source MySQL server, Seatunnel executes an insert operation for each
record. This raises concerns about network issues when dealing with a large
number of records(lets say load data of 1M records). Is there a provision
for batch inserts or CDC based on the last fetched ID? I have attached my
CDC configuration file below.

Thank you.