You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "zyhui98 (via GitHub)" <gi...@apache.org> on 2026/01/04 08:37:02 UTC
[I] [Bug] [MYQL-CDC] mysql全量阶段如果主键id不连续,split发生错误 [seatunnel]
zyhui98 opened a new issue, #10270:
URL: https://github.com/apache/seatunnel/issues/10270
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
运行一段时间后,提示位点提交超时,没有其他错误。
trigger checkpoint failed
org.apache.seatunnel.engine.server.checkpoint.CheckpointException: Checkpoint expired before completing. Please increase checkpoint timeout in the seatunnel.yaml or jobConfig env.
at org.apache.seatunnel.engine.server.checkpoint.PendingCheckpoint.abortCheckpoint(PendingCheckpoint.java:176) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$cleanPendingCheckpoint$20(CheckpointCoordinator.java:810) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4707) ~[?:1.8.0_202]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.cleanPendingCheckpoint(CheckpointCoordinator.java:808) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:296) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$null$9(CheckpointCoordinator.java:688) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.api.tracing.MDCRunnable.run(MDCRunnable.java:43) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_202]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_202]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_202]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_202]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_202]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_202]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202
### SeaTunnel Version
2.3.12
### SeaTunnel Config
```conf
env {
"job.mode"=STREAMING
"job.name"="20260104160319"
"checkpoint.timeout"=60000
"checkpoint.interval"=120000
"job.retry.times"=0
"job.retry.interval.seconds"=30
"parallelism"=3
"read_limit.rows_per_second"=5000
tag_filter {
group = "2000455856282628097_group"
team = "2000455856282628097_team"
}
"savemode.execute.location"=CLUSTER
}
source {
MySQL-CDC {
plugin_output = "source"
username = "******"
password = "******"
table-names = ["aist_geofence.t_aist_geofence_info"]
base-url = "jdbc:mysql://******:******/aist_geofence"
format = "DEFAULT"
startup.mode = "initial"
snapshot.split.size = 1000
}}
transform {
}
sink {
ElasticsearchHB {
plugin_input = "source"
username = "esclient_user"
password = "******"
tls_verify_certificate = false
tls_verify_hostname = false
index = "test_poi_aist_geofence_info_20260104160319"
job_id = 2007724509605326850
max_batch_size = 1000
primary_keys_hb = ["guid"]
}}
```
### Running Command
```shell
正常启动任务
```
### Error Exception
```log
trigger checkpoint failed
org.apache.seatunnel.engine.server.checkpoint.CheckpointException: Checkpoint expired before completing. Please increase checkpoint timeout in the seatunnel.yaml or jobConfig env.
at org.apache.seatunnel.engine.server.checkpoint.PendingCheckpoint.abortCheckpoint(PendingCheckpoint.java:176) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$cleanPendingCheckpoint$20(CheckpointCoordinator.java:810) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at java.util.concurrent.ConcurrentHashMap$ValuesView.forEach(ConcurrentHashMap.java:4707) ~[?:1.8.0_202]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.cleanPendingCheckpoint(CheckpointCoordinator.java:808) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.handleCoordinatorError(CheckpointCoordinator.java:296) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.engine.server.checkpoint.CheckpointCoordinator.lambda$null$9(CheckpointCoordinator.java:688) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at org.apache.seatunnel.api.tracing.MDCRunnable.run(MDCRunnable.java:43) ~[seatunnel-starter.jar:2.3.12.hb-SNAPSHOT]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_202]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_202]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) ~[?:1.8.0_202]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) ~[?:1.8.0_202]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_202]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_202]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_202
```
### Zeta or Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug][Connector-v2][MYQL-CDC] If the primary key IDs are not consecutive during the MySQL full data stage, a split error will occur [seatunnel]
Posted by "davidzollo (via GitHub)" <gi...@apache.org>.
davidzollo closed issue #10270: [Bug][Connector-v2][MYQL-CDC] If the primary key IDs are not consecutive during the MySQL full data stage, a split error will occur
URL: https://github.com/apache/seatunnel/issues/10270
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org