You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "man-laughing (via GitHub)" <gi...@apache.org> on 2026/08/31 11:02:24 UTC
[I] [Bug] [Oracle CDC] Generate Splits for table XXX [seatunnel]
man-laughing opened a new issue, #12019:
URL: https://github.com/apache/seatunnel/issues/12019
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
Oracle CDC -> Percona Server 5.7.44 Error
### SeaTunnel Version
2.3.13
### SeaTunnel Config
```conf
env {
parallelism = 2
job.mode = "STREAMING"
checkpoint.interval = 10000
}
source {
Oracle-CDC {
parallelism = 2
plugin_output = "oracle_fund_cdc_data_test"
driver = "oracle.jdbc.driver.OracleDriver"
username = "MY_USER"
password = "MY_PWD"
base-url = "jdbc:oracle:thin:@MYIP:1521/XXX"
database-names = ["XXX"]
schema-names = ["XXX"]
table-names = [
"XXX.XXX.XXX",
...
...
...
]
connection.pool.size = 2
source.reader.close.timeout = 600000
schema-changes.enabled = true
#enable_concurrent_read = false
# split.allow-sampling = false
# split.size = 50000
}
}
#transform {
#}
sink {
jdbc {
parallelism = 4
batch_size = 8000
connection.pool.size = 4
plugin_input = "oracle_fund_cdc_data_test"
url = "jdbc:mysql://DBIP:3306/finedb_st?rewriteBatchedStatements=true"
driver = "com.mysql.cj.jdbc.Driver"
user = "XXXX"
password = "XXXX"
generate_sink_sql = true
exclude_columns_regex = "SYS_NC.*"
database = finedb_st
table = "ODS_${schema_name}_${table_name}"
}
}
```
### Running Command
```shell
bin/seatunnel.sh -m cluster -cn zltest_seatunnel -c oracdc_fund_to_mysql_multi_table.0824_t &> fund.log
```
### Error Exception
```log
2026-08-31 17:04:32,042 INFO [o.a.s.e.c.j.ClientJobProxy ] [main] - Job (1146725070333280257) end with state FAILED
2026-08-31 17:04:32,042 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [zltest_seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTTING_DOWN
2026-08-31 17:04:32,046 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [zltest_seatunnel] [5.1] Removed connection to endpoint: [10.0.72.94]:5802:a73177a2-6573-4d0a-831d-38b5eab3d785, connection: ClientConnection{alive=false, connectionId=2, channel=NioChannel{/10.0.72.94:26295->/10.0.72.94:5802}, remoteAddress=[10.0.72.94]:5802, lastReadTime=2026-08-31 17:04:26.769, lastWriteTime=2026-08-31 17:04:26.768, closedTime=2026-08-31 17:04:32.044, connected server version=5.1}
2026-08-31 17:04:32,047 INFO [.c.i.c.ClientConnectionManager] [main] - hz.client_1 [zltest_seatunnel] [5.1] Removed connection to endpoint: [10.0.72.94]:5801:1c426090-817b-4bb7-9ac7-c41bf9aa91b5, connection: ClientConnection{alive=false, connectionId=1, channel=NioChannel{/10.0.72.94:45661->/10.0.72.94:5801}, remoteAddress=[10.0.72.94]:5801, lastReadTime=2026-08-31 17:04:32.031, lastWriteTime=2026-08-31 17:04:31.768, closedTime=2026-08-31 17:04:32.046, connected server version=5.1}
2026-08-31 17:04:32,047 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [zltest_seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_DISCONNECTED
2026-08-31 17:04:32,049 INFO [c.h.c.LifecycleService ] [main] - hz.client_1 [zltest_seatunnel] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is SHUTDOWN
2026-08-31 17:04:32,049 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed SeaTunnel client......
2026-08-31 17:04:32,049 INFO [s.c.s.s.c.ClientExecuteCommand] [main] - Closed metrics executor service ......
2026-08-31 17:04:32,049 ERROR [o.a.s.c.s.SeaTunnel ] [main] -
===============================================================================
2026-08-31 17:04:32,049 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Fatal Error,
2026-08-31 17:04:32,049 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Please submit bug report in https://github.com/apache/seatunnel/issues
2026-08-31 17:04:32,049 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Reason:SeaTunnel job executed failed
2026-08-31 17:04:32,050 ERROR [o.a.s.c.s.SeaTunnel ] [main] - Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: SeaTunnel job executed failed
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:266)
at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:40)
Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Generate Splits for table FUNDDB.FUND_USER.T_BA_ACCOUNTS error
at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.requestSplit(SourceFlowLifeCycle.java:240)
at org.apache.seatunnel.engine.server.task.context.SourceReaderContext.sendSplitRequest(SourceReaderContext.java:68)
at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.onSplitFinished(IncrementalSourceReader.java:179)
at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.finishCurrentFetch(SourceReaderBase.java:212)
at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.moveToNextSplit(SourceReaderBase.java:188)
at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.getNextFetch(SourceReaderBase.java:169)
at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:93)
at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:119)
at org.apache.seatunnel.connectors.seatunnel.common.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:114)
at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceReader.pollNext(IncrementalSourceReader.java:119)
at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:159)
at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:127)
at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:165)
at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:132)
at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:683)
at org.apache.seatunnel.engine.server.TaskExecutionService$NamedTaskWrapper.run(TaskExecutionService.java:1012)
at org.apache.seatunnel.api.tracing.MDCRunnable.run(MDCRunnable.java:43)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: Generate Splits for table FUNDDB.FUND_USER.T_BA_ACCOUNTS error
at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.returnOrThrowWithGetConventions(InvocationFuture.java:121)
at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.resolveAndThrowIfException(InvocationFuture.java:100)
at com.hazelcast.spi.impl.AbstractInvocationFuture.get(AbstractInvocationFuture.java:617)
at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.requestSplit(SourceFlowLifeCycle.java:237)
... 21 more
Caused by: java.lang.RuntimeException: Generate Splits for table FUNDDB.FUND_USER.T_BA_ACCOUNTS error
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.splitter.AbstractJdbcSourceChunkSplitter.generateSplits(AbstractJdbcSourceChunkSplitter.java:121)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner.getNext(SnapshotSplitAssigner.java:185)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.HybridSplitAssigner.getNext(HybridSplitAssigner.java:98)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.assignSplits(IncrementalSourceEnumerator.java:172)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.handleSplitRequest(IncrementalSourceEnumerator.java:82)
at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.requestSplit(SourceSplitEnumeratorTask.java:250)
at org.apache.seatunnel.engine.server.task.operation.source.RequestSplitOperation.lambda$runInternal$0(RequestSplitOperation.java:62)
at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48)
at org.apache.seatunnel.engine.server.task.operation.source.RequestSplitOperation.runInternal(RequestSplitOperation.java:52)
at org.apache.seatunnel.engine.server.task.operation.TracingOperation.run(TracingOperation.java:42)
at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189)
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273)
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248)
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:213)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:175)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:139)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123)
at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102)
at ------ submitted from ------.()
at com.hazelcast.internal.util.ExceptionUtil.cloneExceptionWithFixedAsyncStackTrace(ExceptionUtil.java:336)
at com.hazelcast.spi.impl.operationservice.impl.InvocationFuture.returnOrThrowWithGetConventions(InvocationFuture.java:112)
... 24 more
Caused by: java.lang.RuntimeException: Failed to split chunks for table FUNDDB.FUND_USER.T_BA_ACCOUNTS
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.splitter.AbstractJdbcSourceChunkSplitter.generateSplits(AbstractJdbcSourceChunkSplitter.java:93)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.SnapshotSplitAssigner.getNext(SnapshotSplitAssigner.java:185)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.HybridSplitAssigner.getNext(HybridSplitAssigner.java:98)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.assignSplits(IncrementalSourceEnumerator.java:172)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.IncrementalSourceEnumerator.handleSplitRequest(IncrementalSourceEnumerator.java:82)
at org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask.requestSplit(SourceSplitEnumeratorTask.java:250)
at org.apache.seatunnel.engine.server.task.operation.source.RequestSplitOperation.lambda$runInternal$0(RequestSplitOperation.java:62)
at org.apache.seatunnel.common.utils.RetryUtils.retryWithException(RetryUtils.java:48)
at org.apache.seatunnel.engine.server.task.operation.source.RequestSplitOperation.runInternal(RequestSplitOperation.java:52)
at org.apache.seatunnel.engine.server.task.operation.TracingOperation.run(TracingOperation.java:42)
at com.hazelcast.spi.impl.operationservice.Operation.call(Operation.java:189)
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.call(OperationRunnerImpl.java:273)
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:248)
at com.hazelcast.spi.impl.operationservice.impl.OperationRunnerImpl.run(OperationRunnerImpl.java:213)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:175)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.process(OperationThread.java:139)
at com.hazelcast.spi.impl.operationexecutor.impl.OperationThread.executeRun(OperationThread.java:123)
at com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102)
Caused by: java.sql.SQLRecoverableException: No more data to read from socket
at oracle.jdbc.driver.T4CMAREngineNIO.prepareForReading(T4CMAREngineNIO.java:119)
at oracle.jdbc.driver.T4CMAREngineNIO.unmarshalUB1(T4CMAREngineNIO.java:534)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:485)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:252)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:612)
at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:213)
at oracle.jdbc.driver.T4CStatement.doOall8(T4CStatement.java:37)
at oracle.jdbc.driver.T4CStatement.executeForRows(T4CStatement.java:896)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1119)
at oracle.jdbc.driver.OracleStatement.executeInternal(OracleStatement.java:1737)
at oracle.jdbc.driver.OracleStatement.execute(OracleStatement.java:1692)
at oracle.jdbc.driver.OracleStatementWrapper.execute(OracleStatementWrapper.java:300)
at io.debezium.jdbc.JdbcConnection.lambda$execute$3(JdbcConnection.java:430)
at io.debezium.jdbc.JdbcConnection.execute(JdbcConnection.java:447)
at io.debezium.jdbc.JdbcConnection.execute(JdbcConnection.java:424)
at org.apache.seatunnel.connectors.seatunnel.cdc.oracle.utils.OracleUtils.queryApproximateRowCnt(OracleUtils.java:105)
at org.apache.seatunnel.connectors.seatunnel.cdc.oracle.source.enumerator.OracleChunkSplitter.queryApproximateRowCnt(OracleChunkSplitter.java:87)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.splitter.AbstractJdbcSourceChunkSplitter.splitTableIntoChunks(AbstractJdbcSourceChunkSplitter.java:154)
at org.apache.seatunnel.connectors.cdc.base.source.enumerator.splitter.AbstractJdbcSourceChunkSplitter.generateSplits(AbstractJdbcSourceChunkSplitter.java:91)
... 17 more
at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:258)
... 2 more
2026-08-31 17:04:32,050 ERROR [o.a.s.c.s.SeaTunnel ] [main] -
```
### Zeta or Flink or Spark Version
Zeta
### Java or Scala Version
java version "1.8.0_333"
Java(TM) SE Runtime Environment (build 1.8.0_333-b02)
Java HotSpot(TM) 64-Bit Server VM (build 25.333-b02, mixed mode)
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Oracle CDC] Generate Splits for table XXX [seatunnel]
Posted by "xinnyuli (via GitHub)" <gi...@apache.org>.
xinnyuli commented on issue #12019:
URL: https://github.com/apache/seatunnel/issues/12019#issuecomment-5477973116
Line 105 in 2.3.13 is `jdbc.execute(analyzeTable)` — so the statement that
died is `analyze table ... compute statistics for table`, not the row-count
query. That's a full scan, which fits a long-running statement being cut off.
Both `skip_analyze` and `use_select_count` default to false, so the analyze
runs unless you set one of them.
Could you retry with `skip_analyze = true`? If it then fails on the cheap
`select NUM_ROWS from all_tables` too, that would point at the connection
rather than the statement duration.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Oracle CDC] Generate Splits for table XXX [seatunnel]
Posted by "DanielLeens (via GitHub)" <gi...@apache.org>.
DanielLeens commented on issue #12019:
URL: https://github.com/apache/seatunnel/issues/12019#issuecomment-5478145627
Thanks for the report. I rechecked the current Oracle CDC split path on `dev` before replying.
The stack trace here is important: the failure is happening while Oracle CDC is generating snapshot splits, and on the current source the concrete statement that dies in this path is `jdbc.execute(analyzeTable)` inside `OracleUtils.queryApproximateRowCnt(...)`, not the downstream sink path or the LogMiner streaming phase.
Today the relevant defaults are:
1. `use_select_count = false`;
2. `skip_analyze = false`;
3. so the default path runs `analyze table ... compute statistics for table` before it reads `NUM_ROWS`.
Because of that, I would not call this a confirmed SeaTunnel product bug yet. First we need to separate "the analyze statement is timing out / losing its Oracle session" from "any row-count path fails".
Could you please retry with these two controlled variants and report exactly which one fails?
1. `skip_analyze = true` while keeping `use_select_count = false` so the split path skips `analyze table` and reads `NUM_ROWS` directly.
2. `use_select_count = true` so the split path skips `analyze table` entirely and uses `select count(*) from ...`.
If variant 1 or 2 succeeds, the failure is likely specific to the analyze/statistics path or its runtime duration. If both still fail with the same `No more data to read from socket`, then we should treat it as a broader Oracle JDBC/session-stability issue in split enumeration.
When you reply, please also include:
1. the exact Oracle database version;
2. whether the failure still reproduces on the same table with `parallelism = 1`;
3. any server-side SQL/socket timeout settings that may close a long-running Oracle session.
That will let maintainers narrow this much faster without guessing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Oracle CDC] Generate Splits for table XXX [seatunnel]
Posted by "man-laughing (via GitHub)" <gi...@apache.org>.
man-laughing closed issue #12019: [Bug] [Oracle CDC] Generate Splits for table XXX
URL: https://github.com/apache/seatunnel/issues/12019
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Oracle CDC] Generate Splits for table XXX [seatunnel]
Posted by "man-laughing (via GitHub)" <gi...@apache.org>.
man-laughing commented on issue #12019:
URL: https://github.com/apache/seatunnel/issues/12019#issuecomment-5492558206
> Thanks for the report. I rechecked the current Oracle CDC split path on `dev` before replying.
>
> The stack trace here is important: the failure is happening while Oracle CDC is generating snapshot splits, and on the current source the concrete statement that dies in this path is `jdbc.execute(analyzeTable)` inside `OracleUtils.queryApproximateRowCnt(...)`, not the downstream sink path or the LogMiner streaming phase.
>
> Today the relevant defaults are:
>
> 1. `use_select_count = false`;
> 2. `skip_analyze = false`;
> 3. so the default path runs `analyze table ... compute statistics for table` before it reads `NUM_ROWS`.
>
> Because of that, I would not call this a confirmed SeaTunnel product bug yet. First we need to separate "the analyze statement is timing out / losing its Oracle session" from "any row-count path fails".
>
> Could you please retry with these two controlled variants and report exactly which one fails?
>
> 1. `skip_analyze = true` while keeping `use_select_count = false` so the split path skips `analyze table` and reads `NUM_ROWS` directly.
> 2. `use_select_count = true` so the split path skips `analyze table` entirely and uses `select count(*) from ...`.
>
> If variant 1 or 2 succeeds, the failure is likely specific to the analyze/statistics path or its runtime duration. If both still fail with the same `No more data to read from socket`, then we should treat it as a broader Oracle JDBC/session-stability issue in split enumeration.
>
> When you reply, please also include:
>
> 1. the exact Oracle database version;
> 2. whether the failure still reproduces on the same table with `parallelism = 1`;
> 3. any server-side SQL/socket timeout settings that may close a long-running Oracle session.
>
> That will let maintainers narrow this much faster without guessing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] [Oracle CDC] Generate Splits for table XXX [seatunnel]
Posted by "zhang-arvin (via GitHub)" <gi...@apache.org>.
zhang-arvin commented on issue #12019:
URL: https://github.com/apache/seatunnel/issues/12019#issuecomment-5480048933
I would like to work on this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org