You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by "e-mhui (via GitHub)" <gi...@apache.org> on 2023/03/27 09:30:05 UTC

[GitHub] [inlong] e-mhui opened a new issue, #7708: [Bug][Sort] Fix the error that occurs when adding a table during whole database synchronization in Oracle.

e-mhui opened a new issue, #7708:
URL: https://github.com/apache/inlong/issues/7708

   ### What happened
   
   ```java
   2023-03-27 16:22:06.074 [debezium-reader-0] INFO  org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.logminer.LogMinerQueryResultProcessor [] - Table XE.FLINKUSER.VOTE_RECORD_03 is new and will be captured.
   2023-03-27 16:22:06.136 [debezium-reader-0] INFO  org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.OracleConnection [] - Database Version: Oracle Database 11g Express Edition Release 11.2.0.2.0 - 64bit Production
   2023-03-27 16:22:07.254 [pool-19-thread-1] INFO  org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed
   2023-03-27 16:22:12.404 [debezium-reader-0] ERROR org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.logminer.LogMinerHelper [] - Mining session stopped due to the org.apache.inlong.sort.cdc.oracle.shaded.org.apache.kafka.connect.errors.DataException: file is not a valid field name
   2023-03-27 16:22:12.405 [debezium-reader-0] ERROR org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.pipeline.ErrorHandler [] - Producer failure
   org.apache.inlong.sort.cdc.oracle.shaded.org.apache.kafka.connect.errors.DataException: file is not a valid field name
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.kafka.connect.data.Struct.lookupField(Struct.java:254) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.kafka.connect.data.Struct.getCheckType(Struct.java:261) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.kafka.connect.data.Struct.getString(Struct.java:158) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.inlong.sort.cdc.base.relational.JdbcSourceEventDispatcher$SchemaChangeEventReceiver.schemaChangeRecordValue(JdbcSourceEventDispatcher.java:190) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.inlong.sort.cdc.base.relational.JdbcSourceEventDispatcher$SchemaChangeEventReceiver.schemaChangeEvent(JdbcSourceEventDispatcher.java:220) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.OracleSchemaChangeEventEmitter.emitSchemaChangeEvent(OracleSchemaChangeEventEmitter.java:113) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.inlong.sort.cdc.base.relational.JdbcSourceEventDispatcher.dispatchSchemaChangeEvent(JdbcSourceEventDispatcher.java:149) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.inlong.sort.cdc.base.relational.JdbcSourceEventDispatcher.dispatchSchemaChangeEvent(JdbcSourceEventDispatcher.java:64) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.logminer.LogMinerQueryResultProcessor.dispatchSchemaChangeEventAndGetTableForNewCapturedTable(LogMinerQueryResultProcessor.java:336) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.logminer.LogMinerQueryResultProcessor.getTableForDmlEvent(LogMinerQueryResultProcessor.java:323) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.logminer.LogMinerQueryResultProcessor.processResult(LogMinerQueryResultProcessor.java:257) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.io.debezium.connector.oracle.logminer.LogMinerStreamingChangeEventSource.execute(LogMinerStreamingChangeEventSource.java:280) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.source.reader.fetch.OracleStreamFetchTask$RedoLogSplitReadTask.execute(OracleStreamFetchTask.java:125) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.source.reader.fetch.OracleStreamFetchTask.execute(OracleStreamFetchTask.java:73) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at org.apache.inlong.sort.cdc.oracle.shaded.org.apache.inlong.sort.cdc.base.source.reader.external.IncrementalSourceStreamFetcher.lambda$submitTask$0(IncrementalSourceStreamFetcher.java:86) ~[pool-1-thread-10-1679904897888-test-0308sort-connector-oracle-cdc-1.5.0-SNAPSHOT.jar:2.3.0]
   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_332]
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_332]
   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_332]
   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_332]
   	at java.lang.Thread.run(Thread.java:750) [?:1.8.0_332]
   ```
   
   ### What you expected to happen
   
   Successfully synchronized data.
   
   
   ### How to reproduce
   
   Run whole database synchronization in Oracle.
   
   
   ### Environment
   
   _No response_
   
   ### InLong version
   
   master
   
   ### InLong Component
   
   InLong Sort
   
   ### Are you willing to submit PR?
   
   - [X] Yes, I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [inlong] dockerzhang closed issue #7708: [Bug][Sort] Fix the error that occurs when adding a table during whole database synchronization in Oracle.

Posted by "dockerzhang (via GitHub)" <gi...@apache.org>.
dockerzhang closed issue #7708: [Bug][Sort] Fix the error that occurs when adding a table during whole database synchronization in Oracle.
URL: https://github.com/apache/inlong/issues/7708


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org