You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by "e-mhui (via GitHub)" <gi...@apache.org> on 2023/03/02 03:37:57 UTC
[GitHub] [inlong] e-mhui opened a new issue, #7488: [Bug][Sort] Oracle CDC 2.3 can only read one record during snapshot reading
e-mhui opened a new issue, #7488:
URL: https://github.com/apache/inlong/issues/7488
### What happened
Oracle CDC 2.3 can only read one record during snapshot reading.
### What you expected to happen
After enabling incremental reading in Oracle CDC, all data can be read.
### How to reproduce
1. The test data :
<img width="254" alt="image" src="https://user-images.githubusercontent.com/111486498/215480063-6a6ac56f-93de-49e6-85bf-3cd541323a8d.png">
3. The test code :
```java
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
env.setParallelism(1);
env.disableOperatorChaining();
StreamTableEnvironment tableEnv = StreamTableEnvironment.create(env);
tableEnv.executeSql(
"CREATE TABLE `table_1`(\n"
+ " `ID` DECIMAL(10, 2),\n"
+ " `NAME` STRING,\n"
+ " `PROCESS_TIME` AS PROCTIME())\n"
+ " WITH (\n"
+ " 'connector' = 'oracle-cdc',\n"
+ " 'hostname' = 'localhost',\n"
+ " 'username' = 'flinkuser',\n"
+ " 'password' = 'flinkpw',\n"
+ " 'database-name' = 'XE',\n"
+ " 'schema-name' = 'FLINKUSER',\n"
+ " 'table-name' = 'TB2',\n"
+ " 'debezium.database.tablename.case.insensitive' = 'false',\n"
+ " 'debezium.log.mining.strategy' = 'redo_log_catalog',\n"
+ " 'debezium.log.mining.continuous.mine' = 'false',\n"
+ " 'scan.incremental.snapshot.enabled' = 'true',\n" // default true
+ " 'port' = '1521',\n"
+ " 'scan.startup.mode' = 'initial'\n"
+ ")"
);
TableResult tableResult = tableEnv.executeSql("select * from table_1");
tableResult.print();
try {
env.execute();
Thread.sleep(1000 * 1000);
} catch (Exception e) {
e.printStackTrace();
}
```
5. The error :
**Additional Description**
If applicable, add screenshots to help explain your problem.
1. When I close incremental snapshot, set `scan.incremental.snapshot.enabled=false`, it'll read all records.
<img width="1570" alt="image" src="https://user-images.githubusercontent.com/111486498/215480305-fd7b2a09-ac44-43c1-ba49-833902cfdd76.png">
2. When open incremental snapshot, set `scan.incremental.snapshot.enabled=true`, it'll read one record.
<img width="1465" alt="image" src="https://user-images.githubusercontent.com/111486498/215479928-99a90ece-0592-40e0-824e-1be1f196cbcd.png">
### Environment
_No response_
### InLong version
master
### InLong Component
InLong Sort
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] dockerzhang closed issue #7488: [Bug][Sort] Oracle CDC 2.3 can only read one record during snapshot reading
Posted by "dockerzhang (via GitHub)" <gi...@apache.org>.
dockerzhang closed issue #7488: [Bug][Sort] Oracle CDC 2.3 can only read one record during snapshot reading
URL: https://github.com/apache/inlong/issues/7488
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org