You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "SinyoWong (via GitHub)" <gi...@apache.org> on 2023/04/21 03:33:11 UTC
[GitHub] [doris] SinyoWong opened a new issue, #18885: [Bug] Flink-Doris-Connector cdc job data lose
SinyoWong opened a new issue, #18885:
URL: https://github.com/apache/doris/issues/18885
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
Doris 1.2.3
Flink 1.14.5
Flink Doris Connector 1.14_2.12-1.1.0
### What's Wrong?
Data lose happens when I synchronize data from mysql-cdc to doris, using datastream load to doris's light-schema-change features.
How to review this bug:
1. Set flink's checkpoint time as 10s , just enough for next two operations could operate in one checkpoint ;
2. While the mysql-cdc job is running, add one source table's column （DDL）;
3. Update this source table's data （DML）;
The result seems that doris couldn't recieve DML data in this checkpoint , but the DDL synchronized.
### What You Expected?
In one flink's checkpoint , both DDL and DML should be synchronized .
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] SinyoWong commented on issue #18885: [Bug] Flink-Doris-Connector cdc job data lose
Posted by "SinyoWong (via GitHub)" <gi...@apache.org>.
SinyoWong commented on issue #18885:
URL: https://github.com/apache/doris/issues/18885#issuecomment-1517219595
same issue:
https://github.com/apache/doris/issues/18854
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] SinyoWong closed issue #18885: [Bug] Flink-Doris-Connector cdc job data lose
Posted by "SinyoWong (via GitHub)" <gi...@apache.org>.
SinyoWong closed issue #18885: [Bug] Flink-Doris-Connector cdc job data lose
URL: https://github.com/apache/doris/issues/18885
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org