You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "lordk911 (via GitHub)" <gi...@apache.org> on 2023/03/31 03:29:26 UTC
[GitHub] [incubator-seatunnel] lordk911 opened a new issue, #4461: [Bug] [doris sink] cdc from mysql can't delete row
lordk911 opened a new issue, #4461:
URL: https://github.com/apache/incubator-seatunnel/issues/4461
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
mysqlcdc to doris(1.2.3) when delete a row from mysql , it can't be delete from doris
### SeaTunnel Version
SeaTunnel 2.3.1
### SeaTunnel Config
```conf
env {
# You can set flink configuration here
execution.parallelism = 2
job.mode = "STREAMING"
checkpoint.interval = 10000
#execution.checkpoint.interval = 10000
#execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
}
source {
MySQL-CDC {
startup.mode = "initial"
result_table_name = "cdc2doris"
parallelism = 1
server-id = 5656
username = "root"
password = ""
table-names = ["test.t_test"]
base-url = "jdbc:mysql://:31009/test"
}
}
sink {
Doris {
source_table_name = "cdc2doris"
fenodes = ":8030"
username = root
password = ''
table.identifier = "db_01.test_cdc_sink"
sink.enable-2pc = "true"
sink.label-prefix = "test_json_cdc4"
doris.config = {
format="json"
read_json_by_line="true"
}
}
Console {
source_table_name = "cdc2doris_t"
}
}
```
### Running Command
```shell
./bin/seatunnel.sh --config ./jobs/mycdc2doris.conf -e local
```
### Error Exception
```log
no error , I can see the row be delete from Console sink, But it's not delete from doris
```
### Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] lordk911 closed issue #4461: [Bug] [doris sink] cdc from mysql can't delete row
Posted by "lordk911 (via GitHub)" <gi...@apache.org>.
lordk911 closed issue #4461: [Bug] [doris sink] cdc from mysql can't delete row
URL: https://github.com/apache/incubator-seatunnel/issues/4461
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org