You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "lordk911 (via GitHub)" <gi...@apache.org> on 2023/03/31 03:29:26 UTC

[GitHub] [incubator-seatunnel] lordk911 opened a new issue, #4461: [Bug] [doris sink] cdc from mysql can't delete row

lordk911 opened a new issue, #4461:
URL: https://github.com/apache/incubator-seatunnel/issues/4461

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   mysqlcdc to doris(1.2.3) when delete a row from mysql , it can't be delete from doris 
   
   ### SeaTunnel Version
   
   SeaTunnel  2.3.1
   
   ### SeaTunnel Config
   
   ```conf
   env {
     # You can set flink configuration here
     execution.parallelism = 2
     job.mode = "STREAMING"
     checkpoint.interval = 10000
     #execution.checkpoint.interval = 10000
     #execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
   }
   
   source {
      MySQL-CDC {
       startup.mode = "initial"
       result_table_name = "cdc2doris"
       parallelism = 1
       server-id = 5656
       username = "root"
       password = ""
       table-names = ["test.t_test"]
       base-url = "jdbc:mysql://:31009/test"
     }
   
   }
   
   sink {
     Doris {
           source_table_name = "cdc2doris"
           fenodes = ":8030"
           username = root
           password = ''
           table.identifier = "db_01.test_cdc_sink"
           sink.enable-2pc = "true"
           sink.label-prefix = "test_json_cdc4"
           doris.config = {
               format="json"
               read_json_by_line="true"
           }
   
     }
   
     Console {
       source_table_name = "cdc2doris_t"
     }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel.sh --config ./jobs/mycdc2doris.conf -e local
   ```
   
   
   ### Error Exception
   
   ```log
   no error , I can see the row be delete from Console sink, But it's not delete from doris
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] lordk911 closed issue #4461: [Bug] [doris sink] cdc from mysql can't delete row

Posted by "lordk911 (via GitHub)" <gi...@apache.org>.
lordk911 closed issue #4461: [Bug] [doris sink] cdc from mysql can't delete row
URL: https://github.com/apache/incubator-seatunnel/issues/4461


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org