[GitHub] [incubator-seatunnel] JackyChenPeng opened a new issue, #4756: [Bug] [MYSQL-CDC] [Doris-sink] 使用mysql-cdc +doris-sink同步数据时,sink.label-prefix相同会报错,导致无法任务无法通过checkpoint还原

["JackyChenPeng (via GitHub)" <gi...@apache.org>]

JackyChenPeng opened a new issue, #4756:
URL: https://github.com/apache/incubator-seatunnel/issues/4756

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   操作过程:
   
   [duplicate-label-error.txt](https://github.com/apache/incubator-seatunnel/files/11476436/duplicate-label-error.txt)
   [error.txt](https://github.com/apache/incubator-seatunnel/files/11476397/error.txt)
   
   ### SeaTunnel Version
   
   seatunnel-2.3.1
   
   ### SeaTunnel Config
   
   ```conf
   env {
     job.name = "jacky.test"
     job.mode = "STREAMING"
     parallelism = 2
   }
   
   source {
     MySQL-CDC {
       result_table_name = "t_loan_apply_temp"
       catalog = {
       factory = "MySQL"
       }
       parallelism = 2
       server-id = 1001
       username = "biz-ro"
       password = "xx"
       table-names = ["mexico_one.t_loan_apply"]
       base-url = "jdbc:mysql://biz-rds-ro.norotech.lo:3306/mexico_one"
     }
   
   }
   
   transform {
   }
   
   sink {
       Doris {
           fenodes = "xxxx"
           username = "jacky_chen"
           password = "xx"
           source_table_name = "t_loan_apply_temp"
           table.identifier = "mexico_one.t_loan_apply"
           sink.enable-2pc = "true"
           sink.label-prefix = "biz_20230515_031906"
           doris.config = {
               format="json"
               read_json_by_line="true"
           }
       }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   集群starndalone模式
   1. 手动启动一个任务: sh bin/seatunnel.sh  -c noroDwhConfig/mexico_one.t_loan_apply.conf 通过log找到job id
   2. 手动执行 sh bin/seatunnel.sh -s {job id} 存savepoint
   3. 还原任务报错   sh bin/seatunnel.sh -c noroDwhConfig/mexico_one.t_loan_apply.conf -r {job id}
   ```
   
   
   ### Error Exception
   
   ```log
   见附件
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   jdk-1.8.0-371
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [seatunnel] zhongjiajie closed issue #4756: [Bug] [MYSQL-CDC] [Doris-sink] doris-sink task can not be restored from checkpoint

["zhongjiajie (via GitHub)" <gi...@apache.org>]

zhongjiajie closed issue #4756: [Bug] [MYSQL-CDC] [Doris-sink] doris-sink task can not be restored from checkpoint 
URL: https://github.com/apache/seatunnel/issues/4756


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [seatunnel] Carl-Zhou-CN commented on issue #4756: [Bug] [MYSQL-CDC] [Doris-sink] doris-sink task can not be restored from checkpoint

["Carl-Zhou-CN (via GitHub)" <gi...@apache.org>]

Carl-Zhou-CN commented on issue #4756:
URL: https://github.com/apache/seatunnel/issues/4756#issuecomment-1564149988

   hi, as for your first question, the same label-prefix cannot perform the same task twice. For the time being, it may be because the two tasks finally produce the same label, which may need to be improved. As for your second question, I am not quite clear


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org