You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "zhijia3278 (via GitHub)" <gi...@apache.org> on 2023/07/27 00:56:32 UTC

[GitHub] [seatunnel] zhijia3278 opened a new issue, #5165: 关于MySQL CDC到starrocks的同步延迟

zhijia3278 opened a new issue, #5165:
URL: https://github.com/apache/seatunnel/issues/5165

   在使用seatunnel同步MySQL CDC到starrocks的时候,发现starrocks同步不及时。
   首先明确一点,CDC的数据应该是实时的,问题应该是出在sink到starrocks的时候。
   一开始发现是由 env 的 checkpoint.interval 参数控制的,但是不希望降低该参数,后来发现可以通过调整sink端starrocks的 batch_interval_ms 参数来控制
   此问题已解决,记录一下


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] 关于MySQL CDC到starrocks的同步延迟 [seatunnel]

Posted by "Sdreamery (via GitHub)" <gi...@apache.org>.
Sdreamery commented on issue #5165:
URL: https://github.com/apache/seatunnel/issues/5165#issuecomment-1914621590

   请问您看看您的配置参数是怎么写的吗,我这边也是这样,同步后面没反应


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [seatunnel] zhijia3278 closed issue #5165: 关于MySQL CDC到starrocks的同步延迟

Posted by "zhijia3278 (via GitHub)" <gi...@apache.org>.
zhijia3278 closed issue #5165: 关于MySQL CDC到starrocks的同步延迟
URL: https://github.com/apache/seatunnel/issues/5165


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] 关于MySQL CDC到starrocks的同步延迟 [seatunnel]

Posted by "zhijia3278 (via GitHub)" <gi...@apache.org>.
zhijia3278 commented on issue #5165:
URL: https://github.com/apache/seatunnel/issues/5165#issuecomment-1914622176

   这是来自QQ邮箱的自动回复邮件。
    
   您好,我最近正在休假中,无法亲自回复您的邮件。我将在假期结束后,尽快给您回复。


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org