You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "melin (via GitHub)" <gi...@apache.org> on 2024/11/27 03:25:59 UTC

[I] [Feature] CDC support Yaml configuration and multiple source Datasources [paimon]

melin opened a new issue, #4597:
URL: https://github.com/apache/paimon/issues/4597

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
   
   
   ### Motivation
   
   40多个库(每个库一个rds 实例)，1000+表， 但每天增量数据只有100万+。目前已经使用aws dms 工具，mysql 到redshift ，dms使用4台2c16g 机器资源。
   计划迁移到Paimon数据湖方案，CDC 不支持多数据源，每个库一个任务，需要资源量比较大。 不支持yaml 维护任务不方便。
   
   
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature] CDC support Yaml configuration and multiple source Datasources [paimon]

Posted by "melin (via GitHub)" <gi...@apache.org>.
melin commented on issue #4597:
URL: https://github.com/apache/paimon/issues/4597#issuecomment-2503136789

   cc @JingsongLi 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] [Feature] CDC support Yaml configuration and multiple source Datasources [paimon]

Posted by "melin (via GitHub)" <gi...@apache.org>.
melin closed issue #4597: [Feature]  CDC support Yaml configuration and multiple source Datasources
URL: https://github.com/apache/paimon/issues/4597


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org