You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@rocketmq.apache.org by "DuansgXD (via GitHub)" <gi...@apache.org> on 2023/05/08 03:31:10 UTC
[GitHub] [rocketmq-connect] DuansgXD opened a new issue, #497: Some questions about S3
DuansgXD opened a new issue, #497:
URL: https://github.com/apache/rocketmq-connect/issues/497
I saw that rocketmq connect was designed as a tool for streaming data across heterogeneous systems. But I have a few questions, as follows:
1、Now, the connectors support only partial heterogeneous systems of data processing? Because I have looked at some of the code related to sink task in the master branch, such as (sftp, cassandra)sink task, their source/sink task is processed in a special data way. It may not support things like redis source -> sftp sink this way.
2、SSo, for S3, need to support S3 source -> S3 sink this way? Or do you need to support all heterogeneous systems?
3、If need to support other heterogeneous systems, like S3 sink for batch message processing such as Mysql source, it needs to generate table files?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] DuansgXD commented on issue #497: Some questions about S3
Posted by "DuansgXD (via GitHub)" <gi...@apache.org>.
DuansgXD commented on issue #497:
URL: https://github.com/apache/rocketmq-connect/issues/497#issuecomment-1537787824
@odbozhou ok，thanks
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] odbozhou commented on issue #497: Some questions about S3
Posted by "odbozhou (via GitHub)" <gi...@apache.org>.
odbozhou commented on issue #497:
URL: https://github.com/apache/rocketmq-connect/issues/497#issuecomment-1537784796
You can look at the jdbc connector implementation, which is relatively complete. It is not difficult to achieve data transmission between heterogeneous systems, mainly through the support of schema and converter.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org