You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2020/05/21 12:44:06 UTC
[GitHub] [rocketmq-externals] RongtongJin opened a new issue #570: [ASoc] RocketMQ Connect Runtime optimization
RongtongJin opened a new issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570
OpenMessaging is a cloud native, vendor-neutral open specification for distributed messaging. By following OpenMessaging Connect API instead of a Message-Queue specific API, developers avoid repetitive work in building connector plugins for different message queues. OpenMessaging also provides a runtime specification which provides cluster management, scheduling, resource allocation and load-balancing functionality for OpenMessaging Connect. RocketMQ Runtime implements OpenMessaging Runtime.
This Topic requires you to optimize RocketMQ Connect Runtime, including
- Optimize the file connector in Connect Runtime, provide quick-start script.
- Complete the development of the Cassandra connector and optimize the runtime during the development.
- Optimize the configuration of the connect runtime clusters and the synchronization mechanism of the sites, Solve the issue that the startup speed of newly added workers is slow.
- Optimize Connect Runtime configuration information storage format to make it easier to manage.
- Optimize the connector loading mechanism, increase the configuration to determine the startup sequence of the connector and whether to start.
- Optimize the restful interface, add full start/stop and life cycle management for connector/task level
- Complete Connect Runtime docker image packaging.
- Improve the documentation.
- Other ease-of-use optimization.
OpenMessaging是云原生、厂商中立的分布式消息开放规范的集合。通过遵循OpenMessaging Connect API而不是特殊的Message Queue的API，开发人员可以避免为不同的消息队列构建connector插件。OpenMessaging还提供了一个OpenMessaging Runtime，该规范为OpenMessaging Connect提供了群集管理，调度，资源分配和负载平衡功能。 RocketMQ Runtime 实现 OpenMessaging Runtime。
本题目希望你能优化Connect Runtime，包括
- 优化Connect Runtime中的file connector，提供一键运行quick start脚本。
- 完成Cassandra connector的开发，在开发过程中优化Runtime。
- 优化Connect Runtime集群间配置、位点同步机制，解决新加入worker启动速度过慢的问题。
- 优化Connect Runtime配置信息存储格式，使其更加容易管理。
- 优化connector加载机制，增加配置决定connector的启动顺序以及是否启动。
- 优化restful接口，提升易用性，增加全量启动停止以及针对connector/task层级的生命周期管理。
- 完成Connect Runtime docker镜像打包。
- 完善文档。
- 其他易用性的优化提升。
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] Dreaouth commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
Dreaouth commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-650211060
@RongtongJin I have finished my proposal. Do I need to send it to you first and you can have a look and provide some advice? So that I can have a more specific requirement and modify my proposal.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] RongtongJin commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
RongtongJin commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-647136407
Hi @Fuyun791 , it would be better to communicate in English. In addition, so far we have not received a specific proposal for this project, and there is no limit to the number of students that can participate in each project. So looking forward to your participation.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] RongtongJin edited a comment on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
RongtongJin edited a comment on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-645227478
Hi @Dreaouth Welcome to the RocketMQ community.
I suggest you read some documents about Open Connect
https://rocketmq-1.gitbook.io/rocketmq-connector/
https://github.com/apache/rocketmq-externals/tree/master/rocketmq-connect
https://github.com/openmessaging/openmessaging-connect
https://github.com/openmessaging/openmessaging-connect-runtime
If you want to complete this project, you also need a deeper understanding of the source code. Looking forward to your participation.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] Dreaouth commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
Dreaouth commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-645108007
Hi，@RongtongJin I'm interested in this project for asoc，do you have some guideline tasks or suggestions to start with this project?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] Fuyun791 commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
Fuyun791 commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-646925100
@RongtongJin I participated in the issue for the first time and wanted to ask two questions. The first question, I saw that everyone uses English. Do I need to communicate in English as much as possible? Another question is that there is already someone interested in this project, can I still participate in this project
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] RongtongJin commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
RongtongJin commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-650204986
Hi, @Dreaouth @Fuyun791, ASoC's registration deadline(06.30) is approaching. If you want to participate, don't forget to submit your proposal. We look forward to your participation
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] Dreaouth commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
Dreaouth commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-647245942
@RongtongJin Thank you for your suggestions！I'm finishing my proposal for this issue by understanding the source code and documents. I will submit my applications before the deadline.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] RongtongJin commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
RongtongJin commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-645227478
@Dreaouth Welcome to the RocketMQ community.
I suggest you read some documents about Open Connect
https://rocketmq-1.gitbook.io/rocketmq-connector/
https://github.com/apache/rocketmq-externals/tree/master/rocketmq-connect
https://github.com/openmessaging/openmessaging-connect
https://github.com/openmessaging/openmessaging-connect-runtime
If you want to complete this project, you also need a deeper understanding of the source code. Looking forward to your participation.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-externals] Dreaouth commented on issue #570: [ASoC] RocketMQ Connect Runtime optimization
Posted by GitBox <gi...@apache.org>.
Dreaouth commented on issue #570:
URL: https://github.com/apache/rocketmq-externals/issues/570#issuecomment-650487896
Hi, @RongtongJin I have submit my proposal. Did you get it? If you have any questions with my proposal, please contact me via the email in the proposal. Thank you very much !
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org