You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@rocketmq.apache.org by "leehom (via GitHub)" <gi...@apache.org> on 2023/05/16 10:49:03 UTC
[GitHub] [rocketmq-connect] leehom opened a new issue, #505: 配置服务rocketmq实现疑问
leehom opened a new issue, #505:
URL: https://github.com/apache/rocketmq-connect/issues/505
配置服务local和rocketmq实现可以用于分布式环境，但两者有个重要差别，START_SIGNAL的分发，local实现start的时候发出START_SIGNAL，获取其他worker节点的配置，这样，在负载均衡过程中获取connector/task的配置，但rocketmq并没有START_SIGNAL，怎么获取全量的connector/task的配置？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] leehom commented on issue #505: 配置服务rocketmq实现疑问
Posted by "leehom (via GitHub)" <gi...@apache.org>.
leehom commented on issue #505:
URL: https://github.com/apache/rocketmq-connect/issues/505#issuecomment-1549607986
> 配置变化时会向指定的配置topic（connector-config-topic）发消息 可以看下这块实现 org.apache.rocketmq.connect.runtime.service.AbstractConfigManagementService#putConnectorConfig
>
> 所有worker都会消费connector-config-topic消息。这样所有worker就可以获取到全量的connector，task配置信息 处理逻辑可以看下这个方法 org.apache.rocketmq.connect.runtime.service.AbstractConfigManagementService#process
你说的这个我知道，那是变更的时候，我说的场景时，一个新的worker启动，local服务发START_SIGNAL，让其他worker发送自身的配置，新的worker得到全量的配置，但rocketmq实现并没有发送START_SIGNAL，新worker是怎么样获取全量的配置？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] odbozhou commented on issue #505: 配置服务rocketmq实现疑问
Posted by "odbozhou (via GitHub)" <gi...@apache.org>.
odbozhou commented on issue #505:
URL: https://github.com/apache/rocketmq-connect/issues/505#issuecomment-1549534502
配置变化时会向指定的配置topic（connector-config-topic）发消息
可以看下这块实现
org.apache.rocketmq.connect.runtime.service.AbstractConfigManagementService#putConnectorConfig
所有worker都会消费connector-config-topic消息。这样所有worker就可以获取到全量的connector，task配置信息
处理逻辑可以看下这个方法
org.apache.rocketmq.connect.runtime.service.AbstractConfigManagementService#process
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] leehom commented on issue #505: 配置服务rocketmq实现疑问
Posted by "leehom (via GitHub)" <gi...@apache.org>.
leehom commented on issue #505:
URL: https://github.com/apache/rocketmq-connect/issues/505#issuecomment-1550621137
> > 配置变化时会向指定的配置topic（connector-config-topic）发消息 可以看下这块实现 org.apache.rocketmq.connect.runtime.service.AbstractConfigManagementService#putConnectorConfig
> > 所有worker都会消费connector-config-topic消息。这样所有worker就可以获取到全量的connector，task配置信息 处理逻辑可以看下这个方法 org.apache.rocketmq.connect.runtime.service.AbstractConfigManagementService#process
>
> 你说的这个我知道，那是变更的时候，我说的场景时，一个新的worker启动，local服务发START_SIGNAL，让其他worker发送自身的配置，新的worker得到全量的配置，但rocketmq实现并没有发送START_SIGNAL，新worker是怎么样获取全量的配置？
我估计是还没实现类似kafka connect的KafkaBackingStore
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] sunxiaojian commented on issue #505: 配置服务rocketmq实现疑问
Posted by "sunxiaojian (via GitHub)" <gi...@apache.org>.
sunxiaojian commented on issue #505:
URL: https://github.com/apache/rocketmq-connect/issues/505#issuecomment-1558382405
> KafkaBackingStore
org.apache.rocketmq.connect.runtime.utils.datasync.BrokerBasedLog
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] leehom commented on issue #505: 配置服务rocketmq实现疑问
Posted by "leehom (via GitHub)" <gi...@apache.org>.
leehom commented on issue #505:
URL: https://github.com/apache/rocketmq-connect/issues/505#issuecomment-1558617640
> > KafkaBackingStore
>
> org.apache.rocketmq.connect.runtime.utils.datasync.BrokerBasedLog
明白，还是要补一下rocketmq
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [rocketmq-connect] leehom closed issue #505: 配置服务rocketmq实现疑问
Posted by "leehom (via GitHub)" <gi...@apache.org>.
leehom closed issue #505: 配置服务rocketmq实现疑问
URL: https://github.com/apache/rocketmq-connect/issues/505
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org