You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@rocketmq.apache.org by GitBox <gi...@apache.org> on 2020/11/30 10:47:24 UTC

[GitHub] [rocketmq] xiaojiaoshou opened a new issue #2463: 双主双从集群模式下 故障演练 消费端消息消费问题

xiaojiaoshou opened a new issue #2463:
URL: https://github.com/apache/rocketmq/issues/2463


   rocketmq 选择了2主2从搭建的集群（a,a-s,b,b-s）选择的是同步复制，异步刷盘。做如下测试 ，发送消息5000条，同时生产端设置了重试次数，以及失败后转移另一台broker参数。  在生产端发送到一半的时候，kill  掉 a 主节点。 后面剩余消息会发送到b  broker 上。  最终结果是  producter 生产端 5000 条都发送成功了。 但是消费端消费条数却会少于5000条，少1-3条数据。 如果此时，再去开启a broker 节点。 那么  消费端就会消费到之前缺少的几条数据。  我有点疑惑， 我的想法是，a 主节点挂掉后，消费端应该会去切换消费a-s 备份broker上的数据以及b 主节点的数据。但是在集群模式下事实并没有。在a 挂掉后，只消费了 b  broker 上的消息。 为什么呢？ 我又做了测试，如果只是搭建一主一从，同样采用同步复制，异步刷盘，kill 掉主节点，此时会消费备份节点的�
 ��据了。集群模式下的这种机制又是怎么样的？有点疑惑
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] vongosling commented on issue #2463: 双主双从集群模式下 故障演练 消费端消息消费问题

Posted by GitBox <gi...@apache.org>.
vongosling commented on issue #2463:
URL: https://github.com/apache/rocketmq/issues/2463#issuecomment-736150666


   Besides what comments above, you are suggested to use the dledger mode.  less confused, more strong :-)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] duhenglucky edited a comment on issue #2463: 双主双从集群模式下 故障演练 消费端消息消费问题

Posted by GitBox <gi...@apache.org>.
duhenglucky edited a comment on issue #2463:
URL: https://github.com/apache/rocketmq/issues/2463#issuecomment-735870703


   @xiaojiaoshou 这里面有几个地方需要注意：1. 异步刷盘，强制杀掉进程可能会导致来不及刷盘，存在丢数据的风险。2. 从slave 上面读取是有一些条件和开关的，slaveReadEnable/suggestPullingFromSlave等。
   
   issue一般用作bug report或者feature request，为了能够更好等沉淀下来，咱们在邮件列表讨论一下，订阅方式：https://rocketmq.apache.org/about/contact/
   
   Also,  please use English to engage the community next time so that more people can help you :)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] duhenglucky commented on issue #2463: 双主双从集群模式下 故障演练 消费端消息消费问题

Posted by GitBox <gi...@apache.org>.
duhenglucky commented on issue #2463:
URL: https://github.com/apache/rocketmq/issues/2463#issuecomment-735870703


   @xiaojiaoshou 这里面有几个地方需要注意，（1）异步刷盘，强制杀掉进程可能会导致来不及刷盘（2）从slave 上面读取是有一些条件和开关的，slaveReadEnable/suggestPullingFromSlave等 这个问题确实是大家比较关注等问题，issue一般用作bug report或者feature request，为了能够更好等沉淀下来，咱们在邮件列表讨论一下，，订阅方式：https://rocketmq.apache.org/about/contact/


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] duhenglucky closed issue #2463: 双主双从集群模式下 故障演练 消费端消息消费问题

Posted by GitBox <gi...@apache.org>.
duhenglucky closed issue #2463:
URL: https://github.com/apache/rocketmq/issues/2463


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org