You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@rocketmq.apache.org by GitBox <gi...@apache.org> on 2022/12/21 09:37:56 UTC

[GitHub] [rocketmq] riki-wang opened a new issue, #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

riki-wang opened a new issue, #5751:
URL: https://github.com/apache/rocketmq/issues/5751

   1. Problem
      Broker在自动故障转移模式下，设置transientStorePoolEnable=true导致benchmark性能测试急剧下降
      - transientStorePoolEnable=false测试性能
         ![image](https://user-images.githubusercontent.com/23468936/208872480-d84413b5-4d64-4278-a56c-ba6069122521.png)
   
      - transientStorePoolEnable=true测试性能
        ![image](https://user-images.githubusercontent.com/23468936/208872822-c22ff63b-bcc3-48da-8f7c-df3e72a98326.png)
   
   
   2. Environment
       - RocketMQ 5.0 1Master-1Slave Dledger Controller Mode
       - broker配置
       ```
         brokerClusterName = DefaultCluster
         brokerName = broker-a
         brokerId = -1
         deleteWhen = 04
         fileReservedTime = 12
         enableControllerMode = true
         namesrvAddr = 10.110.150.106:9876;10.110.150.107:9876;10.110.150.108:9876
         controllerAddr = 10.110.150.106:59878;10.110.150.107:59878;10.110.150.108:59878
         allAckInSyncStateSet = true
   
         flushDiskType = ASYNC_FLUSH
   
         transientStorePoolEnable=true
         transientStorePoolSize=3
   
         listenPort = 59011
   
         storePathRootDir=/home/data/rocketmq/broker-a/store
         storePathIndex=/home/data/rocketmq/broker-a/store/index
         storeCheckpoint=/home/data/rocketmq/broker-a/store/checkpoint
         abortFile=/home/data/rocketmq/broker-a/store/abort
         storePathCommitLog=/home/data/rocketmq/broker-a/store/commitlog
         storePathConsumerQueue=/home/data/rocketmq/broker-a/store/consumequeue
         storePathEpochFile=/home/data/rocketmq/broker-a/store/storePathEpochFile
       ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] Oliverwqcwrw closed issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
Oliverwqcwrw closed issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true
URL: https://github.com/apache/rocketmq/issues/5751


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] riki-wang commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by "riki-wang (via GitHub)" <gi...@apache.org>.
riki-wang commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1504742632

    Rocketmq v5.1.0 still has this issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] RongtongJin commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
RongtongJin commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362310735

   Hi @riki-wang, the issue of enabling transientStorePool in controller mode is still fixed in #5722 . After the repair is completed, we can continue to test.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] mxsm commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
mxsm commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362291701

   Hi @riki-wang 
   ![image](https://user-images.githubusercontent.com/15797831/209035409-ba8ec056-0ac4-457c-a825-83eb510a8dfc.png)
   ![image](https://user-images.githubusercontent.com/15797831/209035472-a20cecd4-4613-4d70-a4ce-df0bbf85b7d2.png)
   Little performance impact


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] riki-wang commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
riki-wang commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362312329

   > Hi @riki-wang, the issue of enabling transientStorePool in controller mode is still fixed in #5722 . After the repair is completed, we can continue to test.
   
   
   本来是准备给生产环境引入自动故障转移的，就突然测出这个性能bug了
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] Oliverwqcwrw commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
Oliverwqcwrw commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1381487192

   close as fixed


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] mxsm commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
mxsm commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362297195

   > > Hi @riki-wang ![image](https://user-images.githubusercontent.com/15797831/209035409-ba8ec056-0ac4-457c-a825-83eb510a8dfc.png) ![image](https://user-images.githubusercontent.com/15797831/209035472-a20cecd4-4613-4d70-a4ce-df0bbf85b7d2.png) Little performance impact
   > > 首次启动会有这个问题，而且是要在controller模式下，1master-1slave
   
   我试下首次启动，我上面的模式就是Controller的A-HA的自主切换模式。
   ![image](https://user-images.githubusercontent.com/15797831/209038223-956961bd-796b-4a24-9106-1cbff405386d.png)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] RongtongJin commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
RongtongJin commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362536592

   @riki-wang PR #5722 has fixed it. You can try this PR code.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] riki-wang commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
riki-wang commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362293048

   > Hi @riki-wang ![image](https://user-images.githubusercontent.com/15797831/209035409-ba8ec056-0ac4-457c-a825-83eb510a8dfc.png) ![image](https://user-images.githubusercontent.com/15797831/209035472-a20cecd4-4613-4d70-a4ce-df0bbf85b7d2.png) Little performance impact
   首次启动会有这个问题


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] riki-wang commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
riki-wang commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362312067

   > 
   
   本来是准备给生产环境引入自动故障转移的，就突然测出这个性能bug了


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [rocketmq] mxsm commented on issue #5751: Performance drops dramatically in controller mode when transientStorePoolEnable=true

Posted by GitBox <gi...@apache.org>.
mxsm commented on issue #5751:
URL: https://github.com/apache/rocketmq/issues/5751#issuecomment-1362309680

   @riki-wang 
   ![image](https://user-images.githubusercontent.com/15797831/209039139-979de2ea-780c-455e-9df5-32559ff38734.png)
   
   ![image](https://user-images.githubusercontent.com/15797831/209039937-b9b9aa4d-a974-4f97-ad16-7e29df373354.png)
   
   When first start on controller model, broker has performance impact. 
   I will try to find it and fix.
   thanks for you catch.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@rocketmq.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org