[GitHub] [rocketmq] shenhui0509 opened a new issue #1515: [improvement] SYNC_MASTER could be change into pipeline manner

[GitBox <gi...@apache.org>]

shenhui0509 opened a new issue #1515: [improvement] SYNC_MASTER could be change into pipeline manner
URL: https://github.com/apache/rocketmq/issues/1515
 
 
   ** Performance improvement **
   
   The performance of SYNC_MASTER is poor, only 1/10 of async.
   According to benchmark
   - Configure
       - CPU : Intel(R) Xeon(R) Gold 5118 CPU @ 2.30GHz, 48C
       - Memory : 512G
       - Disk : 2T PCIE SSD
   - Result
       - ASYNC_MASTER : TPS = 108k; latency avg = 1.8ms; latency pct99=2.6ms
       - SYNC_MASTER : TPS = 10.6k; latency avg = 18.7ms; latency pct99=26ms
   
   The cause of the poor performance of SYNC_MASTER is that the request processor blocking wait until the flushed offset larger than write offset, blocking the upcoming request.
   
   This blocking wait manner can be changed into pipeline manner, when then send request is written to local commitLog, the processor can process the next request immediately; let the flushSlave/flushDisk thread responds to client the send request is replicated successfully or timeout. 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services