You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@brpc.apache.org by "zc08291161 (via GitHub)" <gi...@apache.org> on 2023/02/09 13:04:13 UTC
[GitHub] [brpc] zc08291161 opened a new issue, #2119: 单个rpcserver的多连接带宽上限如何突破
zc08291161 opened a new issue, #2119:
URL: https://github.com/apache/brpc/issues/2119
**Is your feature request related to a problem? (你需要的功能是否与某个问题有关?)**
在一台linux服务器上部署一个依赖brpc的进程A，压测发现进程A最大的入口带宽为2.5GB/s左右，无论如何更改A进程的内部线程模型或者brpc的各种参数，都无法继续增长；但是硬件指标都没有跑满，这时再部署相同的进程B，发现带宽又可以继续增加到4.5GB/s左右，以此类推，增加进程的个数，可以将硬件打满
**Describe the solution you'd like (描述你期望的解决方法)**
根据brpc的项目描述，也确实曾经描述过单个server的带宽上限约为2.3GB/s每秒，但这个限制到底源于什么呢？为什么增加brpc server可以解决，但是通过扩充单个server的调度线程或worker线程，就无法解决呢？这实在让人疑惑
**Describe alternatives you've considered (描述你想到的折衷方案)**
**Additional context/screenshots (更多上下文/截图)**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] chenzhangyi commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "chenzhangyi (via GitHub)" <gi...@apache.org>.
chenzhangyi commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425139020
@zc08291161 最大吞吐的server数量和numa node数量一致么？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] Tuvie commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "Tuvie (via GitHub)" <gi...@apache.org>.
Tuvie commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1427877896
你说的这个带宽瓶颈我这里测试没有发现
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] zc08291161 commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "zc08291161 (via GitHub)" <gi...@apache.org>.
zc08291161 commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425272923
> 2.5GB/s是单连接还是多连接？connection_type设置为pooled看看呢？
是有多个client，所以总的链接个数肯定是多个，不过每个链接都是single类型的，这种和pooled应该是类似的吧。无论增加多少个client，最大带宽都不会上升了。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] zc08291161 commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "zc08291161 (via GitHub)" <gi...@apache.org>.
zc08291161 commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425081796
> 增加event_dispatcher_num试试
多谢提醒，这个已经增加过了，也是没有用
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] zc08291161 commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "zc08291161 (via GitHub)" <gi...@apache.org>.
zc08291161 commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425274298
> 2.5GB/s是单连接还是多连接？connection_type设置为pooled看看呢？
实测还发现一个现象，我们利用sofa-rpc进行测试，最大带宽可以打到5GB/s左右，我现在怀疑是brpc的dispatch调度机制的问题，就是总是把自己让出来去接收消息，再由空闲的worker去调度dispatch线程，而sofa则是始终有一个dispatch线程工作。会不会是brpc的dipatch线程工作不充分导致的。（增加dipstach线程个数也试过，也没用）
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] zc08291161 commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "zc08291161 (via GitHub)" <gi...@apache.org>.
zc08291161 commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425271829
> numa node
没有太理解您的问题，我就是单台server，多个client进行压测，server只有一台，就这台server的最大入口带宽就是2.5GB/s
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] wwbmmm commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "wwbmmm (via GitHub)" <gi...@apache.org>.
wwbmmm commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425063433
增加event_dispatcher_num试试
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] zc08291161 commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "zc08291161 (via GitHub)" <gi...@apache.org>.
zc08291161 commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425267883
> 你使用的server本身带宽多少呢？2.5GB/s基本上接近25G带宽了。
我是双25GE网卡bond4绑定，实测可以达到6GB/s
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] Tuvie commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "Tuvie (via GitHub)" <gi...@apache.org>.
Tuvie commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425271699
2.5GB/s是单连接还是多连接？connection_type设置为pooled看看呢？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] zc08291161 commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "zc08291161 (via GitHub)" <gi...@apache.org>.
zc08291161 commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1427238335
> 如果任何一个cpu都没有100%，那应该不是dispatch的问题。
那请问还是否了解为何brpc单个server有带宽瓶颈么？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] Tuvie commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "Tuvie (via GitHub)" <gi...@apache.org>.
Tuvie commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1426613075
如果任何一个cpu都没有100%，那应该不是dispatch的问题。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
[GitHub] [brpc] Tuvie commented on issue #2119: 单个rpcserver的多连接带宽上限如何突破
Posted by "Tuvie (via GitHub)" <gi...@apache.org>.
Tuvie commented on issue #2119:
URL: https://github.com/apache/brpc/issues/2119#issuecomment-1425266847
你使用的server本身带宽多少呢？2.5GB/s基本上接近25G带宽了。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org