You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@brpc.apache.org by "imdouyu (via GitHub)" <gi...@apache.org> on 2024/12/17 13:36:37 UTC
[I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
imdouyu opened a new issue, #2853:
URL: https://github.com/apache/brpc/issues/2853
**Describe the bug (描述bug)**
发送的数据包变大了，预期调大socket_max_unwritten_bytes可以缓解拥塞的问题，但实际没有
**To Reproduce (复现方法)**
**Expected behavior (期望行为)**
**Versions (各种版本)**
OS:
Compiler:
brpc:
protobuf:
**Additional context/screenshots (更多上下文/截图)**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright closed issue #2853: 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解
URL: https://github.com/apache/brpc/issues/2853
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561728854
server也忽略一下就好了
https://github.com/apache/brpc/blob/master/docs/cn/server.md#server%E7%AB%AF%E5%BF%BD%E7%95%A5eovercrowded
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561644983
ignore后依旧有这个问题，相比之前缓解了一些🥲
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561661649
> 每次rpc都有调Controller::ignore_eovercrowded()吗？调Controller::ignore_eovercrowded()的rpc才会忽略，其他没调的还是会overcrowded rpc失败。
每次都有调用，cntl.ignore_eovercrowded();
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561673327
> 作为server还是client报错的？
client
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561680239
https://github.com/apache/brpc/blob/103da1d5b9d8dc4a509a3b79ba872c4c01aa5a75/src/brpc/socket.cpp#L1634-L1636
https://github.com/apache/brpc/blob/103da1d5b9d8dc4a509a3b79ba872c4c01aa5a75/src/brpc/socket.cpp#L1672-L1674
client只有这两个位置会返回失败，理论上调了Controller::ignore_eovercrowded()应该就不会失败了。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561691077
这个错误会不会是server回的？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2551209822
> 试一下Controller::ignore_eovercrowded()
大佬，这各方法相当于不检测拥塞，尽最大努力发送的意思吗
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561687798
从现象上看，加上ignore后对比没加的，在指定时间范围内overcrowded的日志减少了一半，看起来有缓解，但没根治
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561736082
> server也忽略一下就好了 https://github.com/apache/brpc/blob/master/docs/cn/server.md#server%E7%AB%AF%E5%BF%BD%E7%95%A5eovercrowded
感谢大佬，今天抽空测试一下
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2567480347
> 消费速度一直小于生产速度的话，内存会一直涨。
离线服务每天发送的数据有一个高低峰期，如果说在高峰期启用这个选项后的内存在接受范围内，其实启用这个选项是安全的，可以这么理解吗？主要担心会不会带来其他影响
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2550930090
试一下Controller::ignore_eovercrowded
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright closed issue #2853: 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解
URL: https://github.com/apache/brpc/issues/2853
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561713559
> 这个错误会不会是server回的？
哦大佬，我刚才理解错意思了，是server回的，拿echo_c++举个例子
```C++
cntl.ignore_eovercrowded();
stub.Echo(&cntl, &request, &response, brpc::DoNothing());
brpc::Join(cntl.call_id());
if (!cntl.Failed()) {
LOG(INFO) << "Received response from " << cntl.remote_side()
<< " to " << cntl.local_side()
<< ": " << response.message() << " (attached="
<< cntl.response_attachment() << ")"
<< " latency=" << cntl.latency_us() << "us";
} else {
LOG(WARNING) << cntl.ErrorText();
}
```
错误在cntl.ErrorText();打印出来的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561659335
每次rpc都有调Controller::ignore_eovercrowded()吗？调Controller::ignore_eovercrowded()的rpc才会忽略，其他没调的还是会overcrowded rpc失败。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2567431180
消费速度一直小于生产速度的话，内存会一直涨。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2567522908
主要是内存的问题了
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "Karssadin (via GitHub)" <gi...@apache.org>.
Karssadin commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-3043567071
> server也忽略一下就好了
大佬，有个问题想问一下。目前开发场景下使用的brpc release版本较老，并未包含server端的ignore。给client端设置ignore之后进行测试，是在baidu_rpc_protocol.cpp中检测overcrowded，就是接收方的检测。因为做测试的时候将unwritten_size设置为了0。
想请教一下，这种情况下，接收方的socket检测是否大于unwritten_size，是否是一个单独的socket，因为接收方也会作为发送发给原发送方发送数据，也存在一个channel。
如果是相互独立的socket的话，这种场景下我可以设置unwritten_size来只针对接收方给发送方的response限制
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@brpc.apache.org
For additional commands, e-mail: issues-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-3048416753
> 想请教一下，这种情况下，接收方的socket检测是否大于unwritten_size，是否是一个单独的socket
Socket维度的
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@brpc.apache.org
For additional commands, e-mail: issues-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "imdouyu (via GitHub)" <gi...@apache.org>.
imdouyu commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2567405659
佬，打patch测试了一下，目前还没出现overcrowded，看代码注释说对heavy-load的rpc不应该启用，如果我们场景的rpc是heavy-load的，启用这个选项有什么影响吗https://github.com/apache/brpc/blob/5c0341410c1ea77210337df7c42bb99fe0ce3fe5/src/brpc/server.h#L290-#L293
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2551237480
忽略拥塞，将数据加入发送队列。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org
Re: [I] 发送数据出现这条日志[E1011]Connection to x.x.x.x:12345 is overcrowded，调大socket_max_unwritten_bytes依旧没有缓解 (brpc)
Posted by "chenBright (via GitHub)" <gi...@apache.org>.
chenBright commented on issue #2853:
URL: https://github.com/apache/brpc/issues/2853#issuecomment-2561673023
作为server还是client报错的？
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@brpc.apache.org
For additional commands, e-mail: dev-help@brpc.apache.org