You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2022/08/31 02:22:57 UTC
[GitHub] [pulsar] rogueVpedro opened a new issue, #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
rogueVpedro opened a new issue, #17360:
URL: https://github.com/apache/pulsar/issues/17360
### Search before asking
- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.
### Version
2.10.1 master
### Minimal reproduce step
When we call the client for a long time, we find that the client is down and cannot send messages.
Then we got an exception while calling the client producer to send messages. (Maybe the frequency of use is too high)
Before asking, we have checked the relevant issues #15724 and #15691，but we still don't know how to avoid this situation.
And this is our process of creating producers
For the configuration of these two parameters(maxPendingMessages and memoryLimit), we set the default values . Btw，The JVM memory of the producer client is 10g and our server memory is 24g.When a problem occurs, out of heap memory is sufficient.
So，how to solve or optimize this problem [Client memory buffer is full]
### What did you expect to see?
Avoid this problem, or recover to the original normal situation when the client hangs up.
### What did you see instead?
Failing
### Anything else?
We sincerely hope to solve this problem,
### Are you willing to submit a PR?
- [X] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] github-actions[bot] commented on issue #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #17360:
URL: https://github.com/apache/pulsar/issues/17360#issuecomment-1299467912
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] rogueVpedro commented on issue #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
Posted by GitBox <gi...@apache.org>.
rogueVpedro commented on issue #17360:
URL: https://github.com/apache/pulsar/issues/17360#issuecomment-1234960613
> If you encountered send error, like timeout, there were multiple bug about client memory release, please reference #16837 #16915 #16957 #16958 #16971
OK, I will refer to the solutions to these bugs, but I am not sure whether they are useful.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] Jason918 commented on issue #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
Posted by GitBox <gi...@apache.org>.
Jason918 commented on issue #17360:
URL: https://github.com/apache/pulsar/issues/17360#issuecomment-1264554537
> In fact, the size of each message is controlled within 64M. We judge the size of each message before sending it to the producer queue. But still found this problem again
FYI: 64MB is the total memory limit, not for each message.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] gaozhangmin commented on issue #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
Posted by GitBox <gi...@apache.org>.
gaozhangmin commented on issue #17360:
URL: https://github.com/apache/pulsar/issues/17360#issuecomment-1232840977
If you encountered send error, like timeout, there were multiple bug about client memory release, please reference
https://github.com/apache/pulsar/pull/16837
https://github.com/apache/pulsar/pull/16915
https://github.com/apache/pulsar/pull/16957
https://github.com/apache/pulsar/pull/16958
https://github.com/apache/pulsar/pull/16971
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] github-actions[bot] commented on issue #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #17360:
URL: https://github.com/apache/pulsar/issues/17360#issuecomment-1264529377
The issue had no activity for 30 days, mark with Stale label.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] Technoboy- commented on issue #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
Posted by GitBox <gi...@apache.org>.
Technoboy- commented on issue #17360:
URL: https://github.com/apache/pulsar/issues/17360#issuecomment-1232706708
The default memoryLimit is 64M.
Try to set a larger value.
```
PulsarClient.builder()
.memoryLimit(xxx, SizeUnit.MEGA_BYTES)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar] rogueVpedro commented on issue #17360: [Bug] How to solve or optimize this problem [Client memory buffer is full]
Posted by GitBox <gi...@apache.org>.
rogueVpedro commented on issue #17360:
URL: https://github.com/apache/pulsar/issues/17360#issuecomment-1234959364
> 默认内存限制为 64M。 尝试设置更大的值。
>
> ```
> PulsarClient.builder()
> .memoryLimit(xxx, SizeUnit.MEGA_BYTES)
> ```
In fact, the size of each message is controlled within 64M. We judge the size of each message before sending it to the producer queue. But still found this problem again
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org