[GitHub] [pulsar] codelipenghui opened a new pull request, #20914: [fix][tool] fix perf-producer get OOM with high publish latency

["codelipenghui (via GitHub)" <gi...@apache.org>]

codelipenghui opened a new pull request, #20914:
URL: https://github.com/apache/pulsar/pull/20914

   ### Motivation
   
   Fix the perf-producer to get direct memory OOM with high publish latency.
   The root cause is the perf-producer without any memory limitation and pending
   queue size limitation by default.
   
   You can try to set the max pending queue size for a workaround. 
   
   ### Modifications
   
   Use the default configuration of the PulsarClient instead of removing the memory
   limitation in pulsar-perf.
   
   We should also provide an option to specify the max memory for the perf tool.
   But it will introduce new public API changes to the perf tool, so it should only be available
   in the feature release. This PR is focused on the BUG fix to avoid confusing users
   with OOM.
   
   ### Does this pull request potentially affect one of the following parts:
   
   <!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. -->
   
   *If the box was checked, please highlight the changes*
   
   - [ ] Dependencies (add or upgrade a dependency)
   - [ ] The public API
   - [ ] The schema
   - [ ] The default values of configurations
   - [ ] The threading model
   - [ ] The binary protocol
   - [ ] The REST endpoints
   - [ ] The admin CLI options
   - [ ] The metrics
   - [ ] Anything that affects deployment
   
   ### Documentation
   
   <!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. -->
   
   - [ ] `doc` <!-- Your PR contains doc changes. -->
   - [ ] `doc-required` <!-- Your PR changes impact docs and you will update later -->
   - [x] `doc-not-needed` <!-- Your PR changes do not impact docs -->
   - [ ] `doc-complete` <!-- Docs have been already added -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] Technoboy- closed pull request #20914: [fix][client] Fix perf-producer get OOM with high publish latency

["Technoboy- (via GitHub)" <gi...@apache.org>]

Technoboy- closed pull request #20914: [fix][client] Fix perf-producer get OOM with high publish latency
URL: https://github.com/apache/pulsar/pull/20914


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [pulsar] Technoboy- merged pull request #20914: [fix][client] Fix perf-producer get OOM with high publish latency

["Technoboy- (via GitHub)" <gi...@apache.org>]

Technoboy- merged PR #20914:
URL: https://github.com/apache/pulsar/pull/20914


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org