You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by "WilliamShoww (via GitHub)" <gi...@apache.org> on 2023/05/16 05:58:56 UTC
[GitHub] [skywalking] WilliamShoww opened a new issue, #10813: [Feature] Optimizing memory caching
WilliamShoww opened a new issue, #10813:
URL: https://github.com/apache/skywalking/issues/10813
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar feature requirement.
### Description
Skywalking version: 8.9.0
Server machine config: 4C + 8G
Description: I have found that during my usage, the OAPServer service tends to consume increasing amounts of memory, eventually leading to memory overflow.
I dumped the memory and analyzed it, and below are the screenshots for reference:
### Use case
Optimizing memory caching，Preventing increasing memory usage.
### Related issues
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #10813: [Feature] Optimizing memory caching
Posted by "wu-sheng (via GitHub)" <gi...@apache.org>.
wu-sheng commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549334312
There is nothing we can do from this report. That is what I can say for now.
We don't have the magic to reduce memory costs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] WilliamShoww commented on issue #10813: [Feature] Optimizing memory caching
Posted by "WilliamShoww (via GitHub)" <gi...@apache.org>.
WilliamShoww commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549331568
>
I don't want to do anything, I just feed back the problems I encountered to you, I hope your project will get better and better
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] WilliamShoww commented on issue #10813: [Feature] Optimizing memory caching
Posted by "WilliamShoww (via GitHub)" <gi...@apache.org>.
WilliamShoww commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549072418
> > Optimizing memory caching，Preventing increasing memory usage.
>
> This has nothing helpful. If you have anything to propose, you should take action and back to upstream about what should be changed with why and outcome. Simply asking doesn't help.
Are you suggesting that I should submit a pull request to you?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #10813: [Feature] Optimizing memory caching
Posted by "wu-sheng (via GitHub)" <gi...@apache.org>.
wu-sheng commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1550591465
It is not about the rule itself. Once you set rules for endpoints, then the number of endpoints would cause this kind of OOM easily, especially since most users' don't group the endpoint in a reasonable size.
I have provided as much as I could. If you can't understand, I am afraid you have to read codes and understand how the alerting core works.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] WilliamShoww commented on issue #10813: [Feature] Optimizing memory caching
Posted by "WilliamShoww (via GitHub)" <gi...@apache.org>.
WilliamShoww commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549343008
>
> Only anomaly I can see is that, your alarming data seems extremely large, which should not happen by default. Maybe you have large scale of endpoint candidates and you set alarm for all endpoints somehow.
>
> <img alt="image" width="825" src="https://user-images.githubusercontent.com/5441976/238603286-9f7df6b1-292a-44f3-b865-c0329b86bb7d.png">
> BTW, 8G means nothing for a large traffic env monitoring, and 8.9 is EOF for nearly 1 year by the upstream team.
>
> Anyway, I would be OUT from here. As diagnosing your env is your responsibility, we shouldn't and can't do it from here.
Yes, We monitor latency across all interfaces
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #10813: [Feature] Optimizing memory caching
Posted by "wu-sheng (via GitHub)" <gi...@apache.org>.
wu-sheng commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549346408
This is not about monitoring, this is about alerting rules. If so, there is nothing we can do, that is expected.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #10813: [Feature] Optimizing memory caching
Posted by "wu-sheng (via GitHub)" <gi...@apache.org>.
wu-sheng commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549083727
What do you want to do with a pull request?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #10813: [Feature] Optimizing memory caching
Posted by "wu-sheng (via GitHub)" <gi...@apache.org>.
wu-sheng commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549340149
Only anomaly I can see is that, your alarming data seems extremely large, which should not happen by default.
Maybe you have large scale of endpoint candidates and you set alarm for all endpoints somehow.
<img width="825" alt="image" src="https://github.com/apache/skywalking/assets/5441976/9f7df6b1-292a-44f3-b865-c0329b86bb7d">
BTW, 8G means nothing for a large traffic env monitoring, and 8.9 is EOF for nearly 1 year by the upstream team.
Anyway, I would be OUT from here. As diagnosing your env is your responsibility, we shouldn't and can't do it from here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #10813: [Feature] Optimizing memory caching
Posted by "wu-sheng (via GitHub)" <gi...@apache.org>.
wu-sheng commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1549041365
> Optimizing memory caching，Preventing increasing memory usage.
This has nothing helpful. If you have anything to propose, you should take action and back to upstream about what should be changed with why and outcome.
Simply asking doesn't help.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] WilliamShoww commented on issue #10813: [Feature] Optimizing memory caching
Posted by "WilliamShoww (via GitHub)" <gi...@apache.org>.
WilliamShoww commented on issue #10813:
URL: https://github.com/apache/skywalking/issues/10813#issuecomment-1550587916
>
alerting rules not many, not 10 items
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng closed issue #10813: [Feature] Optimizing memory caching
Posted by "wu-sheng (via GitHub)" <gi...@apache.org>.
wu-sheng closed issue #10813: [Feature] Optimizing memory caching
URL: https://github.com/apache/skywalking/issues/10813
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org