You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by GitBox <gi...@apache.org> on 2021/08/09 08:09:21 UTC
[GitHub] [skywalking] JHub-Wei opened a new issue #7424: GC overhead limit exceeded
JHub-Wei opened a new issue #7424:
URL: https://github.com/apache/skywalking/issues/7424
Please answer these questions before submitting your issue.
- Why do you submit this issue?
- [ ] Question or discussion
- [ * ] Bug
- [ ] Requirement
- [ ] Feature or performance improvement
___
### Question
- What do you want to know?
It was running well before, but one day the interface was stuck, and then I found OOM in the OAP logs.Is there a memory leak on the backend？
2021-08-06 09:35:34,258 - org.apache.skywalking.oap.server.core.analysis.worker.MetricsPersistentWorker - 255 [DataCarrier.METRICS_L2_AGGREGATION.BulkConsumePool.0.Thread] ERROR [] - GC overhead limit exceeded
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:35:50,663 - org.apache.skywalking.oap.server.core.storage.ttl.DataTTLKeeperTimer - 81 [pool-8-thread-1] INFO [] - Beginning to remove expired metrics from the storage.
2021-08-06 09:35:50,663 - org.apache.skywalking.oap.server.core.analysis.worker.MetricsAggregateWorker - 118 [DataCarrier.METRICS_L1_AGGREGATION.BulkConsumePool.15.Thread] ERROR [] - GC overhead limit exceeded
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:36:28,958 - org.apache.skywalking.oap.server.core.analysis.worker.MetricsAggregateWorker - 118 [DataCarrier.METRICS_L1_AGGREGATION.BulkConsumePool.12.Thread] ERROR [] - GC overhead limit exceeded
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:35:50,663 - org.apache.skywalking.oap.server.core.analysis.worker.MetricsPersistentWorker - 255 [DataCarrier.METRICS_L2_AGGREGATION.BulkConsumePool.0.Thread] ERROR [] - GC overhead limit exceeded
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:36:41,302 - org.apache.skywalking.oap.server.core.analysis.worker.MetricsPersistentWorker - 194 [pool-7-thread-1] ERROR [] - GC overhead limit exceeded
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:36:40,045 - org.apache.skywalking.oap.server.core.analysis.worker.MetricsPersistentWorker - 255 [DataCarrier.METRICS_L2_AGGREGATION.BulkConsumePool.0.Thread] ERROR [] - GC overhead limit exceeded
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:35:51,832 - org.eclipse.jetty.io.ManagedSelector - 904 [qtp1882395698-313] WARN [] - java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:36:28,553 - org.eclipse.jetty.util.thread.QueuedThreadPool - 1048 [qtp1882395698-315] WARN [] -
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:36:43,713 - org.eclipse.jetty.io.ManagedSelector - 904 [qtp1882395698-309] WARN [] - java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:36:43,713 - io.netty.channel.ChannelInitializer - 97 [grpc-nio-worker-ELG-3-3] WARN [] - Failed to initialize a channel. Closing: [id: 0xf6681a8c, L:/172.16.7.247:11800 - R:/192.168.0.197:28016]
java.lang.OutOfMemoryError: GC overhead limit exceeded
2021-08-06 09:36:43,715 - org.apache.skywalking.oap.server.core.storage.PersistenceTimer - 129 [pool-7-thread-1] ERROR [] - GC overhead limit exceeded
___
### Bug
- Which version of SkyWalking, OS, and JRE?
- 8.4.0，jdk1.8
- Which company or project?
- What happened?
If possible, provide a way to reproduce the error. e.g. demo application, component version.
___
### Requirement or improvement
- Please describe your requirements or improvement suggestions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng closed issue #7424: GC overhead limit exceeded
Posted by GitBox <gi...@apache.org>.
wu-sheng closed issue #7424:
URL: https://github.com/apache/skywalking/issues/7424
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #7424: GC overhead limit exceeded
Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #7424:
URL: https://github.com/apache/skywalking/issues/7424#issuecomment-895032537
`MetricsPersistentWorker` wouldn't OOM, but the whole OAP could use 20G memory(we gave 500 in default only) if in high load. I am not sure what is your case.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org