You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by GitBox <gi...@apache.org> on 2019/06/25 09:29:22 UTC
[GitHub] [skywalking] evanxuhe opened a new issue #2945: Lots of null
pointer execeptions after lose of ES data
evanxuhe opened a new issue #2945: Lots of null pointer execeptions after lose of ES data
URL: https://github.com/apache/skywalking/issues/2945
Please answer these questions before submitting your issue.
- Why do you submit this issue?
- [ ] Bug
### Bug
- Which version of SkyWalking, OS and JRE?
Lots of null pointer execeptions after lose of ES data
Because of some reasons, es data is lost while there are lots of errors repoted in oap.
After debug to oap. I found that it is because ```serviceInventoryCache.get(sourceBuilder.getSourceServiceId())```return null and after that call get Name.
**I assume it is because es has lost the instance inventory but agent still cache its instance id info.**
And i think that **oap and agent should abondon all the out-of-date segment rather than throw exceptions ,and rebuild trace info considering es data has been lost**. If my understanding is right? And if there is some method to make all agents clear cached segments before.
- Which company or project?
- What happen?
If possible, provide a way for reproducing the error. e.g. demo application, component version.
## log info
```
2019-06-25 17:18:47,350 - org.apache.skywalking.oap.server.receiver.jvm.provider.handler.JVMSourceDispatcher - 51 [grpc-default-executor-60] WARN [] - Can't found service by service instance id from cache, service instance id is: 632
2019-06-25 17:18:47,352 - org.apache.skywalking.oap.server.receiver.trace.provider.parser.SegmentParseV2 - 114 [grpc-default-executor-67] ERROR [] - null
java.lang.NullPointerException: null
2019-06-25 17:18:47,357 - org.apache.skywalking.oap.server.receiver.trace.provider.parser.SegmentParseV2 - 114 [grpc-default-executor-67] ERROR [] - null
java.lang.NullPointerException: null
2019-06-25 17:18:47,360 - org.apache.skywalking.oap.server.core.remote.client.GRPCRemoteClient - 182 [DataCarrier.GRPCRemoteClient.Consumser.0.Thread] WARN [] - Remote client block times over 60 seconds.
2019-06-25 17:18:47,360 - org.apache.skywalking.oap.server.receiver.trace.provider.parser.SegmentParseV2 - 114 [grpc-default-executor-67] ERROR [] - null
java.lang.NullPointerException: null
2019-06-25 17:18:47,365 - org.apache.skywalking.oap.server.receiver.trace.provider.parser.SegmentParseV2 - 114 [grpc-default-executor-67] ERROR [] - null
java.lang.NullPointerException: null
2019-06-25 17:18:47,369 - org.apache.skywalking.oap.server.receiver.trace.provider.parser.SegmentParseV2 - 114 [grpc-default-executor-67] ERROR [] - null
```
```java
sourceBuilder.setSourceServiceName(serviceInventoryCache.get(sourceBuilder.getSourceServiceId()).getName());
sourceBuilder.setSourceServiceInstanceName(instanceInventoryCache.get(sourceBuilder.getSourceServiceInstanceId()).getName());
sourceBuilder.setSourceEndpointName(endpointInventoryCache.get(sourceBuilder.getSourceEndpointId()).getName());
sourceBuilder.setDestServiceName(serviceInventoryCache.get(sourceBuilder.getDestServiceId()).getName());
sourceBuilder.setDestServiceInstanceName(instanceInventoryCache.get(sourceBuilder.getDestServiceInstanceId()).getName());
sourceBuilder.setDestEndpointName(endpointInventoryCache.get(sourceBuilder.getDestEndpointId()).getName());
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services