You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Sammi Chen (Jira)" <ji...@apache.org> on 2020/08/04 04:11:00 UTC
[jira] [Created] (HDDS-4060) Clean up OM Rpc handler NPE Log
Sammi Chen created HDDS-4060:
--------------------------------
Summary: Clean up OM Rpc handler NPE Log
Key: HDDS-4060
URL: https://issues.apache.org/jira/browse/HDDS-4060
Project: Hadoop Distributed Data Store
Issue Type: Bug
Reporter: Sammi Chen
There a lot of Rpc NPE Log after OM restart. The root cause is http server is not started yet when RPC request arrives.
The NPE is thrown out from line
if (httpServer.getHttpAddress() != null) {
2020-07-30 22:22:07,350 [IPC Server handler 16 on default port 9862] WARN org.apache.hadoop.ipc.Server: IPC Server handler 16 on default port 9862, call Call#143754 Retry#1 org.apache.hadoop.ozone.om.protocol.OzoneManagerProtocol.submitRequest from 9.180.8.85:50503
java.lang.NullPointerException
at org.apache.hadoop.ozone.om.OzoneManager.getServiceList(OzoneManager.java:2505)
at org.apache.hadoop.ozone.om.OzoneManager.getServiceInfo(OzoneManager.java:2578)
at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.getServiceList(OzoneManagerRequestHandler.java:451)
at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.handleReadRequest(OzoneManagerRequestHandler.java:176)
at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequestDirectlyToOM(OzoneManagerProtocolServerSideTranslatorPB.java:218)
at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.processRequest(OzoneManagerProtocolServerSideTranslatorPB.java:145)
at org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:74)
at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequest(OzoneManagerProtocolServerSideTranslatorPB.java:113)
at org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OzoneManagerService$2.callBlockingMethod(OzoneManagerProtocolProtos.java)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1070)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:999)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:927)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2915)
2020-07-30 22:22:07,382 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: Starting Web-server for ozoneManager at: http://0.0.0.0:18080
2020-07-30 22:22:07,383 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: Hadoop Security Enabled: false Ozone Security Enabled: false Ozone HTTP Security Enabled: false
2020-07-30 22:22:07,403 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.util.log: Logging initialized @5333ms to org.eclipse.jetty.util.log.Slf4jLog
2020-07-30 22:22:07,484 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
2020-07-30 22:22:07,487 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpRequestLog: Http request log for http.requests.ozoneManager is not defined
2020-07-30 22:22:07,492 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.hdds.server.http.HttpServer2$QuotingInputFilter)
2020-07-30 22:22:07,493 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context ozoneManager
2020-07-30 22:22:07,493 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2020-07-30 22:22:07,493 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2020-07-30 22:22:07,519 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: HTTP server of ozoneManager uses base directory /data1/ozone/
2020-07-30 22:22:07,520 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Jetty bound to port 18080
2020-07-30 22:22:07,521 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.Server: jetty-9.4.26.v20200117; built: 2020-01-17T12:35:33.676Z; git: 7b38981d25d14afb4a12ff1f2596756144edf695; jvm 1.8.0_232-86
2020-07-30 22:22:07,546 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.session: DefaultSessionIdManager workerName=node0
2020-07-30 22:22:07,546 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.session: No SessionScavenger set, using defaults
2020-07-30 22:22:07,548 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.session: node0 Scavenging every 600000ms
2020-07-30 22:22:07,556 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@54acff7d{logs,/logs,file:///data/ozoneadmin/ozoneenv/ozone/logs/,AVAILABLE}
2020-07-30 22:22:07,557 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@712ca57b{static,/static,jar:file:/data/ozoneadmin/ozoneenv/ozone/share/ozone/lib/hadoop-ozone-ozone-manager-0.6.0-SNAPSHOT.jar!/webapps/static,AVAILABLE}
2020-07-30 22:22:07,640 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@783ec989{ozoneManager,/,file:///data1/ozone/jetty-0_0_0_0-18080-hadoop-ozone-ozone-manager-0_6_0-SNAPSHOT_jar-_-any-8886437637791744930.dir/webapp/,AVAILABLE}{jar:file:/data/ozoneadmin/ozoneenv/ozone/share/ozone/lib/hadoop-ozone-ozone-manager-0.6.0-SNAPSHOT.jar!/webapps/ozoneManager}
2020-07-30 22:22:07,651 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@203dd56b{HTTP/1.1,[http/1.1]}{0.0.0.0:18080}
2020-07-30 22:22:07,652 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.Server: Started @5582ms
2020-07-30 22:22:07,654 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter: Sink prometheus started
2020-07-30 22:22:07,654 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered sink prometheus
2020-07-30 22:22:07,654 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: HTTP server of ozoneManager listening at http://0.0.0.0:18080
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org