You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Sammi Chen (Jira)" <ji...@apache.org> on 2020/08/06 02:40:00 UTC

[jira] [Resolved] (HDDS-4060) Clean up OM Rpc handler NPE Log

     [ https://issues.apache.org/jira/browse/HDDS-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sammi Chen resolved HDDS-4060.
------------------------------
    Resolution: Duplicate

> Clean up OM Rpc handler NPE Log
> -------------------------------
>
>                 Key: HDDS-4060
>                 URL: https://issues.apache.org/jira/browse/HDDS-4060
>             Project: Hadoop Distributed Data Store
>          Issue Type: Bug
>            Reporter: Sammi Chen
>            Assignee: Sammi Chen
>            Priority: Major
>
> There a lot of Rpc NPE Log after OM restart. The root cause is http server is not started yet when RPC request arrives. 
> The NPE is thrown out from line
> if (httpServer.getHttpAddress() != null) {
> java.lang.NullPointerException
>         at org.apache.hadoop.ozone.om.OzoneManager.getServiceList(OzoneManager.java:2505)
>         at org.apache.hadoop.ozone.om.OzoneManager.getServiceInfo(OzoneManager.java:2578)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.getServiceList(OzoneManagerRequestHandler.java:451)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.handleReadRequest(OzoneManagerRequestHandler.java:176)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequestDirectlyToOM(OzoneManagerProtocolServerSideTranslatorPB.java:218)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.processRequest(OzoneManagerProtocolServerSideTranslatorPB.java:145)
>         at org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:74)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequest(OzoneManagerProtocolServerSideTranslatorPB.java:113)
>         at org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OzoneManagerService$2.callBlockingMethod(OzoneManagerProtocolProtos.java)
>         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1070)
>         at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:999)
>         at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:927)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2915)
> java.lang.NullPointerException
>         at org.apache.hadoop.ozone.om.OzoneManager.getServiceList(OzoneManager.java:2505)
>         at org.apache.hadoop.ozone.om.OzoneManager.getServiceInfo(OzoneManager.java:2578)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.getServiceList(OzoneManagerRequestHandler.java:451)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerRequestHandler.handleReadRequest(OzoneManagerRequestHandler.java:176)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequestDirectlyToOM(OzoneManagerProtocolServerSideTranslatorPB.java:218)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.processRequest(OzoneManagerProtocolServerSideTranslatorPB.java:145)
>         at org.apache.hadoop.hdds.server.OzoneProtocolMessageDispatcher.processRequest(OzoneProtocolMessageDispatcher.java:74)
>         at org.apache.hadoop.ozone.protocolPB.OzoneManagerProtocolServerSideTranslatorPB.submitRequest(OzoneManagerProtocolServerSideTranslatorPB.java:113)
>         at org.apache.hadoop.ozone.protocol.proto.OzoneManagerProtocolProtos$OzoneManagerService$2.callBlockingMethod(OzoneManagerProtocolProtos.java)
>         at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:528)
>         at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1070)
>         at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:999)
>         at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:927)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2915)
> 2020-07-30 22:22:07,382 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: Starting Web-server for ozoneManager at: http://0.0.0.0:18080
> 2020-07-30 22:22:07,383 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: Hadoop Security Enabled: false Ozone Security Enabled: false Ozone HTTP Security Enabled: false
> 2020-07-30 22:22:07,403 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.util.log: Logging initialized @5333ms to org.eclipse.jetty.util.log.Slf4jLog
> 2020-07-30 22:22:07,484 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.security.authentication.server.AuthenticationFilter: Unable to initialize FileSignerSecretProvider, falling back to use random secrets.
> 2020-07-30 22:22:07,487 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpRequestLog: Http request log for http.requests.ozoneManager is not defined
> 2020-07-30 22:22:07,492 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added global filter 'safety' (class=org.apache.hadoop.hdds.server.http.HttpServer2$QuotingInputFilter)
> 2020-07-30 22:22:07,493 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context ozoneManager
> 2020-07-30 22:22:07,493 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
> 2020-07-30 22:22:07,493 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
> 2020-07-30 22:22:07,519 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: HTTP server of ozoneManager uses base directory /data1/ozone/
> 2020-07-30 22:22:07,520 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.HttpServer2: Jetty bound to port 18080
> 2020-07-30 22:22:07,521 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.Server: jetty-9.4.26.v20200117; built: 2020-01-17T12:35:33.676Z; git: 7b38981d25d14afb4a12ff1f2596756144edf695; jvm 1.8.0_232-86
> 2020-07-30 22:22:07,546 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.session: DefaultSessionIdManager workerName=node0
> 2020-07-30 22:22:07,546 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.session: No SessionScavenger set, using defaults
> 2020-07-30 22:22:07,548 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.session: node0 Scavenging every 600000ms
> 2020-07-30 22:22:07,556 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@54acff7d{logs,/logs,file:///data/ozoneadmin/ozoneenv/ozone/logs/,AVAILABLE}
> 2020-07-30 22:22:07,557 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.s.ServletContextHandler@712ca57b{static,/static,jar:file:/data/ozoneadmin/ozoneenv/ozone/share/ozone/lib/hadoop-ozone-ozone-manager-0.6.0-SNAPSHOT.jar!/webapps/static,AVAILABLE}
> 2020-07-30 22:22:07,640 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.handler.ContextHandler: Started o.e.j.w.WebAppContext@783ec989{ozoneManager,/,file:///data1/ozone/jetty-0_0_0_0-18080-hadoop-ozone-ozone-manager-0_6_0-SNAPSHOT_jar-_-any-8886437637791744930.dir/webapp/,AVAILABLE}{jar:file:/data/ozoneadmin/ozoneenv/ozone/share/ozone/lib/hadoop-ozone-ozone-manager-0.6.0-SNAPSHOT.jar!/webapps/ozoneManager}
> 2020-07-30 22:22:07,651 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.AbstractConnector: Started ServerConnector@203dd56b{HTTP/1.1,[http/1.1]}{0.0.0.0:18080}
> 2020-07-30 22:22:07,652 [Listener at 10.51.87.181/9862] INFO org.eclipse.jetty.server.Server: Started @5582ms
> 2020-07-30 22:22:07,654 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter: Sink prometheus started
> 2020-07-30 22:22:07,654 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Registered sink prometheus
> 2020-07-30 22:22:07,654 [Listener at 10.51.87.181/9862] INFO org.apache.hadoop.hdds.server.http.BaseHttpServer: HTTP server of ozoneManager listening at http://0.0.0.0:18080



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org