You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "JiangHua Zhu (Jira)" <ji...@apache.org> on 2021/12/17 03:21:00 UTC
[jira] [Created] (HDFS-16388) The namenode should check the connection channel before the RPC returns data
JiangHua Zhu created HDFS-16388:
-----------------------------------
Summary: The namenode should check the connection channel before the RPC returns data
Key: HDFS-16388
URL: https://issues.apache.org/jira/browse/HDFS-16388
Project: Hadoop HDFS
Issue Type: Improvement
Components: namanode
Affects Versions: 2.9.2
Reporter: JiangHua Zhu
Some RBF-related information has been reported in HDFS-15078 and HDFS-15079, which may be similar to the situation here.
When the client connects to the NameNode, such as creating a file, sometimes RPC will prompt some exception information:
2021-12-15 14:57:14,502 [2246654536] - WARN [IPC Server handler 58 on 8025:Server$Responder@1518] - IPC Server handler 58 on 8025, call Call#870382577 Retry#0 org.apache.hadoop.hdfs.protocol.ClientProtocol.addBlock from 10.196.73.49:33700: output error
2021-12-15 14:57:14,502 [2246654536] - INFO [IPC Server handler 58 on 8025:Server$Handler@2619] - IPC Server handler 58 on 8025 caught an exception
java.nio.channels.ClosedChannelException
at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:270)
at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:461)
at org.apache.hadoop.ipc.Server.channelWrite(Server.java:3173)
at org.apache.hadoop.ipc.Server.access$1700(Server.java:136)
at org.apache.hadoop.ipc.Server$Responder.processResponse(Server.java:1468)
at org.apache.hadoop.ipc.Server$Responder.doRespond(Server.java:1538)
at org.apache.hadoop.ipc.Server$Connection.sendResponse(Server.java:2517)
at org.apache.hadoop.ipc.Server$Connection.access$300(Server.java:1610)
at org.apache.hadoop.ipc.Server$RpcCall.doResponse(Server.java:935)
at org.apache.hadoop.ipc.Server$Call.sendResponse(Server.java:769)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:880)
at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:817)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2606)
This information exists in the log recorded by the NameNode, which is somewhat different from HDFS-15078&HDFS-15079, but they have a common feature, that is, they all appear when accessing RPC.
I think this problem can be solved in a unified way.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org