You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Vivek Ghatala (JIRA)" <ji...@apache.org> on 2017/10/18 17:38:00 UTC
[jira] [Created] (HDFS-12679) Namenode stale memory Datanode gets
Wipes out
Vivek Ghatala created HDFS-12679:
------------------------------------
Summary: Namenode stale memory Datanode gets Wipes out
Key: HDFS-12679
URL: https://issues.apache.org/jira/browse/HDFS-12679
Project: Hadoop HDFS
Issue Type: Bug
Components: namenode
Affects Versions: 2.8.1
Reporter: Vivek Ghatala
Namenode stale mapping information about datanodes commands wiping out datanode.
LOG LINES:
2017-10-11 23:01:45,969 DEBUG org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: remove datanode XXX.XX.XX.1:YYYYY
2017-10-11 23:01:45,969 DEBUG org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager: DatanodeManager.wipeDatanode(XXX.XX.XX.1:YYYYY): storage ##STORAGE_ID1## is removed from datanodeMap.
Scenario: Our environment uses shared storage. Whenever some datanode restarts, some other node comes up with that storage with different Ip address. It is possible that multiple datanodes restarts at same time.
Case: the node 1 serving some storage X is now serving storage Y. node 2 comes up and is serving storage X now. Namenode here commands storage Y to get wiped out.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org