You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "angerszhu (Jira)" <ji...@apache.org> on 2020/07/27 06:25:00 UTC

[jira] [Created] (HADOOP-17155) DF implementation of CachingGetSpaceUsed makes DFS Used size not correct

angerszhu created HADOOP-17155:
----------------------------------

             Summary: DF implementation of CachingGetSpaceUsed makes DFS Used size not correct
                 Key: HADOOP-17155
                 URL: https://issues.apache.org/jira/browse/HADOOP-17155
             Project: Hadoop Common
          Issue Type: Sub-task
            Reporter: angerszhu


When   we calculate DN's storage used, we add each Volume's used size together and each volume's size comes from it's BP's size. 

When we use DF instead of DU, we know that DF check disk space usage (not disk size of a directory). so when check BP dir path,  What you're actually checking is the corresponding disk directory space. 

 

When we use this with federation, under each volume  may have more than one BP, each BP return it's corresponding disk directory space. 

 

If we have two BP under one volume, we will make DN's storage info's Used size double than real size.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org