You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "angerszhu (Jira)" <ji...@apache.org> on 2020/07/27 06:47:00 UTC
[jira] [Updated] (HADOOP-17155) DF implementation of
CachingGetSpaceUsed makes DFS Used size not correct
[ https://issues.apache.org/jira/browse/HADOOP-17155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
angerszhu updated HADOOP-17155:
-------------------------------
Attachment: HADOOP-17155.1.patch
> DF implementation of CachingGetSpaceUsed makes DFS Used size not correct
> ------------------------------------------------------------------------
>
> Key: HADOOP-17155
> URL: https://issues.apache.org/jira/browse/HADOOP-17155
> Project: Hadoop Common
> Issue Type: Sub-task
> Reporter: angerszhu
> Priority: Minor
> Attachments: HADOOP-17155.1.patch
>
>
> When we calculate DN's storage used, we add each Volume's used size together and each volume's size comes from it's BP's size.
> When we use DF instead of DU, we know that DF check disk space usage (not disk size of a directory). so when check BP dir path, What you're actually checking is the corresponding disk directory space.
>
> When we use this with federation, under each volume may have more than one BP, each BP return it's corresponding disk directory space.
>
> If we have two BP under one volume, we will make DN's storage info's Used size double than real size.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org