[jira] Commented: (HADOOP-909) dfs "du" shows that the size of a subdirectory is 0

["Hairong Kuang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12466610 ] 

Hairong Kuang commented on HADOOP-909:
--------------------------------------

After some further investigation, it turns out that the new FsShell does not handle the "du" command correctly. The size of a direcotry tree should be fetched using getContentLength not getLength.

> dfs "du" shows that the size of a subdirectory is 0
> ---------------------------------------------------
>
>                 Key: HADOOP-909
>                 URL: https://issues.apache.org/jira/browse/HADOOP-909
>             Project: Hadoop
>          Issue Type: Bug
>          Components: dfs
>    Affects Versions: 0.10.1
>            Reporter: Hairong Kuang
>         Assigned To: Hairong Kuang
>
> dfs "du" is implemented by sending a listPaths request to the namenode to get the size of each file/subdir under the directory. At the namenode side, the size of subdir was calculated by recursively going through the whole subtree with the subdir as the root. But starting from the release 0.10.0, the size of subdir is no longer gets calculated. So dfs "du" shows its size as 0.
> The problem is that both "du" and "list" send the same request "listPaths" to the  namenode. The previous implmentation made list very expensive, but the current implementation makes du not working.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.