[jira] [Commented] (HDFS-16047) getContentSummary return incorrect filecount

["Steve Loughran (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HDFS-16047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17353302#comment-17353302 ] 

Steve Loughran commented on HDFS-16047:
---------------------------------------

moving to HDFS. the base hadoop summary is a treewalk, so unless things change during the walk it should be complete. HDFS has its own optimisations to avoid a user overloading the store. Maybe its some caching thing or a side effect of the optimisation.



> getContentSummary return incorrect filecount
> --------------------------------------------
>
>                 Key: HDFS-16047
>                 URL: https://issues.apache.org/jira/browse/HDFS-16047
>             Project: Hadoop HDFS
>          Issue Type: Bug
>          Components: dfsclient
>    Affects Versions: 2.7.7
>         Environment: HDP:2.7.7
>            Reporter: philipse
>            Priority: Minor
>
> Hi team
> I got a strange test result when I get hdfs statistics ,the test process shows below. 
> Any advice will be appreciated ,Thanks in advance.
> {code:java}
> 1、hdfs dfs -count /data/BaseData/Log/mq/2018/02/09/,it shows we have 100 file
> 1          100         9689234070 /data/BaseData/Log/mq/2018/02/09/
> 2、hdfs dfs -ls  /data/BaseData/Log/mq/2018/02/09/ ,it shows we have only 98 items
> Found 98 items
> 3、hdfs dfs -cp /data/BaseData/Log/mq/2018/02/09/* /data/BaseData/Log/mq_test/2018/02/09/
> 4、hdfs dfs -count /data/BaseData/Log/mq_test/2018/02/09/ ,it shows we have 98 items too
> 1           98         9689234070 /data/dpdcadmin/gf13871/test20210528
> 5、hdfs dfs -ls /data/BaseData/Log/mq_test/2018/02/09/ ,it shows we have 98 items
> Found 98 items
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-help@hadoop.apache.org