You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Rakesh Radhakrishnan (Jira)" <ji...@apache.org> on 2022/05/25 05:49:00 UTC
[jira] [Commented] (HDDS-6474) File system optimized bucket list status file number inconsistent
[ https://issues.apache.org/jira/browse/HDDS-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17541832#comment-17541832 ]
Rakesh Radhakrishnan commented on HDDS-6474:
--------------------------------------------
Thanks [~aswinshakil] for continuous efforts and for the patch.
As there is another parallel work HDDS-6788 going on to implement sorted order logic in listStatus() and listKeys() APIs, you will need to refactor your patch accordingly. The proposed seek algorithm in that patch is a completely new idea. We need to test this scenario on top of [that PR|https://github.com/apache/ozone/pull/3444]. Appreciate if you could test your changes with that PR and review it.
> File system optimized bucket list status file number inconsistent
> -----------------------------------------------------------------
>
> Key: HDDS-6474
> URL: https://issues.apache.org/jira/browse/HDDS-6474
> Project: Apache Ozone
> Issue Type: Bug
> Affects Versions: 1.2.0
> Reporter: mengqi
> Assignee: Aswin Shakil Balasubramanian
> Priority: Major
> Labels: pull-request-available
>
> I put 10000 file （file name is 0001 - 10000） to a File system optimized bucket dir /user/filesystemoptimizedbucket/test and list the dir ，found something wrong.
> ./bin/ozone fs -ls /user/filesystemoptimizedbucket/test | wc -l
> only 5000+ files found , not 10000。 so I read the source code ,and found the issue in the function org.apache.hadoop.ozone.om.KeyManagerImpl#getFilesFromDirectory
> after listStatusFindFilesInTableCache, countEntries should be set into 0. so we can find all files from keyTable.iterator .
> I fix the issue, someone can review it ?
> [fix fso list|https://github.com/Mengqi777/ozone/commit/df3097388c89bec06e433f945dce271f4d4c2212]
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org