You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Charlie Helin (JIRA)" <ji...@apache.org> on 2015/09/18 22:57:04 UTC

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

     [ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Charlie Helin updated HDFS-9110:
--------------------------------
    Attachment: HDFS-9110.00.patch

Suggested solution

> Improve upon HDFS-8480
> ----------------------
>
>                 Key: HDFS-9110
>                 URL: https://issues.apache.org/jira/browse/HDFS-9110
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>    Affects Versions: 2.7.0
>            Reporter: Charlie Helin
>            Assignee: Charlie Helin
>            Priority: Minor
>             Fix For: 2.7.0, 2.6.1
>
>         Attachments: HDFS-9110.00.patch
>
>
> This is a request to do some cosmetic improvements on top of HDFS-8480. There a couple of File -> java.nio.file.Path conversions which is a little bit distracting. 
> The second aspect is more around efficiency, to be perfectly honest I'm not sure what the number of files that may be processed. However as HDFS-8480 eludes to it appears that this number could be significantly large. 
> The current implementation is basically a collect and process where all files first is being examined; put into a collection and after that processed. HDFS-8480 could simply be further enhanced by employing a single iteration without creating an intermediary collection of filenames by using a FileWalker



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)