You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/08/02 21:27:00 UTC

[jira] [Work logged] (MAPREDUCE-7401) Optimize liststatus for better performance by using recursive listing

     [ https://issues.apache.org/jira/browse/MAPREDUCE-7401?focusedWorklogId=797397&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-797397 ]

ASF GitHub Bot logged work on MAPREDUCE-7401:
---------------------------------------------

                Author: ASF GitHub Bot
            Created on: 02/Aug/22 21:26
            Start Date: 02/Aug/22 21:26
    Worklog Time Spent: 10m 
      Work Description: ashutoshcipher opened a new pull request, #4677:
URL: https://github.com/apache/hadoop/pull/4677

   ### Description of PR [PR in draft to check any stylecheck issues and others]
   
   Optimize liststatus for better performance by using recursive listing.
   
   JIRA - MAPREDUCE-7401
   
   ### How was this patch tested?
   
   Unit tests
   
   
   ### For code changes:
   
   - [X] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
   
   




Issue Time Tracking
-------------------

            Worklog Id:     (was: 797397)
    Remaining Estimate: 0h
            Time Spent: 10m

> Optimize liststatus for better performance by using recursive listing
> ---------------------------------------------------------------------
>
>                 Key: MAPREDUCE-7401
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7401
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>    Affects Versions: 3.3.3
>            Reporter: groot
>            Assignee: groot
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> This change adds recursive listing APIs to FileSystem. The purpose is to enable different FileSystem implementations optimize on the listStatus calls if they can. Default implementation is provided for normal FileSystem implementation which does level by level listing for each directory.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org