You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-dev@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/30 20:36:39 UTC

[jira] [Resolved] (HADOOP-6732) Improve FsShell's heap consumption by switching to listStatus that returns an iterator

     [ https://issues.apache.org/jira/browse/HADOOP-6732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer resolved HADOOP-6732.
--------------------------------------

    Resolution: Incomplete

I know FsShell has undergone several revisions since this JIRA was filed. Closing as stale.  If it is still an issue, let's open a new one. Hooray!

> Improve FsShell's heap consumption by switching to listStatus that returns an iterator
> --------------------------------------------------------------------------------------
>
>                 Key: HADOOP-6732
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6732
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Hairong Kuang
>            Assignee: Daryn Sharp
>
> When listing a large directory from the command line using the default heap configuration, FsShell often runs out of memory. This is because all stats of the entries under the directory need to be in memory before printing them. The new API listStatus that returns an iterator of FileStatus, which implemented in HDFS-1091, no longer requires that all entries are fetched first. Thus switching to this new API will greatly improve the use of heap space.



--
This message was sent by Atlassian JIRA
(v6.2#6252)