You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Cristina L. Abad (JIRA)" <ji...@apache.org> on 2013/08/05 22:30:48 UTC

[jira] [Updated] (HADOOP-9757) Har metadata cache can grow without limit

     [ https://issues.apache.org/jira/browse/HADOOP-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Cristina L. Abad updated HADOOP-9757:
-------------------------------------

    Attachment: HADOOP_9757.trunk.patch
                HADOOP_9757.branch-2.patch

Attaching patches for trunk and branch 2 (they are identical; the patch for branch 23 is slightly different but just due to changes in line # where hunks are applied). Also made sure that patch for branch 23 still applies without errors.
                
> Har metadata cache can grow without limit
> -----------------------------------------
>
>                 Key: HADOOP-9757
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9757
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 2.0.4-alpha, 0.23.9
>            Reporter: Jason Lowe
>            Assignee: Cristina L. Abad
>         Attachments: HADOOP_9757.branch23.patch, HADOOP_9757.branch-2.patch, HADOOP_9757.trunk.patch
>
>
> MAPREDUCE-2459 added a metadata cache to the har filesystem, but the cache has no upper limits.  A long-running process that accesses many har archives will eventually run out of memory due to a har metadata cache that never retires entries.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira