You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "shanyu zhao (JIRA)" <ji...@apache.org> on 2014/11/19 17:40:33 UTC

[jira] [Updated] (HIVE-8914) HDFSCleanup thread holds reference to FileSystem

     [ https://issues.apache.org/jira/browse/HIVE-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

shanyu zhao updated HIVE-8914:
------------------------------
    Attachment: HIVE-8914.patch

Patch attached.

> HDFSCleanup thread holds reference to FileSystem
> ------------------------------------------------
>
>                 Key: HIVE-8914
>                 URL: https://issues.apache.org/jira/browse/HIVE-8914
>             Project: Hive
>          Issue Type: Bug
>          Components: WebHCat
>    Affects Versions: 0.13.1
>            Reporter: shanyu zhao
>            Assignee: shanyu zhao
>         Attachments: HIVE-8914.patch
>
>
> WebHCat server has a long running cleanup thread (HDFSCleanup) which holds a reference to FileSystem. Because of this reference, many FileSystem related objects (e.g. MetricsSystemImpl) cannot be garbage collected. Sometimes this causes OOM exception. Since the cleanup is done every 12 hours by default, we can simply recreate a FileSystem when we need to use it.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)