You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Karen Coppage (Jira)" <ji...@apache.org> on 2021/03/08 14:48:00 UTC
[jira] [Assigned] (HIVE-24858) UDFClassLoader leak in session
HiveConf
[ https://issues.apache.org/jira/browse/HIVE-24858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karen Coppage reassigned HIVE-24858:
------------------------------------
> UDFClassLoader leak in session HiveConf
> ---------------------------------------
>
> Key: HIVE-24858
> URL: https://issues.apache.org/jira/browse/HIVE-24858
> Project: Hive
> Issue Type: Bug
> Reporter: Karen Coppage
> Assignee: Karen Coppage
> Priority: Major
>
> If a UDF jar has been registered in a session and a temporary function created from it, when the session is closed its UDFClassLoader is not GC'd as it has been leaked to the session's HiveConf object's cache. Since the ClassLoader is not GC'd, the UDF jar's classes aren't GC'd from Metaspace. This can potentially lead to Metaspace OOM.
> Path to GC root is:
> {code:java}
> Class Name | Shallow Heap | Retained Heap
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------
> contextClassLoader org.apache.hive.service.server.ThreadWithGarbageCleanup @ 0x7164deb50 HiveServer2-Handler-Pool: Thread-72 Thread| 128 | 79,072
> referent java.util.WeakHashMap$Entry @ 0x7164e67d0 | 40 | 824
> '- [6] java.util.WeakHashMap$Entry[16] @ 0x71581aac0 | 80 | 5,056
> '- table java.util.WeakHashMap @ 0x71580f510 | 48 | 6,920
> '- CACHE_CLASSES class org.apache.hadoop.conf.Configuration @ 0x71580f3d8 | 64 | 74,528
> -------------------------------------------------------------------------------------------------------------------------------------------------------------------
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)