[jira] [Comment Edited] (BIGTOP-3963) merge hive memory leak PRs

["Yuqi Gu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-3963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17747237#comment-17747237 ] 

Yuqi Gu edited comment on BIGTOP-3963 at 8/4/23 3:53 AM:
---------------------------------------------------------

Thansk for working on it.
It appears these memory leak PRs of Hive hava been merged to Hive-4.X.
The Bigtop-v3.3 would upgrade Hive to 4.X.

Before Bigtop v3.3, we plan to firstly release Bigtop-v3.2.1 as the patch release to fix some issues, which would not upgrade Hive to 4.x.
We'd like apply your upcoming Hive memory leak patch into Bigtop [branch-3.2|https://github.com/apache/bigtop/tree/branch-3.2], not into master.

[~iwasakims] What you think of it?



was (Author: yqgu):
Thansk for on working on it.
It appears these memory leak PRs of Hive hava been merged to Hive-4.X.
The Bigtop-v3.3 would upgrade Hive to 4.X.

Before Bigtop v3.3, we plan to firstly release Bigtop-v3.2.1 as the patch release to fix some issues, which would not upgrade Hive to 4.x.
We'd like apply your upcoming Hive memory leak patch into Bigtop [branch-3.2|https://github.com/apache/bigtop/tree/branch-3.2], not into master.

[~iwasakims] What you think of it?


> merge hive memory leak PRs
> --------------------------
>
>                 Key: BIGTOP-3963
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3963
>             Project: Bigtop
>          Issue Type: Improvement
>          Components: hive
>    Affects Versions: 3.2.0
>            Reporter: Robin Zuo
>            Assignee: Robin Zuo
>            Priority: Major
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> Currently, Hive3 has some issues, especially following memory leak related issues, which have been blocked the usage of hive in production environment due to frequently OOM. For this reason, I'd like to merge them in patch format to bigtop project.
>  
> They are:
> HIVE-16455: ADD JAR command leaks JAR Files
> https://issues.apache.org/jira/browse/HIVE-16455
> HIVE-24236/HIVE-25483: Connection leak in TxnHandler
> https://issues.apache.org/jira/browse/HIVE-24236
> https://issues.apache.org/jira/browse/HIVE-25483
> HIVE-24552: Possible HMS connections leak or accumulation in loadDynamicPartitions
> https://issues.apache.org/jira/browse/HIVE-24552
> HIVE-24858: UDFClassLoader leak in Configuration.CACHE_CLASSES
> https://issues.apache.org/jira/browse/HIVE-24858
> HIVE-26404: HMS memory leak when compaction cleaner fails to remove obsolete files
> https://issues.apache.org/jira/browse/HIVE-26404
> HIVE-26530: HS2 OOM-OperationManager.queryIdOperation does not properly clean up multiple queryIds (This PR has been fixed in hive-3.1.3)
> https://issues.apache.org/jira/browse/HIVE-26530



--
This message was sent by Atlassian Jira
(v8.20.10#820010)