You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "hezhang (JIRA)" <ji...@apache.org> on 2018/10/28 13:48:00 UTC
[jira] [Comment Edited] (HIVE-20824) HiveServer2 is still leaking
file handles when using ADD JAR
[ https://issues.apache.org/jira/browse/HIVE-20824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16666402#comment-16666402 ]
hezhang edited comment on HIVE-20824 at 10/28/18 1:47 PM:
----------------------------------------------------------
[~aihuaxu] hi
What do you think of this question?
thanks :D
was (Author: heiheizhang):
[~aihuaxu] hi
What do you think of this question?
> HiveServer2 is still leaking file handles when using ADD JAR
> -------------------------------------------------------------
>
> Key: HIVE-20824
> URL: https://issues.apache.org/jira/browse/HIVE-20824
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
> Affects Versions: 2.1.1
> Reporter: hezhang
> Priority: Major
>
> In Hive version 2.1.1, hiveserver2 is stll leaking jar file handle when using add jar . When using UDF jar and creating function with this jar, the jar file will not delete.
> {noformat}
> Beeline version 2.1.1 by Apache Hive
> 0: jdbc:hive2://localhost:7001/> add jar hdfs:///udf/UDF-1.0-SNAPSHOT.jar;No rows affected (0.45 seconds)
> 0: jdbc:hive2://localhost:7001/> create temporary function my_md5 as 'com.neu.hive.UDF.Md5';No rows affected (0.082 seconds)
> 0: jdbc:hive2://localhost:7001/> select my_md5(name) from test;+-----------------------------------+--+
> | c0 |
> +-----------------------------------+--+
> | ad6f6c09bd4accc056568714692ff4cd |
> | 836db9ecc83d8397a5d0205eb8344d4c |
> | 5a7fcd4f1c785c8ef4931a5a9c698ac0 |
> | 0e2bb4d743f2a009d4b84a9338c98f7c |
> | 3f6697692f4506cf311c95848f3536d3 |
> | 0de5fc94d0ba53fc7a44f0f136e82fbb |
> | 04ef3e58a6b569c1a404efb90d50f906 |
> | f505e0a965c8e721eef7e111c66e5c29 |
> | c053092216d6f623615d5be978b98e67 |
> | 8c2c58079bc3d10be0da79c5d9940f31 |
> +-----------------------------------+--+
> 10 rows selected (0.12 seconds)
> {noformat}
> the hiveserver2 PID is 3856，then list the file handle.
> {noformat}
> [hadoop@10 ~]$ lsof -p 3856 | grep SNAPSHOT.jar
> java 3856 hadoop DEL REG 252,16 263184 /data/emr/hive/tmp/2f3bc7b2-c385-4552-a54e-b575b4338d63_resources/UDF-1.0-SNAPSHOT.jar
> java 3856 hadoop DEL REG 252,16 263178 /data/emr/hive/tmp/986015db-52bf-4f6a-99f8-977de471d528_resources/UDF-4.0-SNAPSHOT.jar
> java 3856 hadoop 774r REG 252,16 90885742 263178 /data/emr/hive/tmp/986015db-52bf-4f6a-99f8-977de471d528_resources/UDF-4.0-SNAPSHOT.jar (deleted)
> java 3856 hadoop 775r REG 252,16 104220075 263184 /data/emr/hive/tmp/2f3bc7b2-c385-4552-a54e-b575b4338d63_resources/UDF-1.0-SNAPSHOT.jar (deleted)
> {noformat}
>
>
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)