You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Vaibhav Gumashta (JIRA)" <ji...@apache.org> on 2015/06/09 08:20:00 UTC

[jira] [Reopened] (HIVE-10453) HS2 leaking open file descriptors when using UDFs

     [ https://issues.apache.org/jira/browse/HIVE-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vaibhav Gumashta reopened HIVE-10453:
-------------------------------------

[~ychena] In our internal testing, we found that closing the classloader removes certain jars from the classpath, resulting in ClassNotFoundException. I'm reopening the jira and reverting the patch from the respective branches via the linked jira.

> HS2 leaking open file descriptors when using UDFs
> -------------------------------------------------
>
>                 Key: HIVE-10453
>                 URL: https://issues.apache.org/jira/browse/HIVE-10453
>             Project: Hive
>          Issue Type: Bug
>          Components: UDF
>            Reporter: Yongzhi Chen
>            Assignee: Yongzhi Chen
>             Fix For: 1.3.0, 1.2.1, 2.0.0
>
>         Attachments: HIVE-10453.1.patch, HIVE-10453.2.patch
>
>
> 1. create a custom function by
> CREATE FUNCTION myfunc AS 'someudfclass' using jar 'hdfs:///tmp/myudf.jar';
> 2. Create a simple jdbc client, just do 
> connect, 
> run simple query which using the function such as:
> select myfunc(col1) from sometable
> 3. Disconnect.
> Check open file for HiveServer2 by:
> lsof -p HSProcID | grep myudf.jar
> You will see the leak as:
> {noformat}
> java      28718 ychen  txt      REG                1,4        741 212977666 /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
> java      28718 ychen  330r     REG                1,4        741 212977666 /private/var/folders/6p/7_njf13d6h144wldzbbsfpz80000gp/T/1bfe3de0-ac63-4eba-a725-6a9840f1f8d5_resources/myudf.jar
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)