You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Kristam Subba Swathi (JIRA)" <ji...@apache.org> on 2012/06/19 12:56:42 UTC

[jira] [Created] (HIVE-3155) Memory leak in Hive

Kristam Subba Swathi created HIVE-3155:
------------------------------------------

             Summary: Memory leak in Hive
                 Key: HIVE-3155
                 URL: https://issues.apache.org/jira/browse/HIVE-3155
             Project: Hive
          Issue Type: Bug
    Affects Versions: 0.9.0
            Reporter: Kristam Subba Swathi


Start the hive in server mode (Hive 0.9 with hadoop 0.23)
Run the sample application containing all queries 
After running the application for 20 hours ,it is found the each time new DFS client object is getting created .Due to this there are so many objects getting added into ArrayList maintained by LeaseRenewer.This internally leads to Memory leak.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3155) Memory leak in Hive

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398062#comment-13398062 ] 

Ashutosh Chauhan commented on HIVE-3155:
----------------------------------------

@Swathi,

* Are you running in secure mode or non-secure mode?
* Are you running metastore as separate process or embedded within HiveServer?
                
> Memory leak in Hive
> -------------------
>
>                 Key: HIVE-3155
>                 URL: https://issues.apache.org/jira/browse/HIVE-3155
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Kristam Subba Swathi
>
> Start the hive in server mode (Hive 0.9 with hadoop 0.23)
> Run the sample application containing all queries 
> After running the application for 20 hours ,it is found the each time new DFS client object is getting created .Due to this there are so many objects getting added into ArrayList maintained by LeaseRenewer.This internally leads to Memory leak.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3155) Memory leak in Hive

Posted by "Kristam Subba Swathi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398200#comment-13398200 ] 

Kristam Subba Swathi commented on HIVE-3155:
--------------------------------------------

Hi @Ashutosh,
Am running in non-secure mode 
I guess this is mainly due to HDFS-3545.So closure of HDFS-3545 will resolve this issue.
                
> Memory leak in Hive
> -------------------
>
>                 Key: HIVE-3155
>                 URL: https://issues.apache.org/jira/browse/HIVE-3155
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Kristam Subba Swathi
>
> Start the hive in server mode (Hive 0.9 with hadoop 0.23)
> Run the sample application containing all queries 
> After running the application for 20 hours ,it is found the each time new DFS client object is getting created .Due to this there are so many objects getting added into ArrayList maintained by LeaseRenewer.This internally leads to Memory leak.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HIVE-3155) Memory leak in Hive

Posted by "Kristam Subba Swathi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13398203#comment-13398203 ] 

Kristam Subba Swathi commented on HIVE-3155:
--------------------------------------------

Hi@Ashutosh
Am running metastore embedded within HiveServer
                
> Memory leak in Hive
> -------------------
>
>                 Key: HIVE-3155
>                 URL: https://issues.apache.org/jira/browse/HIVE-3155
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Kristam Subba Swathi
>
> Start the hive in server mode (Hive 0.9 with hadoop 0.23)
> Run the sample application containing all queries 
> After running the application for 20 hours ,it is found the each time new DFS client object is getting created .Due to this there are so many objects getting added into ArrayList maintained by LeaseRenewer.This internally leads to Memory leak.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira