You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Ferdinand Xu (JIRA)" <ji...@apache.org> on 2014/12/04 06:21:13 UTC

[jira] [Assigned] (HIVE-4132) Connection to Zookeeper is created for each client of HS2

     [ https://issues.apache.org/jira/browse/HIVE-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ferdinand Xu reassigned HIVE-4132:
----------------------------------

    Assignee: Ferdinand Xu

> Connection to Zookeeper is created for each client of HS2
> ---------------------------------------------------------
>
>                 Key: HIVE-4132
>                 URL: https://issues.apache.org/jira/browse/HIVE-4132
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HiveServer2, Server Infrastructure
>            Reporter: Brock Noland
>            Assignee: Ferdinand Xu
>              Labels: HiveServer2
>
> Currently when concurrency is enabled and HS2 is used each client will have a connection to Zookeeper. Zookeeper has a property, maxClientCnxns, in the zoo.cfg which limits the number of connections *per* host to a low number like 50. The stack trace of the threads accessing zookeeper is below for reference.
> {noformat}
> - org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.lock(java.util.List, boolean) @bci=94, line=220 (Interpreted frame)
>  - org.apache.hadoop.hive.ql.Driver.acquireReadWriteLocks() @bci=428, line=834 (Interpreted frame)
>  - org.apache.hadoop.hive.ql.Driver.run(java.lang.String) @bci=453, line=944 (Interpreted frame)
>  - org.apache.hive.service.cli.operation.SQLOperation.run() @bci=126, line=95 (Interpreted frame)
>  - org.apache.hive.service.cli.session.HiveSessionImpl.executeStatement(java.lang.String, java.util.Map) @bci=19, line=168 (Interpreted frame)
>  - org.apache.hive.service.cli.CLIService.executeStatement(org.apache.hive.service.cli.SessionHandle, java.lang.String, java.util.Map) @bci=10, line=153 (Interpreted frame)
>  - org.apache.hive.service.cli.thrift.ThriftCLIService.ExecuteStatement(org.apache.hive.service.cli.thrift.TExecuteStatementReq) @bci=41, line=190 (Interpreted frame)
>  - org.apache.hive.service.cli.thrift.TCLIService$Processor$ExecuteStatement.getResult(org.apache.hive.service.cli.thrift.TCLIService$Iface, org.apache.hive.service.cli.thrift.TCLIService$ExecuteStatement_args) @bci=14, line=1133 (Interpreted frame)
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)