You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hive.apache.org by Zhang Xiaoyu <zh...@gmail.com> on 2013/11/02 10:21:45 UTC
Re: zookeeper error when using HS2 in Hive 0.12
anyone seen this before? BTW, I am using a tarball, not sure if any
additional configuration is needed. Thanks in advance.
Johnny
On Tue, Oct 22, 2013 at 5:38 PM, Zhang Xiaoyu <zh...@gmail.com>wrote:
> Hi, all,
> I set up below property in hive-site.xml.
>
> hive.support.concurrency=true
> hive.zookeeper.quorum=xxxxxxxx
>
> But when I HiveServer2 got multiple concurrent query. I see zookeeper
> exception in hive.log. Anyone has idea about it? Is there any additional
> configuration properties in hive 0.12 ? Since after restart HS2, the issue
> is gone, so I think it is not zk issue.
>
> 2013-10-23 00:31:50,683 WARN zookeeper.ClientCnxn
> (ClientCnxn.java:run(1057)) - Session 0x0 for server xxxxxxxxxxxxx/
> 17.198.227.144:2181, unexpected error, closing socket connection and
> attempting reconnect
> java.io.IOException: Connection reset by peer
> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)
> at sun.nio.ch.IOUtil.read(IOUtil.java:193)
> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:66)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:291)
> at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
>
> Johnny
>
Re: zookeeper error when using HS2 in Hive 0.12
Posted by Zhang Xiaoyu <zh...@gmail.com>.
I found two additional exception in HiveServer2 log, it might be the root
cause?
1.
2013-11-03 01:12:07,586 WARN *ZooKeeperHiveLockManager*
(ZooKeeperHiveLockManager.java:checkRedundantNode(633))
- Error in checkRedundantNode for node /hive_zookeeper_namespace
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hive_zookeeper_namespace
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1496)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.checkRedundantNode(ZooKeeperHiveLockManager.java:622)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.removeAllRedundantNodes(ZooKeeperHiveLockManager.java:605)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.close(ZooKeeperHiveLockManager.java:647)
at org.apache.hadoop.hive.ql.Driver.destroy(Driver.java:1567)
2.
2013-11-03 01:12:07,664 WARN *ZooKeeperHiveLockManager*
(ZooKeeperHiveLockManager.java:setContext(125))
- Unexpected ZK exception when creating parent node
/hive_zookeeper_namespace
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hive_zookeeper_namespace
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.setContext(ZooKeeperHiveLockManager.java:121)
at org.apache.hadoop.hive.ql.Driver.setLockManager(Driver.java:174)
at org.apache.hadoop.hive.ql.Driver.checkLockManager(Driver.java:146)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:985)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
On Sat, Nov 2, 2013 at 2:21 AM, Zhang Xiaoyu <zh...@gmail.com>wrote:
> anyone seen this before? BTW, I am using a tarball, not sure if any
> additional configuration is needed. Thanks in advance.
>
> Johnny
>
>
> On Tue, Oct 22, 2013 at 5:38 PM, Zhang Xiaoyu <zh...@gmail.com>wrote:
>
>> Hi, all,
>> I set up below property in hive-site.xml.
>>
>> hive.support.concurrency=true
>> hive.zookeeper.quorum=xxxxxxxx
>>
>> But when I HiveServer2 got multiple concurrent query. I see zookeeper
>> exception in hive.log. Anyone has idea about it? Is there any additional
>> configuration properties in hive 0.12 ? Since after restart HS2, the issue
>> is gone, so I think it is not zk issue.
>>
>> 2013-10-23 00:31:50,683 WARN zookeeper.ClientCnxn
>> (ClientCnxn.java:run(1057)) - Session 0x0 for server xxxxxxxxxxxxx/
>> 17.198.227.144:2181, unexpected error, closing socket connection and
>> attempting reconnect
>> java.io.IOException: Connection reset by peer
>> at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>> at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>> at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)
>> at sun.nio.ch.IOUtil.read(IOUtil.java:193)
>> at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
>> at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:66)
>> at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:291)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
>>
>> Johnny
>>
>
>