Error and warnings on HBaseTestingUtil.shutdownMiniCluster

[Stephen Boesch <ja...@gmail.com>]

HI,
  I have created a testcase that includes using the
HBaseTestingUtility.startMiniCluster and .shutdownMiniCluster.

The test passes, but the shutdownMiniCluster is not clean.  The following
is the output.  There are two questions about the error/warnings:

a)  Is there a way to fix  the Error : "Connection not found in the list"
b) Are the warnings expected?

I am uncertain of (b) because logging (log4j.properties) seems to be tricky
to get working properly, and I have not been successful on that. Therefore,
when running the existing HBase testcases I do not know whether those
warnings are showing up (but suppressed) or not.

Here is the output directly after invoking
hbaseTestingUtil.shutdownMiniCluster()



EndOfStreamException: Unable to read additional data from client sessionid
0x149d506b3620008, likely client has closed socket
at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
at java.lang.Thread.run(Thread.java:695)
17:03:58.627 WARN org.apache.zookeeper.server.NIOServerCnxn: caught end of
stream exception
EndOfStreamException: Unable to read additional data from client sessionid
0x149d506b3620006, likely client has closed socket
at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
at
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
at java.lang.Thread.run(Thread.java:695)
17:03:58.628 ERROR org.apache.hadoop.hbase.client.HConnectionManager:
Connection not found in the list, can't delete it (connection
key=HConnectionKey{properties={hbase.rpc.timeout=60000,
hbase.zookeeper.property.clientPort=64150, hbase.client.pause=100,
zookeeper.znode.parent=/hbase, hbase.client.retries.number=350,
hbase.zookeeper.quorum=localhost}, username='steve'}). May be the key was
modified?
java.lang.Exception
at
org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:488)
at
org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:424)
at
org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.stop(ReplicationLogCleaner.java:141)
at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.cleanup(CleanerChore.java:276)
at org.apache.hadoop.hbase.Chore.run(Chore.java:94)
at java.lang.Thread.run(Thread.java:695)
17:03:58.734 WARN org.apache.hadoop.hdfs.server.datanode.DirectoryScanner:
DirectoryScanner: shutdown has been called
17:03:58.849 WARN org.apache.hadoop.hdfs.server.datanode.DataNode:
BPOfferService for Block pool BP-397076614-192.168.255.170-1416618224199
(storage id DS-501447446-192.168.255.170-64236-1416618226076) service to
localhost/127.0.0.1:64231 interrupted
17:03:58.849 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending
block pool service for: Block pool
BP-397076614-192.168.255.170-1416618224199 (storage id
DS-501447446-192.168.255.170-64236-1416618226076) service to localhost/
127.0.0.1:64231
17:03:58.852 WARN org.apache.hadoop.hdfs.server.datanode.DirectoryScanner:
DirectoryScanner: shutdown has been called
17:03:58.858 WARN org.apache.hadoop.hdfs.server.datanode.DataNode:
BPOfferService for Block pool BP-397076614-192.168.255.170-1416618224199
(storage id DS-144340759-192.168.255.170-64233-1416618225968) service to
localhost/127.0.0.1:64231 interrupted
17:03:58.858 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending
block pool service for: Block pool
BP-397076614-192.168.255.170-1416618224199 (storage id
DS-144340759-192.168.255.170-64233-1416618225968) service to localhost/
127.0.0.1:64231
17:03:58.861 WARN
org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager: Monitor
interrupted: java.lang.InterruptedException: sleep interrupted
HBaseMiniCluster was shutdown
17:03:59.015 INFO org.apache.spark.scheduler.DAGScheduler: Stopping
DAGScheduler
17:03:59.287 WARN org.apache.zookeeper.ClientCnxn: Session
0x149d506b3620003 for server null, unexpected error, closing socket
connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
17:04:00.075 INFO org.apache.spark.MapOutputTrackerMasterActor:
MapOutputTrackerActor stopped!
17:04:00.078 INFO org.apache.spark.network.nio.ConnectionManager: Selector
thread was interrupted!
17:04:00.079 INFO org.apache.spark.network.nio.ConnectionManager:
ConnectionManager stopped
17:04:00.081 INFO org.apache.spark.storage.MemoryStore: MemoryStore cleared
17:04:00.084 INFO org.apache.spark.storage.BlockManager: BlockManager
stopped
17:04:00.084 INFO org.apache.spark.storage.BlockManagerMaster:
BlockManagerMaster stopped
17:04:00.086 INFO org.apache.spark.SparkContext: Successfully stopped
SparkContext
17:04:00.086 INFO org.apache.spark.sql.hbase.HBaseStartupShutdownSuite:
Completed testcase cleanup
Completed testcase cleanup
17:04:00.093 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator:
Shutting down remote daemon.
17:04:00.095 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator:
Remote daemon shut down; proceeding with flushing remote transports.
17:04:00.162 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator:
Remoting shut down.
17:04:00.202 WARN org.apache.zookeeper.ClientCnxn: Session
0x149d506b3620003 for server null, unexpected error, closing socket
connection and attempting reconnect
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:599)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)