You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by V_sriram <vs...@gmail.com> on 2012/01/13 10:08:38 UTC
HMaster region not reallocated in HBase 0.90.4
I am using HBase 0.90.4. When one of the region server is brought down, the
HMaster doesnot reallocate the regions and the regions are lost.
This issue was mentioned in the following posts as well. But that issue was
prevalent in HBase 0.90.3 and lesser versions. But it was mentioned to be
resolved. But still facing the region reallocation issue.
http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/20073
https://issues.apache.org/jira/browse/HBASE-4109
Any ideas plz??
--
View this message in context: http://old.nabble.com/HMaster-region-not-reallocated-in-HBase-0.90.4-tp33132952p33132952.html
Sent from the HBase User mailing list archive at Nabble.com.
RE: HMaster region not reallocated in HBase 0.90.4
Posted by V_sriram <vs...@gmail.com>.
Hi Ram,
I too expected that to happen. But instead of reallocating the regions, the
HMAster loses the regions present in the killed region server.
HMaster log trace:
-01-12 22:19:18,586 DEBUG org.apache.hadoop.hbase.master.AssignmentManager:
Handling transition=M_ZK_REGION_OFFLINE, server=Namenode:60000,
region=72901a68e2a989a6eaa84abf3c8d50e9
2012-01-12 22:19:18,586 WARN
org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment of
usertable,user2284740271004412903,1326379492626.72901a68e2a989a6eaa84abf3c8d50e9.
to serverName=killedServer,60020,1326381603926, load=(requests=0, regions=0,
usedHeap=0, maxHeap=0), trying to assign elsewhere instead; retry=0
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:404)
at
org.apache.hadoop.hbase.ipc.HBaseClient$Connection.setupIOstreams(HBaseClient.java:328)
at
org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:883)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:750)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
at $Proxy6.openRegion(Unknown Source)
at
org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:561)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1043)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:858)
at
org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:838)
at
org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:92)
at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:156)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
2012-01-12 22:19:18,587 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: No previous transition
plan was found (or we are ignoring an existing plan) for
usertable,user2284740271004412903,1326379492626.72901a68e2a989a6eaa84abf3c8d50e9.
so generated a random one;
hri=usertable,user2284740271004412903,1326379492626.72901a68e2a989a6eaa84abf3c8d50e9.,
src=, dest=hdindex005mwh,60020,1326434624928; 5 (online=5,
exclude=serverName=killedServer,60020,1326381603926, load=(requests=0,
regions=0, usedHeap=0, maxHeap=0)) available servers
2012-01-12 22:19:18,587 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign:
master:60000-0x133687c8252017b Creating (or updating) unassigned node for
72901a68e2a989a6eaa84abf3c8d50e9 with OFFLINE state
2012-01-12 22:19:18,591 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=RS_ZK_REGION_OPENING, server=hdindex002mwh,60020,1326381241252,
region=c9ae9fead42096e189a829ad4dfd79c0
2012-01-12 22:19:18,598 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Handling
transition=M_ZK_REGION_OFFLINE, server=Masterserver:60000,
region=57d4bf6d229a431ab09bb485d2837785
2012-01-12 22:19:18,598 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing plan
for region
usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.;
plan=hri=usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.,
src=hdindex002mwh,60020,1326381241252,
dest=hdindex003mwh.io.askjeeves.info,60020,1326381603926
2012-01-12 22:19:18,598 DEBUG
org.apache.hadoop.hbase.master.AssignmentManager: Assigning region
usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.
to killedServer,60020,1326381603926
2012-01-12 22:19:18,598 WARN
org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment of
usertable,user5389186088818390871,1326379352763.57d4bf6d229a431ab09bb485d2837785.
to serverName=killedServer,60020,1326381603926, load=(requests=0, regions=0,
usedHeap=0, maxHeap=0), trying to assign elsewhere instead; retry=0
Hi Sriram
What is the problem that you are getting ? Any exceptions in logs?
Ideally the master will reallocate all the regions belonging to the region
server that
Went down.
Regards
Ram
--
View this message in context: http://old.nabble.com/HMaster-region-not-reallocated-in-HBase-0.90.4-tp33132952p33134124.html
Sent from the HBase User mailing list archive at Nabble.com.
RE: HMaster region not reallocated in HBase 0.90.4
Posted by "Ramkrishna.S.Vasudevan" <ra...@huawei.com>.
Hi Sriram
What is the problem that you are getting ? Any exceptions in logs?
Ideally the master will reallocate all the regions belonging to the region
server that
Went down.
Regards
Ram
-----Original Message-----
From: V_sriram [mailto:vsriram30@gmail.com]
Sent: Friday, January 13, 2012 2:39 PM
To: hbase-user@hadoop.apache.org
Subject: HMaster region not reallocated in HBase 0.90.4
I am using HBase 0.90.4. When one of the region server is brought down, the
HMaster doesnot reallocate the regions and the regions are lost.
This issue was mentioned in the following posts as well. But that issue was
prevalent in HBase 0.90.3 and lesser versions. But it was mentioned to be
resolved. But still facing the region reallocation issue.
http://comments.gmane.org/gmane.comp.java.hadoop.hbase.user/20073
https://issues.apache.org/jira/browse/HBASE-4109
Any ideas plz??
--
View this message in context:
http://old.nabble.com/HMaster-region-not-reallocated-in-HBase-0.90.4-tp33132
952p33132952.html
Sent from the HBase User mailing list archive at Nabble.com.