You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jean-Daniel Cryans (Created) (JIRA)" <ji...@apache.org> on 2012/03/16 17:57:39 UTC
[jira] [Created] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Unable to stop a master that's waiting on -ROOT- during initialization
----------------------------------------------------------------------
Key: HBASE-5594
URL: https://issues.apache.org/jira/browse/HBASE-5594
Project: HBase
Issue Type: Bug
Affects Versions: 0.92.1
Reporter: Jean-Daniel Cryans
Fix For: 0.92.2, 0.94.0, 0.96.0
We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
{noformat}
"master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
at java.lang.Object.wait(Object.java:485)
at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
- locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
- locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
at java.lang.Thread.run(Thread.java:662)
{noformat}
I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "ramkrishna.s.vasudevan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13232440#comment-13232440 ]
ramkrishna.s.vasudevan commented on HBASE-5594:
-----------------------------------------------
@J-D
This same as HBASE-4951. I tried to give a patch there some half baked one. But needed some more changes to make it fully done.
Can you confirm if the two are duplictes if so one we can invalidate?
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.2, 0.94.0, 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234004#comment-13234004 ]
stack commented on HBASE-5594:
------------------------------
HBASE-5328 has a patch that includes removing the infinite wait on root in waitForRoot. Also has a test. Let me break out the pieces that should fix this.
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.2, 0.94.0, 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "stack (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack resolved HBASE-5594.
--------------------------
Resolution: Fixed
Fix Version/s: (was: 0.92.2)
(was: 0.94.0)
Going to claim this fixed by hbase-5328. It has fixup in master to take care of this issue (and a test). Was needed making a testable standalone master.
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13235239#comment-13235239 ]
stack commented on HBASE-5594:
------------------------------
hmmm... maybe hbase-2464 is not same thing. Going to leave that one for now.
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234978#comment-13234978 ]
stack commented on HBASE-5594:
------------------------------
Not necessary. I want to get it into trunk though, hbase-5328 that is (which fixes this)
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.2, 0.94.0, 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "Jean-Daniel Cryans (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233000#comment-13233000 ]
Jean-Daniel Cryans commented on HBASE-5594:
-------------------------------------------
Hey Ram,
Didn't you write that that thread dump on Dec. 9th wasn't for 4951 and that the issue wasn't in 0.92?
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.2, 0.94.0, 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "Lars Hofhansl (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234943#comment-13234943 ]
Lars Hofhansl commented on HBASE-5594:
--------------------------------------
@Stack: You want this for 0.94?
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.2, 0.94.0, 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "ramkrishna.s.vasudevan (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13233270#comment-13233270 ]
ramkrishna.s.vasudevan commented on HBASE-5594:
-----------------------------------------------
@J-D
That was when the issue started i thought not there in 0.92.
But see the comment at 13/Dec/11 02:48
It is applicable for 0.92 also. Some problems is when we wait for root we dont have access to the master at all. Because ZK classes dont give access to master related variables.
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.2, 0.94.0, 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5594) Unable to stop a master that's
waiting on -ROOT- during initialization
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13234998#comment-13234998 ]
stack commented on HBASE-5594:
------------------------------
HBASE-2464 seems to be same issue as this.
> Unable to stop a master that's waiting on -ROOT- during initialization
> ----------------------------------------------------------------------
>
> Key: HBASE-5594
> URL: https://issues.apache.org/jira/browse/HBASE-5594
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.92.1
> Reporter: Jean-Daniel Cryans
> Fix For: 0.92.2, 0.94.0, 0.96.0
>
>
> We just had a case where the master (that was just restarted) was having a hard time assigning -ROOT- (all the PRI handlers were full already) so we tried to shutdown the cluster and even though all the RS closed down properly the master kept running being blocked on:
> {noformat}
> "master-sv4r20s12,10302,1331916142866" prio=10 tid=0x00007f3708008800 nid=0x4b20 in Object.wait() [0x00007f370d1d0000]
> java.lang.Thread.State: WAITING (on object monitor)
> at java.lang.Object.wait(Native Method)
> - waiting on <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at java.lang.Object.wait(Object.java:485)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:131)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.zookeeper.ZooKeeperNodeTracker.blockUntilAvailable(ZooKeeperNodeTracker.java:104)
> - locked <0x00000006030be3f8> (a org.apache.hadoop.hbase.zookeeper.RootRegionTracker)
> at org.apache.hadoop.hbase.catalog.CatalogTracker.waitForRoot(CatalogTracker.java:313)
> at org.apache.hadoop.hbase.master.HMaster.assignRootAndMeta(HMaster.java:571)
> at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:501)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
> at java.lang.Thread.run(Thread.java:662)
> {noformat}
> I haven't checked the 0.90 code, we got this on 0.92.1
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira