You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2008/11/04 09:04:44 UTC
[jira] Commented: (HBASE-964) Startup stuck "waiting for root
region"
[ https://issues.apache.org/jira/browse/HBASE-964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644916#action_12644916 ]
stack commented on HBASE-964:
-----------------------------
Are we sure this is right?
Testing, I still see this everytime I startup:
{code}
2008-11-04 08:01:54,113 INFO org.apache.hadoop.hbase.regionserver.HRegion: compaction completed on region .META.,,1 in 0sec
2008-11-04 08:02:39,320 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: TestTable,,1225785758336
2008-11-04 08:02:39,320 INFO org.apache.hadoop.hbase.regionserver.HRegionServer: MSG_REGION_OPEN: TestTable,,1225785758336
2008-11-04 08:02:39,334 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:41,336 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:43,339 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:45,341 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:47,344 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:49,347 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:51,348 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:53,351 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:55,353 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:57,356 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:02:59,358 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Attempt 0 of 10 failed with <org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out trying to locate root region>. Retrying after sleep of 2000
2008-11-04 08:02:59,359 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:01,361 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:03,362 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:05,365 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:07,367 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:09,369 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:11,372 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:13,374 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:15,375 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:17,378 DEBUG org.apache.hadoop.hbase.client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
2008-11-04 08:03:19,381 ERROR org.apache.hadoop.hbase.RegionHistorian: Unable to create RegionHistorian
org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out trying to locate root region
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:793)
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:439)
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.relocateRegion(HConnectionManager.java:421)
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:557)
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:449)
at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:414)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:113)
at org.apache.hadoop.hbase.RegionHistorian.online(RegionHistorian.java:310)
at org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:970)
at org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:901)
at java.lang.Thread.run(Thread.java:619)
{code}
Then it starts to work.
> Startup stuck "waiting for root region"
> ---------------------------------------
>
> Key: HBASE-964
> URL: https://issues.apache.org/jira/browse/HBASE-964
> Project: Hadoop HBase
> Issue Type: Bug
> Environment: TRUNK
> Reporter: stack
> Assignee: Jim Kellerman
> Fix For: 0.19.0
>
>
> Seems easy to reproduce.
> I am trying to start a master then start a regionserver. I'm using local filesystem.
> I start master like this:
> {code}
> ./bin/hbase master start
> {code}
> The regionserver similarly.
> All comes up. Then I try to run sequentialWriter from PE.
> Here is what shows in master log:
> {code}
> ...
> 08/10/27 15:20:00 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:02 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:04 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:06 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:06 INFO master.BaseScanner: RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,0, startKey: <>, server: 208.84.6.64:60020}
> 08/10/27 15:20:07 DEBUG master.BaseScanner: RegionManager.rootScanner REGION => {NAME => '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE => {{NAME => '.META.', IS_ROOT => 'false', IS_META => 'true', FAMILIES => [{NAME => 'info', BLOOMFILTER => 'false', VERSIONS => '1', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'false'}, {NAME => 'historian', BLOOMFILTER => 'false', VERSIONS => '2147483647', COMPRESSION => 'NONE', LENGTH => '2147483647', TTL => '-1', IN_MEMORY => 'false', BLOCKCACHE => 'false'}]}}}, SERVER => '208.84.6.64:60020', STARTCODE => 1225145942330
> 08/10/27 15:20:07 INFO master.BaseScanner: RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,0, startKey: <>, server: 208.84.6.64:60020} complete
> 08/10/27 15:20:08 DEBUG client.HConnectionManager$TableServers: Attempt 0 of 10 failed with <org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out trying to locate root region>. Retrying after sleep of 2000
> 08/10/27 15:20:08 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:10 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> ...
> {code}
> Here is the regionserver log:
> {code}
> ....
> 08/10/27 15:19:09 DEBUG regionserver.CompactSplitThread: Compaction requested for region: .META.,,1
> 08/10/27 15:19:09 INFO regionserver.HRegion: starting compaction on region .META.,,1
> 08/10/27 15:19:09 INFO regionserver.HRegion: compaction completed on region .META.,,1 in 0sec
> 08/10/27 15:19:48 INFO regionserver.HRegionServer: MSG_REGION_OPEN: TestTable,,1225145988632
> 08/10/27 15:19:48 INFO regionserver.HRegionServer: MSG_REGION_OPEN: TestTable,,1225145988632
> 08/10/27 15:19:48 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:19:50 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:19:52 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:19:54 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:19:56 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:19:58 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:00 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:02 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:04 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:07 DEBUG client.HConnectionManager$TableServers: Sleeping 2000ms, waiting for root region.
> 08/10/27 15:20:09 DEBUG client.HConnectionManager$TableServers: Attempt 0 of 10 failed with <org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out trying to locate root region>. Retrying after sleep of 2000
> ...
> {code}
> and so on.
> Giving to Jim since he was hereabouts most recently.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.