You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Duo Zhang (Jira)" <ji...@apache.org> on 2020/08/27 06:49:00 UTC
[jira] [Resolved] (HBASE-10237) Master restart, then followed by
the MetaRegionServer crashed will result that the .meta. table won't online
forever
[ https://issues.apache.org/jira/browse/HBASE-10237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Duo Zhang resolved HBASE-10237.
-------------------------------
Resolution: Not A Problem
0.94 has been EOL for a long time and the assignment framework has already been changed a lot. Resolve.
> Master restart, then followed by the MetaRegionServer crashed will result that the .meta. table won't online forever
> --------------------------------------------------------------------------------------------------------------------
>
> Key: HBASE-10237
> URL: https://issues.apache.org/jira/browse/HBASE-10237
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.94.12
> Reporter: Han Xiao
> Priority: Major
>
> The following logs record such process:
> // *once allocate root and meta to node209*
> 2013-12-23 10:45:34,130 INFO \[MASTER_OPEN_REGION-node201.vipcloud,60000,1386903739776-3\] handler.OpenedRegionHandler (OpenedRegionHandler.ja
> va:debugLog(145)) - Handling OPENED event for .META.,,1.1028785192 from node209.vipcloud,60020,1387272038024; deleting unassigned node
> 2013-12-23 14:53:36,268 INFO \[MASTER_OPEN_REGION-node201.vipcloud,60000,1386903739776-4\] handler.OpenedRegionHandler (OpenedRegionHandler.java:debugLog(145)) - Handling OPENED event for \-ROOT\-,,0.70236052 from node209.vipcloud,60020,1387272038024; deleting unassigned node
> // *master restart*
> 2013-12-23 16:30:19 CST Starting master on node201.vipcloud
> // *209 comming*
> 2013-12-23 16:30:33,698 INFO \[master-node201.vipcloud,60000,1387787422616\] master.ServerManager (ServerManager.java:recordNewServer(280)) -
> Registering server=node209.vipcloud,60020,1387272038024
> // *209 out*
> 2013-12-23 16:30:37,106 INFO \[main-EventThread\] zookeeper.RegionServerTracker (RegionServerTracker.java:nodeDeleted(93)) - RegionServer ephe
> meral node deleted, processing expiration \[node209.vipcloud,60020,1387272038024\]
> // *delay processing 209 for initialization*
> 2013-12-23 16:30:37,107 INFO \[main-EventThread\] master.ServerManager (ServerManager.java:expireServer(384)) - Master doesn't enable ServerSh
> utdownHandler during initialization, delay expiring server node209.vipcloud,60020,1387272038024
> // *assign root to node209 for data in zk node*
> 2013-12-23 16:30:42,120 INFO \[master-node201.vipcloud,60000,1387787422616\] master.HMaster (HMaster.java:assignRoot(756)) - \-ROOT\- assigned=0
> , rit=false, location=node209.vipcloud,60020,1387272038024
> // *problem happened when assign META to node209, validation passed first but when check server available failed. Therefore not update the regions struct for META*
> s1：2013-12-23 16:30:42,322 INFO \[master-node201.vipcloud,60000,1387787422616\] master.AssignmentManager (AssignmentManager.java:regionOnline(126
> 4)) - The server is not in online servers, ServerName=node209.vipcloud,60020,1387272038024, region=1028785192
> s2：2013-12-23 16:30:42,323 INFO \[master-node201.vipcloud,60000,1387787422616\] master.HMaster (HMaster.java:assignMeta(814)) - .META. assigned=0
> , rit=false, location=node209.vipcloud,60020,1387272038024
> // *handle node209 shutdown, only do reassign for \-ROOT\- but not for .META. because it is NOT updated in memory*
> 2013-12-23 16:31:35,978 INFO \[MASTER_META_SERVER_OPERATIONS-node201.vipcloud,60000,1387787422616-0\] handler.MetaServerShutdownHandler (MetaS
> erverShutdownHandler.java:process(78)) - Server node209.vipcloud,60020,1387272038024 was carrying ROOT. Trying to assign.
> // *verifaction for META failed (data in \-ROOT\- still stored as node209), but no reassign. for META. META won't be online forever*
> 2013-12-23 16:31:40,048 INFO \[MASTER_SERVER_OPERATIONS-node201.vipcloud,60000,1387787422616-0\] catalog.CatalogTracker (CatalogTracker.java:
> verifyRegionLocation(582)) - Failed verification of .META.,,1 at address=node209.vipcloud,60020,1387272038024; org.apache.hadoop.hbase.ipc.HBa
> seClient$FailedServerException: This server is in the failed servers list: node209.vipcloud/192.168.30.132:60020
> 2013-12-23 16:35:46,764 INFO \[MASTER_SERVER_OPERATIONS-node201.vipcloud,60000,1387787422616-0\] catalog.CatalogTracker (CatalogTracker.java:v
> erifyRegionLocation(582)) - Failed verification of .META.,,1 at address=node209.vipcloud,60020,1387272038024; org.apache.hadoop.hbase.ipc.HBa
> seClient$FailedServerException: This server is in the failed servers list: node209.vipcloud/192.168.30.132:60020
--
This message was sent by Atlassian Jira
(v8.3.4#803005)