You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Bo Cui (Jira)" <ji...@apache.org> on 2020/08/21 02:53:00 UTC

[jira] [Created] (HBASE-24925) SCP reduce unnecessary get requests

Bo Cui created HBASE-24925:
------------------------------

             Summary: SCP reduce unnecessary get requests
                 Key: HBASE-24925
                 URL: https://issues.apache.org/jira/browse/HBASE-24925
             Project: HBase
          Issue Type: Improvement
            Reporter: Bo Cui


SCP should reduce unnecessary Get request

[https://github.com/apache/hbase/blob/65d28da7c22382e040363c607840d5ab6e6b45da/hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java#L520]

during startup， the tableNam2State of tableStateManager is not loading tableState data form metaTable yet.  if procThread num is 50 and hbase has 10K tables, in the worst case, the master needs to query meta table 500K times(50*10K. and the regions that all SCPs simultaneously check tableState belong to the same table )

 

i think master can reduce Get request, and AM#loadMeta can load regions and all tables

[https://github.com/apache/hbase/blob/65d28da7c22382e040363c607840d5ab6e6b45da/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java#L1532]

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)