[jira] [Comment Edited] (HBASE-20548) Master fails to startup on large clusters, refreshing block distribution

["Thiruvel Thirumoolan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-20548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16488631#comment-16488631 ] 

Thiruvel Thirumoolan edited comment on HBASE-20548 at 5/24/18 8:38 AM:
-----------------------------------------------------------------------

Uploaded patch for master. Change was RegionInfo instead of HRegionInfo.

Uploaded patch for branch-2.0 as well, if needed. Since HBASE-20545 is not in branch-2.0, patch is slightly different.


was (Author: thiruvel):
Uploaded patch for master. Change was RegionInfo instead of HRegionInfo.

> Master fails to startup on large clusters, refreshing block distribution
> ------------------------------------------------------------------------
>
>                 Key: HBASE-20548
>                 URL: https://issues.apache.org/jira/browse/HBASE-20548
>             Project: HBase
>          Issue Type: Improvement
>    Affects Versions: 1.4.4
>            Reporter: Thiruvel Thirumoolan
>            Assignee: Thiruvel Thirumoolan
>            Priority: Major
>             Fix For: 1.5.0, 2.0.1, 1.4.5
>
>         Attachments: HBASE-20548.branch-1.4.001.patch, HBASE-20548.branch-2.0.001.patch, HBASE-20548.master.001.patch
>
>
> On our large clusters with, master has failed to startup within specified time and aborted itself since it was initializing HDFS block distribution. Enable table also takes time for larger tables for the same reason. My proposal is to refresh HDFS block distribution at the end of master initialization and not at retainAssignment()'s createCluster(). This would address HBASE-16570's intention, but avoid the problems we ran into.
> cc [~aoxiang] [~tedyu]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)