You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jean-Daniel Cryans (JIRA)" <ji...@apache.org> on 2010/11/30 02:01:11 UTC
[jira] Updated: (HBASE-3286) Bulk assignment isn't handling weird
network settings very well
[ https://issues.apache.org/jira/browse/HBASE-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jean-Daniel Cryans updated HBASE-3286:
--------------------------------------
Summary: Bulk assignment isn't handling weird network settings very well (was: Bulk assignment weird maths)
So I was able to pin it down, I'm debugging how the HSA are created and how we get them from .META and here's the result:
{noformat}
org.apache.hadoop.hbase.master.LoadBalancer: server list contains 10.20.20.185:61020
...
org.apache.hadoop.hbase.master.LoadBalancer: server list contains 10.20.20.182:61020
org.apache.hadoop.hbase.master.LoadBalancer: Assigning TestTable,,1290643751956.ef7ab3ee0b05de57c5938bb95a462403.
randomly because this server doesn't exist sv2borg186:61020
org.apache.hadoop.hbase.master.LoadBalancer: Assigning TestTable,0000049992,1290643755990.124a2b03eed3544d9196876f8660f6dd. to 10.20.20.187:61020
org.apache.hadoop.hbase.master.LoadBalancer: Assigning TestTable,0000100088,1290643795638.e2ddc1eb1a720d89138a49a1622f49be.
randomly because this server doesn't exist sv2borg184:61020
org.apache.hadoop.hbase.master.LoadBalancer: Assigning TestTable,0000109979,1290643795638.649f2bae753dda53931a7eb10899cdb6. to 10.20.20.187:61020
{noformat}
There's a mix of IPs and hostnames, so it won't match. Same old issue...
> Bulk assignment isn't handling weird network settings very well
> ---------------------------------------------------------------
>
> Key: HBASE-3286
> URL: https://issues.apache.org/jira/browse/HBASE-3286
> Project: HBase
> Issue Type: Bug
> Reporter: Jean-Daniel Cryans
> Fix For: 0.90.0
>
>
> Starting my little test cluster on the latest from 0.90, I see:
> {noformat}
> 2010-11-29 23:21:34,131 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1024 region(s) across 9 server(s), retainAssignment=true
> 2010-11-29 23:21:34,134 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 22 region(s) to sv2borg181,61020,1291072886282
> 2010-11-29 23:21:34,135 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 24 region(s) to sv2borg182,61020,1291072885473
> 2010-11-29 23:21:34,135 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 37 region(s) to sv2borg183,61020,1291072885646
> 2010-11-29 23:21:34,135 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 25 region(s) to sv2borg184,61020,1291072886734
> 2010-11-29 23:21:34,135 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 26 region(s) to sv2borg185,61020,1291072886606
> 2010-11-29 23:21:34,136 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 70 region(s) to sv2borg186,61020,1291072885486
> 2010-11-29 23:21:34,136 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 30 region(s) to sv2borg187,61020,1291072886355
> 2010-11-29 23:21:34,136 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 89 region(s) to sv2borg188,61020,1291072885926
> 2010-11-29 23:21:34,136 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 701 region(s) to sv2borg189,61020,1291072886739
> {noformat}
> After another restart:
> {noformat}
> 2010-11-30 00:03:38,100 INFO org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 1024 region(s) across 9 server(s), retainAssignment=true
> 2010-11-30 00:03:38,103 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 71 region(s) to sv2borg181,61020,1291075409984
> 2010-11-30 00:03:38,103 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 82 region(s) to sv2borg182,61020,1291075409956
> 2010-11-30 00:03:38,104 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 61 region(s) to sv2borg183,61020,1291075409952
> 2010-11-30 00:03:38,104 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 122 region(s) to sv2borg184,61020,1291075409957
> 2010-11-30 00:03:38,104 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 59 region(s) to sv2borg185,61020,1291075409955
> 2010-11-30 00:03:38,104 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 71 region(s) to sv2borg186,61020,1291075409963
> 2010-11-30 00:03:38,105 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 52 region(s) to sv2borg187,61020,1291075411049
> 2010-11-30 00:03:38,105 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 254 region(s) to sv2borg188,61020,1291075410360
> 2010-11-30 00:03:38,105 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Bulk assigning 252 region(s) to sv2borg189,61020,1291075409959
> {noformat}
> I also saw one time where everything was assigned to 189.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.