You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2017/02/15 00:08:43 UTC
[jira] [Commented] (HBASE-6721) RegionServer Group based Assignment
[ https://issues.apache.org/jira/browse/HBASE-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15866971#comment-15866971 ]
Hudson commented on HBASE-6721:
-------------------------------
FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #2505 (See [https://builds.apache.org/job/HBase-Trunk_matrix/2505/])
HBASE-17624 Address late review of HBASE-6721, rsgroups feature (stack: rev e019961150624236615fe7bd4a9017622d9f78d0)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/LoadBalancer.java
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestMasterObserver.java
* (edit) hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroups.java
* (edit) hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRSGroupBasedLoadBalancer.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/security/access/AccessController.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupSerDe.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
* (delete) hbase-common/src/test/java/org/apache/hadoop/hbase/util/TestAddressing.java
* (edit) hbase-shell/src/main/ruby/shell/commands/get_table_rsgroup.rb
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupBasedLoadBalancer.java
* (edit) hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestSplitLogManager.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
* (edit) hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/VerifyingRSGroupAdminClient.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestDurability.java
* (edit) hbase-it/src/test/java/org/apache/hadoop/hbase/rsgroup/IntegrationTestRSGroup.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdmin.java
* (edit) hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsOfflineMode.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
* (add) hbase-common/src/main/java/org/apache/hadoop/hbase/util/Address.java
* (edit) hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestSimpleRequestController.java
* (edit) hbase-shell/src/main/ruby/shell/commands/balance_rsgroup.rb
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/util/Addressing.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestWALReplay.java
* (edit) hbase-shell/src/main/ruby/shell/commands/list_rsgroups.rb
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/TestServerName.java
* (edit) hbase-shell/src/main/ruby/shell/commands/remove_rsgroup.rb
* (edit) hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsBase.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/BaseMasterAndRegionObserver.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/balancer/BaseLoadBalancer.java
* (edit) hbase-rsgroup/pom.xml
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminServer.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManagerImpl.java
* (edit) hbase-shell/src/main/ruby/shell/commands/move_tables_rsgroup.rb
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
* (edit) hbase-shell/src/main/ruby/shell/commands/get_server_rsgroup.rb
* (edit) hbase-shell/src/main/ruby/shell/commands/get_rsgroup.rb
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/BaseMasterObserver.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestWALObserver.java
* (edit) hbase-shell/src/main/ruby/hbase/rsgroup_admin.rb
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFactory.java
* (edit) hbase-shell/src/test/ruby/shell/rsgroup_shell_test.rb
* (edit) hbase-shell/src/main/ruby/shell/commands/move_servers_rsgroup.rb
* (edit) hbase-common/src/main/java/org/apache/hadoop/hbase/ServerName.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupableBalancer.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/wal/AbstractFSWALProvider.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/Utility.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminEndpoint.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/AbstractTestWALReplay.java
* (edit) hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupAdminClient.java
> RegionServer Group based Assignment
> -----------------------------------
>
> Key: HBASE-6721
> URL: https://issues.apache.org/jira/browse/HBASE-6721
> Project: HBase
> Issue Type: New Feature
> Components: regionserver
> Reporter: Francis Liu
> Assignee: Francis Liu
> Labels: hbase-6721
> Fix For: 2.0.0
>
> Attachments: 6721-master-webUI.patch, balanceCluster Sequence Diagram.svg, HBASE-6721_0.98_2.patch, HBASE-6721_10.patch, HBASE-6721_11.patch, HBASE-6721_12.patch, HBASE-6721_13.patch, HBASE-6721_14.patch, HBASE-6721_15.patch, HBASE-6721_8.patch, HBASE-6721_94_2.patch, HBASE-6721_94_3.patch, HBASE-6721_94_3.patch, HBASE-6721_94_4.patch, HBASE-6721_94_5.patch, HBASE-6721_94_6.patch, HBASE-6721_94_7.patch, HBASE-6721_94.patch, HBASE-6721_94.patch, HBASE-6721_98_1.patch, HBASE-6721_98_2.patch, HBASE-6721_9.patch, HBASE-6721_9.patch, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721-DesigDoc.pdf, HBASE-6721 GroupBasedLoadBalancer Sequence Diagram.xml, HBASE-6721_hbase-6721_addendum.patch, HBASE-6721_trunk1.patch, HBASE-6721_trunk2.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, HBASE-6721_trunk.patch, hbase-6721-v15-branch-1.1.patch, hbase-6721-v16.patch, hbase-6721-v17.patch, hbase-6721-v18.patch, hbase-6721-v19.patch, hbase-6721-v20.patch, hbase-6721-v21.patch, hbase-6721-v22.patch, hbase-6721-v23.patch, hbase-6721-v25.patch, hbase-6721-v26_draft1.patch, hbase-6721-v26.patch, hbase-6721-v27.patch, hbase-6721-v27.patch, hbase-6721-v27.patch.txt, hbase-6721-v28.patch, hbase-6721-v28.patch, hbase-6721-v29.patch, immediateAssignments Sequence Diagram.svg, randomAssignment Sequence Diagram.svg, retainAssignment Sequence Diagram.svg, roundRobinAssignment Sequence Diagram.svg
>
>
> In multi-tenant deployments of HBase, it is likely that a RegionServer will be serving out regions from a number of different tables owned by various client applications. Being able to group a subset of running RegionServers and assign specific tables to it, provides a client application a level of isolation and resource allocation.
> The proposal essentially is to have an AssignmentManager which is aware of RegionServer groups and assigns tables to region servers based on groupings. Load balancing will occur on a per group basis as well.
> This is essentially a simplification of the approach taken in HBASE-4120. See attached document.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)