You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "stack (JIRA)" <ji...@apache.org> on 2012/10/18 02:02:03 UTC
[jira] [Created] (HBASE-7007) [MTTR] Study assigns to see if we can
make them faster still
stack created HBASE-7007:
----------------------------
Summary: [MTTR] Study assigns to see if we can make them faster still
Key: HBASE-7007
URL: https://issues.apache.org/jira/browse/HBASE-7007
Project: HBase
Issue Type: Improvement
Reporter: stack
Looking at a cluster start, I saw that it took about 25 minutes to assign and open 17k regions. 8 minutes was bulk assigning via zk. 17 minutes was opening the regions. "HBASE-6640 [0.89-fb] Allow multiple regions to be opened simultaneously" in trunk would help but maybe we can do less work up in zk for instance; e.g. if 3.4.5, we can do bulk ops in zk (or make a bulk assign znode that has many regions instead of one)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7007) [MTTR] Study assigns to see if we
can make them faster still
Posted by "nkeywal (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13478772#comment-13478772 ]
nkeywal commented on HBASE-7007:
--------------------------------
That what my tests were saying in June. Hopefully they're right ;-). I've not redone them recently. Hopefully it's still there.
(from HBASE-5843)
I tested the following scenarios, on a local machine, a pseudo
distributed cluster with ZooKeeper and HBase writing in a ram drive,
no datanode nor namenode, with 2 region servers, and one empty table
with 10000 regions, 5K on each RS. Versions taken monday 2nd
3) Start of the cluster after a clean stop; wait for all regions to
become online.
0.92: ~1020s
0.94: ~1023s (tested once only)
0.96: ~31s
> [MTTR] Study assigns to see if we can make them faster still
> ------------------------------------------------------------
>
> Key: HBASE-7007
> URL: https://issues.apache.org/jira/browse/HBASE-7007
> Project: HBase
> Issue Type: Improvement
> Reporter: stack
>
> Looking at a cluster start, I saw that it took about 25 minutes to assign and open 17k regions. 8 minutes was bulk assigning via zk. 17 minutes was opening the regions. "HBASE-6640 [0.89-fb] Allow multiple regions to be opened simultaneously" in trunk would help but maybe we can do less work up in zk for instance; e.g. if 3.4.5, we can do bulk ops in zk (or make a bulk assign znode that has many regions instead of one)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-7007) [MTTR] Study assigns to see if we
can make them faster still
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13479521#comment-13479521 ]
stack commented on HBASE-7007:
------------------------------
I'd say fit criteria for closing this issue would be running a before and after on a cluster.... see how much hbase-6109 buys us. Thanks [~nkeywal]
> [MTTR] Study assigns to see if we can make them faster still
> ------------------------------------------------------------
>
> Key: HBASE-7007
> URL: https://issues.apache.org/jira/browse/HBASE-7007
> Project: HBase
> Issue Type: Improvement
> Reporter: stack
> Fix For: 0.96.0
>
>
> Looking at a cluster start, I saw that it took about 25 minutes to assign and open 17k regions. 8 minutes was bulk assigning via zk. 17 minutes was opening the regions. "HBASE-6640 [0.89-fb] Allow multiple regions to be opened simultaneously" in trunk would help but maybe we can do less work up in zk for instance; e.g. if 3.4.5, we can do bulk ops in zk (or make a bulk assign znode that has many regions instead of one)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-7007) [MTTR] Study assigns to see if we can
make them faster still
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-7007:
-------------------------
Priority: Critical (was: Major)
Fix Version/s: 0.96.0
I think this worth testing as part of the 0.96.0 proofing.
> [MTTR] Study assigns to see if we can make them faster still
> ------------------------------------------------------------
>
> Key: HBASE-7007
> URL: https://issues.apache.org/jira/browse/HBASE-7007
> Project: HBase
> Issue Type: Improvement
> Reporter: stack
> Priority: Critical
> Fix For: 0.96.0
>
>
> Looking at a cluster start, I saw that it took about 25 minutes to assign and open 17k regions. 8 minutes was bulk assigning via zk. 17 minutes was opening the regions. "HBASE-6640 [0.89-fb] Allow multiple regions to be opened simultaneously" in trunk would help but maybe we can do less work up in zk for instance; e.g. if 3.4.5, we can do bulk ops in zk (or make a bulk assign znode that has many regions instead of one)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira