You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org> on 2011/03/16 02:39:29 UTC
[jira] Created: (HBASE-3653) Parallelize Server Requests on HBase
Client
Parallelize Server Requests on HBase Client
-------------------------------------------
Key: HBASE-3653
URL: https://issues.apache.org/jira/browse/HBASE-3653
Project: HBase
Issue Type: Improvement
Affects Versions: 0.90.2, 0.92.0
Reporter: Nicolas Spiegelberg
Assignee: Nicolas Spiegelberg
Fix For: 0.90.2, 0.92.0
Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nicolas Spiegelberg updated HBASE-3653:
---------------------------------------
Status: Patch Available (was: Open)
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nicolas Spiegelberg updated HBASE-3653:
---------------------------------------
Attachment: HBASE-3653.patch
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Reopened: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon reopened HBASE-3653:
--------------------------------
Looks like this didn't get committed to trunk?
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nicolas Spiegelberg resolved HBASE-3653.
----------------------------------------
Resolution: Fixed
sorry. put this in 0.90 and forgot to git svn dcommit to trunk
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007550#comment-13007550 ]
stack commented on HBASE-3653:
------------------------------
+1 Very nice. Especially the bit where you were able to figure out where the slowness was coming from. Trunk and branch?
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nicolas Spiegelberg updated HBASE-3653:
---------------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "Nicolas Spiegelberg (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13007315#comment-13007315 ]
Nicolas Spiegelberg commented on HBASE-3653:
--------------------------------------------
note: because we were completely Network IO saturated, we were seeing 10-20 second RPC delays per RS due to dropped packets. Serialize this across 100 RS == massive delay. Went from 3 min -> 15 sec
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HBASE-3653) Parallelize Server Requests on HBase
Client
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13008264#comment-13008264 ]
Hudson commented on HBASE-3653:
-------------------------------
Integrated in HBase-TRUNK #1794 (See [https://hudson.apache.org/hudson/job/HBase-TRUNK/1794/])
> Parallelize Server Requests on HBase Client
> -------------------------------------------
>
> Key: HBASE-3653
> URL: https://issues.apache.org/jira/browse/HBASE-3653
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.90.2, 0.92.0
> Reporter: Nicolas Spiegelberg
> Assignee: Nicolas Spiegelberg
> Fix For: 0.90.2, 0.92.0
>
> Attachments: HBASE-3653.patch
>
>
> Vastly improves HBCK performance. Although we are parallelizing getRegionAssignment() calls, getHRegionConnection()
> gets a big lock. Cache misses can be expensive on heavily-loaded servers because they need to setup a proxy connection. This hurts cache hits on a cache miss & serializes all cache misses. We should parallelize both situations.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira