[jira] [Commented] (HBASE-20883) HMaster/RS Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec

["Hari Sekhon (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-20883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16561777#comment-16561777 ] 

Hari Sekhon commented on HBASE-20883:
-------------------------------------

Read/Write requests per sec could also be added to RegionServers UI Base Stats next to Requests Per Sec which is total, and also to each RegionServer's JMX API.

> HMaster/RS Read / Write Requests Per Sec across RegionServers, currently only Total Requests Per Sec 
> -----------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-20883
>                 URL: https://issues.apache.org/jira/browse/HBASE-20883
>             Project: HBase
>          Issue Type: Improvement
>          Components: Admin, master, metrics, monitoring, UI, Usability
>    Affects Versions: 1.1.2
>            Reporter: Hari Sekhon
>            Priority: Major
>
> HMaster currently shows Requests Per Second per RegionServer under HMaster UI's /master-status page -> Region Servers -> Base Stats section in the Web UI.
> Please add Reads Per Second and Writes Per Second per RegionServer alongside this in the HMaster UI, and also expose the Read/Write/Total requests per sec information in the HMaster JMX API.
> This will make it easier to find read or write hotspotting on HBase as a combined total will minimize and mask differences between RegionServers. For example, we do 30,000 reads/sec but only 900 writes/sec to each RegionServer, so write skew will be masked as it won't show enough significant difference in the much larger combined Total Requests Per Second stat.
> For now I've written a Python tool to calculate this info from RegionServers JMX read/write/total request counts but since HMaster is collecting this info anyway it shouldn't be a big change to improve it to also show Reads / Writes Per Sec as well as Total.
> Find my tools for more granular Read/Write Requests Per Sec Per Regionserver and also Per Region at my [PyTools github repo|https://github.com/harisekhon/pytools] along with a selection of other HBase tools I've used for performance debugging over the years.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)