You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Anoop Sam John (JIRA)" <ji...@apache.org> on 2013/08/16 19:48:49 UTC
[jira] [Comment Edited] (HBASE-9243) Add more useful statistics in
the HFile tool
[ https://issues.apache.org/jira/browse/HBASE-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13742445#comment-13742445 ]
Anoop Sam John edited comment on HBASE-9243 at 8/16/13 5:47 PM:
----------------------------------------------------------------
bq. This is the count of different key lengths? Or total number of rows?
I think total number of rows
bq. This is the count of the number of different value lengths? Or total number of values
Second.
Correct [~alexandre.normand] ?
was (Author: anoop.hbase):
bq. This is the count of different key lengths? Or total number of rows?
I think total number of rows
bq. This is the count of the number of different value lengths? Or total number of values
Second.
Correct [~alexandre.normand]
> Add more useful statistics in the HFile tool
> --------------------------------------------
>
> Key: HBASE-9243
> URL: https://issues.apache.org/jira/browse/HBASE-9243
> Project: HBase
> Issue Type: Improvement
> Components: HFile
> Affects Versions: 0.96.0
> Reporter: Alexandre Normand
> Priority: Minor
> Labels: newbie
> Attachments: HBASE-9243-1.patch, HBASE-9243-2.patch, HBASE-9243.patch
>
>
> The [HFile tool|http://hbase.apache.org/book/regions.arch.html#hfile_tool] has been very useful to us recently to get a better idea of the size of our rows. However, it happened frequently that we wished for more statistics to have a more complete picture of the distribution of the row sizes.
> [~skuehn] requested that feature often enough in private that I decided to give it a go.
> Here's the patch that adds more nice little stats via yammer's histograms. It was easy enough since {{com.yammer.metrics}} is already in hbase's dependencies.
> Example of the new output from {{org.apache.hadoop.hbase.io.hfile.HFile -s -f ...}}:
> {code}
> Stats:
> Key length:
> min = 24.00
> max = 24.00
> mean = 24.00
> stddev = 0.00
> median = 24.00
> 75% <= 24.00
> 95% <= 24.00
> 98% <= 24.00
> 99% <= 24.00
> 99.9% <= 24.00
> Row size (bytes):
> min = 33.00
> max = 33.00
> mean = 33.00
> stddev = 0.00
> median = 33.00
> 75% <= 33.00
> 95% <= 33.00
> 98% <= 33.00
> 99% <= 33.00
> 99.9% <= 33.00
> Row size (columns):
> min = 1.00
> max = 1.00
> mean = 1.00
> stddev = 0.00
> median = 1.00
> 75% <= 1.00
> 95% <= 1.00
> 98% <= 1.00
> 99% <= 1.00
> 99.9% <= 1.00
> Val length:
> min = 1.00
> max = 1.00
> mean = 1.00
> stddev = 0.00
> median = 1.00
> 75% <= 1.00
> 95% <= 1.00
> 98% <= 1.00
> 99% <= 1.00
> 99.9% <= 1.00
> Key of biggest row: \x00
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira