You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Kannan Muthukkaruppan (JIRA)" <ji...@apache.org> on 2011/05/20 08:11:47 UTC

[jira] [Created] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

make it easier to add per-CF metrics; add some key per-CF metrics to start with
-------------------------------------------------------------------------------

                 Key: HBASE-3907
                 URL: https://issues.apache.org/jira/browse/HBASE-3907
             Project: HBase
          Issue Type: Improvement
            Reporter: Kannan Muthukkaruppan
            Assignee: Kannan Muthukkaruppan


Add plumbing need to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:

1) Blocks read, cache hit, avg time of read for a column family.
2) Similar stats for compaction related reads.
3) Stats for meta block reads per CF
4) Bloom Filter stats per CF
etc.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-3907:
-------------------------

    Component/s: metrics

> make it easier to add per-CF metrics; add some key per-CF metrics to start with
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-3907
>                 URL: https://issues.apache.org/jira/browse/HBASE-3907
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Kannan Muthukkaruppan
>            Assignee: Kannan Muthukkaruppan
>
> Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:
> 1) Blocks read, cache hit, avg time of read for a column family.
> 2) Similar stats for compaction related reads.
> 3) Stats for meta block reads per CF
> 4) Bloom Filter stats per CF
> etc.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Elliott Clark resolved HBASE-3907.
----------------------------------

    Resolution: Not A Problem

>From what I can see the following are the issues that put the per cf metrics in:

* HBASE-4768
* HBASE-4809
* HBASE-4683
* HBASE-5072
* HBASE-5230
* HBASE-5274

Most of the work on the dynamic per cf, per table metrics went into 0.94.0. So I taged that version and marking as resolved(Not A Problem)
                
> make it easier to add per-CF metrics; add some key per-CF metrics to start with
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-3907
>                 URL: https://issues.apache.org/jira/browse/HBASE-3907
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Kannan Muthukkaruppan
>            Assignee: Elliott Clark
>             Fix For: 0.94.0
>
>
> Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:
> 1) Blocks read, cache hit, avg time of read for a column family.
> 2) Similar stats for compaction related reads.
> 3) Stats for meta block reads per CF
> 4) Bloom Filter stats per CF
> etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

Posted by "Kannan Muthukkaruppan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kannan Muthukkaruppan updated HBASE-3907:
-----------------------------------------

    Description: 
Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:

1) Blocks read, cache hit, avg time of read for a column family.
2) Similar stats for compaction related reads.
3) Stats for meta block reads per CF
4) Bloom Filter stats per CF
etc.


  was:
Add plumbing need to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:

1) Blocks read, cache hit, avg time of read for a column family.
2) Similar stats for compaction related reads.
3) Stats for meta block reads per CF
4) Bloom Filter stats per CF
etc.



> make it easier to add per-CF metrics; add some key per-CF metrics to start with
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-3907
>                 URL: https://issues.apache.org/jira/browse/HBASE-3907
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Kannan Muthukkaruppan
>            Assignee: Kannan Muthukkaruppan
>
> Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:
> 1) Blocks read, cache hit, avg time of read for a column family.
> 2) Similar stats for compaction related reads.
> 3) Stats for meta block reads per CF
> 4) Bloom Filter stats per CF
> etc.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

Posted by "Kannan Muthukkaruppan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13450720#comment-13450720 ] 

Kannan Muthukkaruppan commented on HBASE-3907:
----------------------------------------------

This is all done from a while ago, and ported to trunk as well. The port might have happened as part of the HFile V2 port. So I don't have the exact patch details. But we pretty much have block cache stats, compaction stats, bloom/index/ stats on a per-CF, get/put ops/latency stats, on a per-CF basis.

Stack: Can you mark this resolved with appropriate tags (to indicate the right version since which this has been in)? Thanks...
                
> make it easier to add per-CF metrics; add some key per-CF metrics to start with
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-3907
>                 URL: https://issues.apache.org/jira/browse/HBASE-3907
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Kannan Muthukkaruppan
>            Assignee: Kannan Muthukkaruppan
>
> Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:
> 1) Blocks read, cache hit, avg time of read for a column family.
> 2) Similar stats for compaction related reads.
> 3) Stats for meta block reads per CF
> 4) Bloom Filter stats per CF
> etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Elliott Clark updated HBASE-3907:
---------------------------------

    Fix Version/s: 0.94.0
    
> make it easier to add per-CF metrics; add some key per-CF metrics to start with
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-3907
>                 URL: https://issues.apache.org/jira/browse/HBASE-3907
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Kannan Muthukkaruppan
>            Assignee: Elliott Clark
>             Fix For: 0.94.0
>
>
> Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:
> 1) Blocks read, cache hit, avg time of read for a column family.
> 2) Similar stats for compaction related reads.
> 3) Stats for meta block reads per CF
> 4) Bloom Filter stats per CF
> etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13448197#comment-13448197 ] 

Lars Hofhansl commented on HBASE-3907:
--------------------------------------

@Kannan: Any plans of working on this? Should we keep it open?
                
> make it easier to add per-CF metrics; add some key per-CF metrics to start with
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-3907
>                 URL: https://issues.apache.org/jira/browse/HBASE-3907
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Kannan Muthukkaruppan
>            Assignee: Kannan Muthukkaruppan
>
> Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:
> 1) Blocks read, cache hit, avg time of read for a column family.
> 2) Similar stats for compaction related reads.
> 3) Stats for meta block reads per CF
> 4) Bloom Filter stats per CF
> etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Assigned] (HBASE-3907) make it easier to add per-CF metrics; add some key per-CF metrics to start with

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack reassigned HBASE-3907:
----------------------------

    Assignee: Elliott Clark  (was: Kannan Muthukkaruppan)

Mind taking care of this one boss?  You have clue on what metrics we show and when they were added.  Please resolve w/ appropriate version as per Kannans' request.  Good stuff.
                
> make it easier to add per-CF metrics; add some key per-CF metrics to start with
> -------------------------------------------------------------------------------
>
>                 Key: HBASE-3907
>                 URL: https://issues.apache.org/jira/browse/HBASE-3907
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Kannan Muthukkaruppan
>            Assignee: Elliott Clark
>
> Add plumbing needed to add various types of per ColumnFamily metrics. And to start with add a bunch per-CF metrics such as:
> 1) Blocks read, cache hit, avg time of read for a column family.
> 2) Similar stats for compaction related reads.
> 3) Stats for meta block reads per CF
> 4) Bloom Filter stats per CF
> etc.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira