You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Elliott Clark (JIRA)" <ji...@apache.org> on 2012/11/13 20:06:14 UTC

[jira] [Created] (HBASE-7157) Report Metrics into an HBase table

Elliott Clark created HBASE-7157:
------------------------------------

             Summary: Report Metrics into an HBase table
                 Key: HBASE-7157
                 URL: https://issues.apache.org/jira/browse/HBASE-7157
             Project: HBase
          Issue Type: Improvement
            Reporter: Elliott Clark
            Assignee: Elliott Clark


Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7157) Report Metrics into an HBase table

Posted by "Elliott Clark (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Elliott Clark updated HBASE-7157:
---------------------------------

    Component/s: metrics
    
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Comment Edited] (HBASE-7157) Report Metrics into an HBase table

Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496764#comment-13496764 ] 

Enis Soztutar edited comment on HBASE-7157 at 11/14/12 2:16 AM:
----------------------------------------------------------------

Do we have to resurface the system-tables discussion. This looks like a system table to me. Could not find the issue. 
                
      was (Author: enis):
    DO we have to resurface the system-tables discussion. This looks like a system table to me. Could not find the issue. 
                  
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7157) Report Metrics into an HBase table

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496502#comment-13496502 ] 

stack commented on HBASE-7157:
------------------------------

[~jxiang] Yeah, would be cool if the tsdb-reader could run against this table...so could do nice queries. Benoit said'd it'd be cool having same format.  TSDB has nice compaction of the content every hour to make the metrics more compact but maybe we just TTL the stuff out before we need to do this -- unless user changes the config. to keep the metrics.
                
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7157) Report Metrics into an HBase table

Posted by "Anoop Sam John (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498581#comment-13498581 ] 

Anoop Sam John commented on HBASE-7157:
---------------------------------------

Any chance some one finding out that Jira issue, pls give the issue id here. If no one worked on that yet I would like to have a go on it ...
Or is it like just discussed abt that in some other issue?  We will raise a new issue?
                
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7157) Report Metrics into an HBase table

Posted by "Jimmy Xiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496431#comment-13496431 ] 

Jimmy Xiang commented on HBASE-7157:
------------------------------------

Could this table hook up with TSDB?
                
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7157) Report Metrics into an HBase table

Posted by "Anoop Sam John (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13497038#comment-13497038 ] 

Anoop Sam John commented on HBASE-7157:
---------------------------------------

Is the meaning that we need to allow marking some tables as system tables?
We should care about these type of tables in different scenarios may be
1. Do not list down in the UI ( also and no metric about that?)
2. No need to check for the ACLs...
I remember in the past when we worked with some thing a similar idea came to my mind of allowing system tables(internal tables).. Had some discussion with Ram then but later lost track of that..
                
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7157) Report Metrics into an HBase table

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496921#comment-13496921 ] 

stack commented on HBASE-7157:
------------------------------

[~enis] What you referring to when you say this 'Do we have to resurface the system-tables discussion. This looks like a system table to me. Could not find the issue.'?

I agree, these metrics would probably go into a 'systems table'.
                
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7157) Report Metrics into an HBase table

Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496764#comment-13496764 ] 

Enis Soztutar commented on HBASE-7157:
--------------------------------------

DO we have to resurface the system-tables discussion. This looks like a system table to me. Could not find the issue. 
                
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HBASE-7157) Report Metrics into an HBase table

Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13498275#comment-13498275 ] 

Enis Soztutar commented on HBASE-7157:
--------------------------------------

bq. What you referring to when you say this
I remember from some jira discussion about introducing special system tables, as Anoop describes above. Like the catalog tables, they are managed, and deployed from hbase internals (like the SQL INFORMATION_SCHEMA). Our ACL table is already a system table in this respect. 
                
> Report Metrics into an HBase table
> ----------------------------------
>
>                 Key: HBASE-7157
>                 URL: https://issues.apache.org/jira/browse/HBASE-7157
>             Project: HBase
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Elliott Clark
>            Assignee: Elliott Clark
>
> Right now metrics are sent using ServerLoad and RegionLoad to the master.  We should store those(and other) metrics in a table.  Storing these metrics in a table will allow the LoadBalancer to have more context.  In addition those metrics will be useful for the ui.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira