You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2008/11/23 00:11:44 UTC

[jira] Created: (HBASE-1020) Regionserver OOME handler should dump vital stats

Regionserver OOME handler should dump vital stats
-------------------------------------------------

                 Key: HBASE-1020
                 URL: https://issues.apache.org/jira/browse/HBASE-1020
             Project: Hadoop HBase
          Issue Type: Improvement
          Components: regionserver
            Reporter: Andrew Purtell
             Fix For: 0.19.0


On OOME the regionserver should dump into the log some vital stats:
- Number of regions
- Number of store files
- Estimated item count and size of memcache(s)
- Estimated item count and size of store file indexes

Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Assigned: (HBASE-1020) Regionserver OOME handler should dump vital stats

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack reassigned HBASE-1020:
----------------------------

    Assignee: stack

> Regionserver OOME handler should dump vital stats
> -------------------------------------------------
>
>                 Key: HBASE-1020
>                 URL: https://issues.apache.org/jira/browse/HBASE-1020
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Andrew Purtell
>            Assignee: stack
>             Fix For: 0.19.0
>
>         Attachments: 1020.patch
>
>
> On OOME the regionserver should dump into the log some vital stats:
> - Number of regions
> - Number of store files
> - Estimated item count and size of memcache(s)
> - Estimated item count and size of store file indexes
> Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1020) Regionserver OOME handler should dump vital stats

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-1020:
-------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Thanks for the review Andrew.

> Regionserver OOME handler should dump vital stats
> -------------------------------------------------
>
>                 Key: HBASE-1020
>                 URL: https://issues.apache.org/jira/browse/HBASE-1020
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Andrew Purtell
>             Fix For: 0.19.0
>
>         Attachments: 1020.patch
>
>
> On OOME the regionserver should dump into the log some vital stats:
> - Number of regions
> - Number of store files
> - Estimated item count and size of memcache(s)
> - Estimated item count and size of store file indexes
> Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1020) Regionserver OOME handler should dump vital stats

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650695#action_12650695 ] 

Andrew Purtell commented on HBASE-1020:
---------------------------------------

+1. With HBASE-1022 in also this is good. 

If OOME escapes I assume there will be a stack trace and we can reopen this issue to fix based on reports of them, correct?

> Regionserver OOME handler should dump vital stats
> -------------------------------------------------
>
>                 Key: HBASE-1020
>                 URL: https://issues.apache.org/jira/browse/HBASE-1020
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Andrew Purtell
>             Fix For: 0.19.0
>
>         Attachments: 1020.patch
>
>
> On OOME the regionserver should dump into the log some vital stats:
> - Number of regions
> - Number of store files
> - Estimated item count and size of memcache(s)
> - Estimated item count and size of store file indexes
> Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1020) Regionserver OOME handler should dump vital stats

Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649989#action_12649989 ] 

Andrew Purtell commented on HBASE-1020:
---------------------------------------

I'll add metrics for store file indexes.

> Regionserver OOME handler should dump vital stats
> -------------------------------------------------
>
>                 Key: HBASE-1020
>                 URL: https://issues.apache.org/jira/browse/HBASE-1020
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Andrew Purtell
>             Fix For: 0.19.0
>
>
> On OOME the regionserver should dump into the log some vital stats:
> - Number of regions
> - Number of store files
> - Estimated item count and size of memcache(s)
> - Estimated item count and size of store file indexes
> Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1020) Regionserver OOME handler should dump vital stats

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-1020:
-------------------------

    Status: Patch Available  (was: Open)

Making patch available.  Review appreciated.

> Regionserver OOME handler should dump vital stats
> -------------------------------------------------
>
>                 Key: HBASE-1020
>                 URL: https://issues.apache.org/jira/browse/HBASE-1020
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Andrew Purtell
>             Fix For: 0.19.0
>
>         Attachments: 1020.patch
>
>
> On OOME the regionserver should dump into the log some vital stats:
> - Number of regions
> - Number of store files
> - Estimated item count and size of memcache(s)
> - Estimated item count and size of store file indexes
> Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HBASE-1020) Regionserver OOME handler should dump vital stats

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-1020:
-------------------------

    Attachment: 1020.patch

Patch to dump metrics on OOME/abort.  Patch also does HBASE-1006 adding in checks for OOME all over HRS.

May still be some holes where an OOME will escape and not be caught and abort-handled.

> Regionserver OOME handler should dump vital stats
> -------------------------------------------------
>
>                 Key: HBASE-1020
>                 URL: https://issues.apache.org/jira/browse/HBASE-1020
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Andrew Purtell
>             Fix For: 0.19.0
>
>         Attachments: 1020.patch
>
>
> On OOME the regionserver should dump into the log some vital stats:
> - Number of regions
> - Number of store files
> - Estimated item count and size of memcache(s)
> - Estimated item count and size of store file indexes
> Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HBASE-1020) Regionserver OOME handler should dump vital stats

Posted by "stack (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649984#action_12649984 ] 

stack commented on HBASE-1020:
------------------------------

Can just dump current metrics to log; has region count, and store file count.  Memcache metric has size, not item count (Might be possible to add this as metric -- I think we keep it.. not so for store files).

> Regionserver OOME handler should dump vital stats
> -------------------------------------------------
>
>                 Key: HBASE-1020
>                 URL: https://issues.apache.org/jira/browse/HBASE-1020
>             Project: Hadoop HBase
>          Issue Type: Improvement
>          Components: regionserver
>            Reporter: Andrew Purtell
>             Fix For: 0.19.0
>
>
> On OOME the regionserver should dump into the log some vital stats:
> - Number of regions
> - Number of store files
> - Estimated item count and size of memcache(s)
> - Estimated item count and size of store file indexes
> Assumes the reserve can be released upon OOME to allow the additional actions.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.