You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Ionut Ignatescu (Created) (JIRA)" <ji...@apache.org> on 2012/04/11 19:45:21 UTC

[jira] [Created] (HBASE-5768) Question about configuring HBase file size

Question about configuring HBase file size
------------------------------------------

                 Key: HBASE-5768
                 URL: https://issues.apache.org/jira/browse/HBASE-5768
             Project: HBase
          Issue Type: Task
            Reporter: Ionut Ignatescu


My use-case: I have several HBase tables in which entries are pushed constantly(300k entries/5min,6-7Gb/day). I started with tables splitted in 32 regions.
File size is currently set to 1Gb. I'm using this tables to perfom real-time scans via a web app. 
Problem: Sometimes,but pretty frequently tables are frozen and I get scanner timeout exception.I found in logs that many splits and compactions are performing and I think this are the cause. If I stop pushing data into tables, are scans are running ok.
Could you provide me some advices to do in order to avoid this problem?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (HBASE-5768) Question about configuring HBase file size

Posted by "Jean-Daniel Cryans (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jean-Daniel Cryans resolved HBASE-5768.
---------------------------------------

    Resolution: Invalid

Please send your questions to the user mailing list: http://hbase.apache.org/mail-lists.html

This Jira is for HBase development only.
                
> Question about configuring HBase file size
> ------------------------------------------
>
>                 Key: HBASE-5768
>                 URL: https://issues.apache.org/jira/browse/HBASE-5768
>             Project: HBase
>          Issue Type: Task
>            Reporter: Ionut Ignatescu
>
> My use-case: I have several HBase tables in which entries are pushed constantly(300k entries/5min,6-7Gb/day). I started with tables splitted in 32 regions.
> File size is currently set to 1Gb. I'm using this tables to perfom real-time scans via a web app. 
> Problem: Sometimes,but pretty frequently tables are frozen and I get scanner timeout exception.I found in logs that many splits and compactions are performing and I think this are the cause. If I stop pushing data into tables, are scans are running ok.
> Could you provide me some advices to do in order to avoid this problem?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HBASE-5768) Question about configuring HBase file size

Posted by "Ionut Ignatescu (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HBASE-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13251825#comment-13251825 ] 

Ionut Ignatescu commented on HBASE-5768:
----------------------------------------

Thanks!
                
> Question about configuring HBase file size
> ------------------------------------------
>
>                 Key: HBASE-5768
>                 URL: https://issues.apache.org/jira/browse/HBASE-5768
>             Project: HBase
>          Issue Type: Task
>            Reporter: Ionut Ignatescu
>
> My use-case: I have several HBase tables in which entries are pushed constantly(300k entries/5min,6-7Gb/day). I started with tables splitted in 32 regions.
> File size is currently set to 1Gb. I'm using this tables to perfom real-time scans via a web app. 
> Problem: Sometimes,but pretty frequently tables are frozen and I get scanner timeout exception.I found in logs that many splits and compactions are performing and I think this are the cause. If I stop pushing data into tables, are scans are running ok.
> Could you provide me some advices to do in order to avoid this problem?

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira