You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Lars Hofhansl (JIRA)" <ji...@apache.org> on 2012/11/29 21:02:58 UTC

[jira] [Created] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs

Lars Hofhansl created HBASE-7239:
------------------------------------

             Summary: Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs
                 Key: HBASE-7239
                 URL: https://issues.apache.org/jira/browse/HBASE-7239
             Project: HBase
          Issue Type: Sub-task
            Reporter: Lars Hofhansl


Result.readFields() used to read from the input stream in 8k chunks to avoid OOM issues with direct memory.
(Reading variable sized chunks into direct memory prevent the JVM from reusing the allocated direct memory and direct memory is only collected during full GCs)

This is just to verify protobufs parseFrom type methods do the right thing as well so that we do not reintroduce this problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HBASE-7239) Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs

Posted by "stack (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HBASE-7239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

stack updated HBASE-7239:
-------------------------

    Priority: Critical  (was: Major)
    
> Verify protobuf serialization is correctly chunking upon read to avoid direct memory OOMs
> -----------------------------------------------------------------------------------------
>
>                 Key: HBASE-7239
>                 URL: https://issues.apache.org/jira/browse/HBASE-7239
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Lars Hofhansl
>            Priority: Critical
>             Fix For: 0.96.0
>
>
> Result.readFields() used to read from the input stream in 8k chunks to avoid OOM issues with direct memory.
> (Reading variable sized chunks into direct memory prevent the JVM from reusing the allocated direct memory and direct memory is only collected during full GCs)
> This is just to verify protobufs parseFrom type methods do the right thing as well so that we do not reintroduce this problem.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira