[jira] [Resolved] (PARQUET-160) Simplify CapacityByteArrayOutputStream

["Alex Levenson (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PARQUET-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Alex Levenson resolved PARQUET-160.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: parquet-mr_1.6.0

Issue resolved by pull request 98
[https://github.com/apache/incubator-parquet-mr/pull/98]

> Simplify CapacityByteArrayOutputStream
> --------------------------------------
>
>                 Key: PARQUET-160
>                 URL: https://issues.apache.org/jira/browse/PARQUET-160
>             Project: Parquet
>          Issue Type: Improvement
>            Reporter: Alex Levenson
>            Priority: Minor
>             Fix For: parquet-mr_1.6.0
>
>
> There's a lot of complicated logic around trying to re-use byte buffers as well as allocating slabs before they are needed as well as shrinking / consolidating. 
> After discussing with [~julienledem] we should simplify and not bother reusing the byte buffers, and not allocate buffers until they are needed. The hope is this will reduce the memory overhead and that the number of byte buffers should be small so they should not cause trouble for GC.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)