[jira] [Updated] (ARROW-5212) Array BinaryBuilder in Go library has no access to resize the values buffer

["Joris Van den Bossche (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joris Van den Bossche updated ARROW-5212:
-----------------------------------------
    Component/s: Go

> Array BinaryBuilder in Go library has no access to resize the values buffer
> ---------------------------------------------------------------------------
>
>                 Key: ARROW-5212
>                 URL: https://issues.apache.org/jira/browse/ARROW-5212
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Go
>            Reporter: Jonathan A Sternberg
>            Priority: Minor
>
> When you are dealing with a binary builder, there are three buffers: the null bitmap, the offset indexes, and the values buffer which contains the actual data.
> When {{Reserve}} or {{Resize}} are used, the null bitmap and the offsets are modified to allow for additional appends to function. This seems correct to me. There's no way to know how much the values buffer should be resized until the values are being appended with just the number of values alone.
> But, when you are then appending a bunch of string values, there's no additional API to preallocate the size of that last buffer. That means that batch appending a large amount of strings will constantly allocate even if you know the size ahead of time.
> There should be some additional API to modify this last buffer such as maybe {{ReserveBytes}} and {{ResizeBytes}} that would correspond with the {{Reserve}} and {{Resize}} methods, but would related to the values buffer.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)