[jira] [Commented] (ARROW-384) Align Java and C++ RecordBatch data and metadata layout

["Julien Le Dem (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685108#comment-15685108 ] 

Julien Le Dem commented on ARROW-384:
-------------------------------------

Here is a 3rd suggestion:
{noformat}
<metadata size: int32> <metadata> <buffers> 
{noformat}
Since we probably know the size of the flatbuffer already before writing.

[~wesmckinn]: One thing I am missing is that in the context of shared memory, buffers are not contiguous.

> Align Java and C++ RecordBatch data and metadata layout
> -------------------------------------------------------
>
>                 Key: ARROW-384
>                 URL: https://issues.apache.org/jira/browse/ARROW-384
>             Project: Apache Arrow
>          Issue Type: Bug
>            Reporter: Julien Le Dem
>
> layout on C++ side:
> {noformat}
> <buffers> <metadata> <metadata size: int32>
> {noformat}
> and on the java side:
> {noformat}
> <metadata> <buffers>
> {noformat}
> In the file format the footer has a Block info that contains the metadata length.
> https://github.com/apache/arrow/blob/f082b17323354dc2af31f39c15c58b995ba08360/format/File.fbs#L36
> See:
> https://github.com/apache/arrow/pull/211#issuecomment-262080545



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)