You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Nick Poorman (JIRA)" <ji...@apache.org> on 2019/08/02 01:07:00 UTC

[jira] [Created] (ARROW-6107) [Go] ipc.Writer Option to skip appending data buffers

Nick Poorman created ARROW-6107:
-----------------------------------

             Summary: [Go] ipc.Writer Option to skip appending data buffers
                 Key: ARROW-6107
                 URL: https://issues.apache.org/jira/browse/ARROW-6107
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Go
            Reporter: Nick Poorman


For cases where we have a known shared memory region, it would be great if the ipc.Writer (and by extension ipc.Reader?) had the ability to write out everything but the actual buffers holding the data. That way we can still utilize the ipc mechanisms to communicate without having to serialize all the underlying data across the wire.

 

This seems like it should be possible since the `RecordBatch` flatbuffers only contain the metadata and the underlying data buffers are appended later. We just need to skip appending the underlying data buffers.

 

[~sbinet] thoughts?



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)