[jira] [Created] (ARROW-1059) [C++] Define API for embedding user-defined metadata / Flatbuffer message types in Arrow IPC machinery

["Wes McKinney (JIRA)" <ji...@apache.org>]

Wes McKinney created ARROW-1059:
-----------------------------------

             Summary: [C++] Define API for embedding user-defined metadata / Flatbuffer message types in Arrow IPC machinery
                 Key: ARROW-1059
                 URL: https://issues.apache.org/jira/browse/ARROW-1059
             Project: Apache Arrow
          Issue Type: New Feature
          Components: C++
            Reporter: Wes McKinney


Currently, the {{MessageHeader}} Flatbuffer union must be modified to serialize new kinds of metadata:

https://github.com/apache/arrow/blob/master/format/Message.fbs#L85

It would be interesting if user metadata could be embedded within a particular application that wishes to use the Arrow C++ libraries' zero-copy IPC machinery for serialization of other kinds of data structures. 

As one approach, the message metadata could be an application-dependent unique identifier for the user defined type, which would internally dispatch to an implementation of an abstract deserializer interface. So in addition to describing the serialized representation of the user type, we also will have to create the abstract API for the user to implement so that the code in {{arrow/ipc}} can be configured to dispatch appropriately. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)