You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "ARF (Jira)" <ji...@apache.org> on 2021/03/08 11:05:00 UTC

[jira] [Created] (ARROW-11902) Allow for custom_metadata for Tensor and SparseTensor IPC messages

ARF created ARROW-11902:
---------------------------

             Summary: Allow for custom_metadata for Tensor and SparseTensor IPC messages
                 Key: ARROW-11902
                 URL: https://issues.apache.org/jira/browse/ARROW-11902
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Format
            Reporter: ARF


The {{Schema}} IPC message allows {{custom_metadata}}. [See here:|https://github.com/apache/arrow/blob/69d436dff83ce33e43acf3e2402e72317fa82aa7/format/Schema.fbs#L401]

It would be great if one could specify similar {{custom_metadata}} for {{Tensor}} and {{SparseTensor}} messages. Currently if one wants to pass the "context/metadata" of a tensor, one has to find out-of-band solutions.

It would be nice, if this could be incorporated into the IPC flow. E.g. one might want to pass a timestamp associated with a tensor indicating when the data was obtained or geographical coordinates indicating the edges of a 2D tensor to locate the data geographically.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)