You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "jorisvandenbossche (via GitHub)" <gi...@apache.org> on 2023/09/25 12:54:44 UTC

[GitHub] [arrow] jorisvandenbossche commented on a diff in pull request #37166: GH-24868: [C++] Add a Tensor logical value type with varying dimensions, implemented using ExtensionType

jorisvandenbossche commented on code in PR #37166:
URL: https://github.com/apache/arrow/pull/37166#discussion_r1335850003


##########
docs/source/format/CanonicalExtensions.rst:
##########
@@ -148,6 +148,107 @@ Fixed shape tensor
   by this specification. Instead, this extension type lets one use fixed shape tensors
   as elements in a field of a RecordBatch or a Table.
 
+.. _variable_shape_tensor_extension:
+
+Variable shape tensor
+=====================
+
+* Extension name: `arrow.variable_shape_tensor`.
+
+* The storage type of the extension is: ``StructArray`` where struct
+  is composed of **data** and **shape** fields describing a single
+  tensor per row:
+
+  * **data** is a ``List`` holding tensor elements of a single tensor.
+    Data type of the list elements is uniform across the entire column
+    and also provided in metadata.

Review Comment:
   ```suggestion
       Data type of the list elements is uniform across the entire column.
   ```
   
   I don't think it is provided in the metadata? (and that is also not needed, since it is part of the type already)



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org