[jira] [Created] (ARROW-14379) [R] Create a custom extension of list that stores row-level metadata

["Jonathan Keane (Jira)" <ji...@apache.org>]

Jonathan Keane created ARROW-14379:
--------------------------------------

             Summary: [R] Create a custom extension of list that stores row-level metadata
                 Key: ARROW-14379
                 URL: https://issues.apache.org/jira/browse/ARROW-14379
             Project: Apache Arrow
          Issue Type: Sub-task
          Components: R
            Reporter: Jonathan Keane


Since lists can be nested, we should be able store each element as something like {{list(value = "foo", attributes = list(attr1 = TRUE, attr2 = "baz"))}} and then we can reconstitute that in the R conversion to transfer the attributes element to attributes.

This will be more efficient (since we get compression on the column + metadata/attributes) and we also will be able to filter these + use them in datasets since each row has all of the information about itself that it needs to roundtrip.

This would get us SF columns for free



--
This message was sent by Atlassian Jira
(v8.3.4#803005)