You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2021/10/11 15:41:00 UTC

[jira] [Created] (ARROW-14286) [Python][Parquet] Allow to select columns of a list field without requiring the list component names

Joris Van den Bossche created ARROW-14286:
---------------------------------------------

             Summary: [Python][Parquet] Allow to select columns of a list field without requiring the list component names
                 Key: ARROW-14286
                 URL: https://issues.apache.org/jira/browse/ARROW-14286
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
            Reporter: Joris Van den Bossche


Subtask for ARROW-14196.

Currently, if you have a list column, where the list elements itself are nested items (eg a list of structs), selecting a subset of that list column requires something like {{columns=["columnA.list.item.subfield"]}}. While this "list.item" is superfluous, since a list always contains a single child. So ideally we allow to specify this as {{columns=["columnA.subfield"]}}. 

This also avoids relying on the exact name of the list item (item vs element), for which the default differs between Parquet and Arrow.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)