You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Abdul Rahman <ab...@outlook.com> on 2017/09/29 20:19:31 UTC

Inconsistent naming of list column type in parquet (appending .list.element to column name) ?

I have a parquet file which has a column of type list. When loading the particular column from the file by name, it gives me an error specifying invalid key error

A deeper look in ColumnSchema of the particular column revealed that the column name is listed as <name>.list.element ? Is this a bug

Here's the schema of the file

[cid:23cea9e1-f012-4cc6-b404-deb8084529eb]
[cid:dce433ae-48ab-42c8-ac83-6b7ddd830f60]

Here's the ColumnSchema

[cid:d2ae2101-9d38-43ff-952b-209a7e62d450]

If i read the column like this, it works

[cid:41f40ad7-207b-481f-81ab-1fc3648ed38b]

I am using version 0.4.0. Is this solved in later releases ?

Re: Inconsistent naming of list column type in parquet (appending .list.element to column name) ?

Posted by Wes McKinney <we...@gmail.com>.
It looks like some images are missing from your post. Can you update to
0.7.0?

On Fri, Sep 29, 2017 at 3:19 PM, Abdul Rahman <ab...@outlook.com>
wrote:

> I have a parquet file which has a column of type list. When loading the
> particular column from the file by name, it gives me an error specifying
> invalid key error
>
> A deeper look in ColumnSchema of the particular column revealed that the
> column name is listed as <name>.list.element ? Is this a bug
>
> Here's the schema of the file
>
>
>
>
> Here's the ColumnSchema
>
>
>
> If i read the column like this, it works
>
>
>
> I am using version 0.4.0. Is this solved in later releases ?
>