You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by Abdul Rahman <ab...@outlook.com> on 2017/09/29 20:19:31 UTC
Inconsistent naming of list column type in parquet (appending
.list.element to column name) ?
I have a parquet file which has a column of type list. When loading the particular column from the file by name, it gives me an error specifying invalid key error
A deeper look in ColumnSchema of the particular column revealed that the column name is listed as <name>.list.element ? Is this a bug
Here's the schema of the file
[cid:23cea9e1-f012-4cc6-b404-deb8084529eb]
[cid:dce433ae-48ab-42c8-ac83-6b7ddd830f60]
Here's the ColumnSchema
[cid:d2ae2101-9d38-43ff-952b-209a7e62d450]
If i read the column like this, it works
[cid:41f40ad7-207b-481f-81ab-1fc3648ed38b]
I am using version 0.4.0. Is this solved in later releases ?
Re: Inconsistent naming of list column type in parquet (appending
.list.element to column name) ?
Posted by Wes McKinney <we...@gmail.com>.
It looks like some images are missing from your post. Can you update to
0.7.0?
On Fri, Sep 29, 2017 at 3:19 PM, Abdul Rahman <ab...@outlook.com>
wrote:
> I have a parquet file which has a column of type list. When loading the
> particular column from the file by name, it gives me an error specifying
> invalid key error
>
> A deeper look in ColumnSchema of the particular column revealed that the
> column name is listed as <name>.list.element ? Is this a bug
>
> Here's the schema of the file
>
>
>
>
> Here's the ColumnSchema
>
>
>
> If i read the column like this, it works
>
>
>
> I am using version 0.4.0. Is this solved in later releases ?
>