You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Alenka Frim (Jira)" <ji...@apache.org> on 2022/10/04 08:40:00 UTC
[jira] [Assigned] (ARROW-14596) [Python] parquet.read_table nested fields in columns does not work for use_legacy_dataset=False
[ https://issues.apache.org/jira/browse/ARROW-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alenka Frim reassigned ARROW-14596:
-----------------------------------
Assignee: (was: Alenka Frim)
> [Python] parquet.read_table nested fields in columns does not work for use_legacy_dataset=False
> -----------------------------------------------------------------------------------------------
>
> Key: ARROW-14596
> URL: https://issues.apache.org/jira/browse/ARROW-14596
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: Tom Scheffers
> Priority: Critical
>
> Reading nested field does not work with use_legacy_dataset=False.
> This works:
>
> {code:java}
> import pyarrow.parquet as pq
> t = pq.read_table(
> source=*filename*,
> columns=['store_key', 'properties.country'],
> use_legacy_dataset=True,
> ).to_pandas()
> {code}
> This does not work (for the same parquet file):
>
> {code:java}
> import pyarrow.parquet as pq
> t = pq.read_table(
> source=*filename*,
> columns=['store_key', 'properties.country'],
> use_legacy_dataset=False,
> ).to_pandas(){code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)