You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Weiyang Zhao (Jira)" <ji...@apache.org> on 2020/11/24 00:33:00 UTC

[jira] [Updated] (ARROW-10706) [Python][Parquet] when filters end up with no partition, it will throw index out of range error.

     [ https://issues.apache.org/jira/browse/ARROW-10706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Weiyang Zhao updated ARROW-10706:
---------------------------------
    Description: 
The below code will raise IndexError:

{{dataset = pq.ParquetDataset(}}
base_path, filesystem=fs,
filters=[('string', '=', "notExisted")],
use_legacy_dataset=True
 {{)}}

when the partition 'string' does not have a matching partition value 'notExisted'.

  was:
The below code will raise IndexError:

{{dataset = pq.ParquetDataset(}}
{{ base_path, filesystem=fs,}}
{{ filters=[('string', '=', "notExisted")],}}
{{ use_legacy_dataset=True}}
{{)}}


> [Python][Parquet] when filters end up with no partition, it will throw index out of range error.
> ------------------------------------------------------------------------------------------------
>
>                 Key: ARROW-10706
>                 URL: https://issues.apache.org/jira/browse/ARROW-10706
>             Project: Apache Arrow
>          Issue Type: Bug
>            Reporter: Weiyang Zhao
>            Assignee: Weiyang Zhao
>            Priority: Major
>
> The below code will raise IndexError:
> {{dataset = pq.ParquetDataset(}}
> base_path, filesystem=fs,
> filters=[('string', '=', "notExisted")],
> use_legacy_dataset=True
>  {{)}}
> when the partition 'string' does not have a matching partition value 'notExisted'.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)