You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2020/08/18 07:21:00 UTC
[jira] [Created] (ARROW-9780) [Python] Legacy ParquetDataset gives
confusing error message when passed a filter for non-directory dataset
Joris Van den Bossche created ARROW-9780:
--------------------------------------------
Summary: [Python] Legacy ParquetDataset gives confusing error message when passed a filter for non-directory dataset
Key: ARROW-9780
URL: https://issues.apache.org/jira/browse/ARROW-9780
Project: Apache Arrow
Issue Type: Improvement
Components: Python
Affects Versions: 1.0.0
Reporter: Joris Van den Bossche
Not highest priority since it's for the legacy dataset, but this is rather confusing:
{code}
In [2]: pq.ParquetDataset("test.parquet", filters=[("x", ">", 4)])
...
AttributeError: 'NoneType' object has no attribute 'filter_accepts_partition'
{code}
Basically the filters argument only makes sense for a directory (because the legacy dataset only filters on partitions), but it shouldn't error like that for non-directories.
From https://github.com/dask/dask/issues/6512
--
This message was sent by Atlassian Jira
(v8.3.4#803005)