You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Abderrahmane Jaidi (Jira)" <ji...@apache.org> on 2022/08/04 16:12:00 UTC
[jira] [Created] (ARROW-17308) ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API
Abderrahmane Jaidi created ARROW-17308:
------------------------------------------
Summary: ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API
Key: ARROW-17308
URL: https://issues.apache.org/jira/browse/ARROW-17308
Project: Apache Arrow
Issue Type: Bug
Components: Python
Reporter: Abderrahmane Jaidi
Documentation for PyArrow 6.x and 7.x both indicate that the `validate_schema` argument is supported in the `ParquetDataset` class. Yet passing that argument to an instance results in:
ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API
Code:
```
parquet_dataset = pyarrow.parquet.ParquetDataset(
path_or_paths=paths,
validate_schema=validate_schema,
filesystem=filesystem,
partitioning=partitioning,
use_legacy_dataset=False,
)
```
Docs link:
[https://arrow.apache.org/docs/6.0/python/generated/pyarrow.parquet.ParquetDataset.html]
[https://arrow.apache.org/docs/7.0/python/generated/pyarrow.parquet.ParquetDataset.html]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)