You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Alenka Frim (Jira)" <ji...@apache.org> on 2022/10/20 12:32:00 UTC
[jira] [Closed] (ARROW-17308) ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API
[ https://issues.apache.org/jira/browse/ARROW-17308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Alenka Frim closed ARROW-17308.
-------------------------------
Resolution: Duplicate
> ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API
> -----------------------------------------------------------------------------------
>
> Key: ARROW-17308
> URL: https://issues.apache.org/jira/browse/ARROW-17308
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: Abderrahmane Jaidi
> Priority: Major
> Labels: dataset-parquet-legacy, dataset-parquet-read
>
> Documentation for PyArrow 6.x and 7.x both indicate that the `validate_schema` argument is supported in the `ParquetDataset` class. Yet passing that argument to an instance results in:
> ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API
> Code:
> {code:python}
> parquet_dataset = pyarrow.parquet.ParquetDataset(
> path_or_paths=paths,
> validate_schema=validate_schema,
> filesystem=filesystem,
> partitioning=partitioning,
> use_legacy_dataset=False,
> ){code}
> Docs link:
> [https://arrow.apache.org/docs/6.0/python/generated/pyarrow.parquet.ParquetDataset.html]
> [https://arrow.apache.org/docs/7.0/python/generated/pyarrow.parquet.ParquetDataset.html]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)