You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Abderrahmane Jaidi (Jira)" <ji...@apache.org> on 2022/08/04 16:12:00 UTC

[jira] [Created] (ARROW-17308) ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API

Abderrahmane Jaidi created ARROW-17308:
------------------------------------------

             Summary: ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API
                 Key: ARROW-17308
                 URL: https://issues.apache.org/jira/browse/ARROW-17308
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
            Reporter: Abderrahmane Jaidi


Documentation for PyArrow 6.x and 7.x both indicate that the `validate_schema` argument is supported in the `ParquetDataset` class. Yet passing that argument to an instance results in:

ValueError: Keyword 'validate_schema' is not yet supported with the new Dataset API

Code:

```
parquet_dataset = pyarrow.parquet.ParquetDataset(
    path_or_paths=paths,
    validate_schema=validate_schema,
    filesystem=filesystem,
    partitioning=partitioning,
    use_legacy_dataset=False,
)
```

Docs link:

[https://arrow.apache.org/docs/6.0/python/generated/pyarrow.parquet.ParquetDataset.html]

[https://arrow.apache.org/docs/7.0/python/generated/pyarrow.parquet.ParquetDataset.html] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)