You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Jorge Leitão (Jira)" <ji...@apache.org> on 2021/07/01 17:14:00 UTC

[jira] [Created] (ARROW-13240) [C++][Parquet] Page statistics not written in v2?

Jorge Leitão created ARROW-13240:
------------------------------------

             Summary: [C++][Parquet] Page statistics not written in v2?
                 Key: ARROW-13240
                 URL: https://issues.apache.org/jira/browse/ARROW-13240
             Project: Apache Arrow
          Issue Type: Bug
            Reporter: Jorge Leitão


While working in integration tests of parquet2 against pyarrow, I noticed that page statistics are only written by pyarrow when using version 1.

I do not have an easy way to reproduce this within pyarrow as I am not sure how to access individual pages from a column chunk, but it is something that I observe when trying to integrate.

The row group stats are still written, this only affects page statistics.

pyarrow call:

```
pa.parquet.write_table(
        t,
        path,
        version="2.0",
        data_page_version="2.0",
        write_statistics=True,
    )
```

changing version to "1.0" does not impact this behavior, suggesting that the specific option causing this behavior is the data_page_version="2.0".




--
This message was sent by Atlassian Jira
(v8.3.4#803005)