You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Gang Wu (Jira)" <ji...@apache.org> on 2023/06/04 15:00:00 UTC

[jira] [Commented] (PARQUET-2306) Parquet statistics stats_null_count is wrong for large json string colums

    [ https://issues.apache.org/jira/browse/PARQUET-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17729072#comment-17729072 ] 

Gang Wu commented on PARQUET-2306:
----------------------------------

Hi [~rotem.l], is there any specific way to reproduce this issue?

BTW, I did a quick check and maybe it is due to the size limit of statistics

- https://issues.apache.org/jira/browse/PARQUET-372

- https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/format/converter/ParquetMetadataConverter.java#L708

> Parquet statistics stats_null_count is wrong for large json string colums
> -------------------------------------------------------------------------
>
>                 Key: PARQUET-2306
>                 URL: https://issues.apache.org/jira/browse/PARQUET-2306
>             Project: Parquet
>          Issue Type: Bug
>            Reporter: Rotem Levi
>            Priority: Major
>
> stats_null_count always None when one of the columns values is about 46977 characters length   



--
This message was sent by Atlassian Jira
(v8.20.10#820010)