You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Lars Volker (JIRA)" <ji...@apache.org> on 2017/08/30 18:10:00 UTC

[jira] [Resolved] (IMPALA-5840) Don't write page level statistics in Parquet files in anticipation of page indexes

     [ https://issues.apache.org/jira/browse/IMPALA-5840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Lars Volker resolved IMPALA-5840.
---------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 2.11.0

IMPALA-5840: Don't write page-level statistics in Parquet files.

Page level statistics in Parquet files are expected to be deprecated in
favor of page indexes (PARQUET-922). This change disables writing
statistics to pages. Impala is currently the only project writing them.
Neither Impala nor other projects make use of these right now and by not
writing them anymore we prevent others from depending on soon-to-be
deprecated fields.

Change-Id: I1b05131320370171d76e93a46b04880a7f9b6d84
Reviewed-on: http://gerrit.cloudera.org:8080/7817
Reviewed-by: Lars Volker <lv...@cloudera.com>
Tested-by: Impala Public Jenkins

> Don't write page level statistics in Parquet files in anticipation of page indexes
> ----------------------------------------------------------------------------------
>
>                 Key: IMPALA-5840
>                 URL: https://issues.apache.org/jira/browse/IMPALA-5840
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 2.9.0
>            Reporter: Lars Volker
>            Assignee: Lars Volker
>            Priority: Blocker
>              Labels: parquet
>             Fix For: Impala 2.11.0
>
>
> The Parquet project is very likely to deprecate page level statistics in favor of page indexes (PARQUET-922). We should stop writing the page level statistics now since we don't plan to add read support for them.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)