You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/01/23 16:37:00 UTC
[jira] [Commented] (IMPALA-5843) Use page index in Parquet files to
skip pages
[ https://issues.apache.org/jira/browse/IMPALA-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16750198#comment-16750198 ]
ASF subversion and git services commented on IMPALA-5843:
---------------------------------------------------------
Commit 969dea84f41cfccf863b14904958a5d2be91983f in impala's branch refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=969dea8 ]
IMPALA-7979: Enhance decoders to support value-skipping
This commit adds value-skipping functionality to the decoders.
Value-skipping is useful when we know that we won't need the
following N values, so instead of decoding and dropping them, we
can just "jump" through them.
This feature is a prerequisite for Parquet page skipping (IMPALA-5843).
I added backend tests for all the decoders. Backed tests related to
bitpacking are moved to the newly created bit-stream-utils-test.
Change-Id: Ib848f1bd71735fe84e8064daf700417b32589f57
Reviewed-on: http://gerrit.cloudera.org:8080/12172
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Use page index in Parquet files to skip pages
> ---------------------------------------------
>
> Key: IMPALA-5843
> URL: https://issues.apache.org/jira/browse/IMPALA-5843
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Affects Versions: Impala 2.10.0
> Reporter: Lars Volker
> Assignee: Zoltán Borók-Nagy
> Priority: Critical
> Labels: parquet, performance
>
> Once IMPALA-5842 has been resolved, we should skip pages based on the page index in Parquet files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org