You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Zoltán Borók-Nagy (JIRA)" <ji...@apache.org> on 2018/12/14 11:38:00 UTC

[jira] [Created] (IMPALA-7979) Enhance decoders to support value-skipping

Zoltán Borók-Nagy created IMPALA-7979:
-----------------------------------------

             Summary: Enhance decoders to support value-skipping
                 Key: IMPALA-7979
                 URL: https://issues.apache.org/jira/browse/IMPALA-7979
             Project: IMPALA
          Issue Type: Sub-task
            Reporter: Zoltán Borók-Nagy


When the parquet scanner can use the page index it is sometimes needed to skip values from the pages. We can just drop these values since we'll never need them.

The decoders don't support value-skipping at the moment, therefore we have to decode each and every value even if we know that we will never need many of them.

The decoders should have methods for value-skipping to make scanning more efficient.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)