You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Bankim Bhavsar (Jira)" <ji...@apache.org> on 2019/10/21 17:52:00 UTC

[jira] [Created] (KUDU-2981) Push predicate evaluation into more CFile decoders

Bankim Bhavsar created KUDU-2981:
------------------------------------

             Summary: Push predicate evaluation into more CFile decoders
                 Key: KUDU-2981
                 URL: https://issues.apache.org/jira/browse/KUDU-2981
             Project: Kudu
          Issue Type: Improvement
          Components: cfile, perf
            Reporter: Bankim Bhavsar
            Assignee: Bankim Bhavsar
             Fix For: 1.12.0


Commit c0f3727 added an optimization to push predicate evaluation into the CFile decoders without fully materializing the contents of each cblock. It did this with dictionary-encoded blocks, but the optimization can be applied to any other encoding types too.

A low hanging fruit is RLE decoders, which should be able to evaluate the predicate for each run instead of materializing each cell and then applying the predicate.

KUDU-736 also notes that we may be able to apply some predicates on bitshuffled data.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)