You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kudu.apache.org by "Bankim Bhavsar (Jira)" <ji...@apache.org> on 2019/10/21 17:55:00 UTC

[jira] [Commented] (KUDU-2852) Push predicate evaluation into RLE Int type decoder

    [ https://issues.apache.org/jira/browse/KUDU-2852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956331#comment-16956331 ] 

Bankim Bhavsar commented on KUDU-2852:
--------------------------------------

Filed separate JIRA KUDU-2981 for remaining decoder types.

> Push predicate evaluation into RLE Int type decoder
> ---------------------------------------------------
>
>                 Key: KUDU-2852
>                 URL: https://issues.apache.org/jira/browse/KUDU-2852
>             Project: Kudu
>          Issue Type: Improvement
>          Components: cfile, perf
>            Reporter: Andrew Wong
>            Assignee: Bankim Bhavsar
>            Priority: Major
>              Labels: newbie
>             Fix For: 1.11.0
>
>
> Commit c0f3727 added an optimization to push predicate evaluation into the CFile decoders without fully materializing the contents of each cblock. It did this with dictionary-encoded blocks, but the optimization can be applied to any other encoding types too.
> A low hanging fruit is RLE decoders, which should be able to evaluate the predicate for each run instead of materializing each cell and then applying the predicate.
> KUDU-736 also notes that we may be able to apply some predicates on bitshuffled data.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)