You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Micah Kornfield (Jira)" <ji...@apache.org> on 2020/04/27 04:13:00 UTC

[jira] [Created] (ARROW-8600) [C++]Expose API for pushing down rep/def level comparison down to decoder

Micah Kornfield created ARROW-8600:
--------------------------------------

             Summary: [C++]Expose API for  pushing down rep/def level comparison down to decoder
                 Key: ARROW-8600
                 URL: https://issues.apache.org/jira/browse/ARROW-8600
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: Micah Kornfield


[https://github.com/apache/arrow/pull/6985] shows the benefit of using SIMD for level to bitmap conversion.  We can do even better by exploiting RLE runs when doing comparisons.  Exposing an appropriate API and using that would likely improve real world use-cases even further.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)