You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Li Jin (JIRA)" <ji...@apache.org> on 2018/10/11 15:45:00 UTC

[jira] [Created] (ARROW-3495) Optimize bit operations performance

Li Jin created ARROW-3495:
-----------------------------

             Summary: Optimize bit operations performance
                 Key: ARROW-3495
                 URL: https://issues.apache.org/jira/browse/ARROW-3495
             Project: Apache Arrow
          Issue Type: Task
          Components: Java
    Affects Versions: 0.11.0
            Reporter: Li Jin


From [~atrivedi]'s benchmark finding:

2) Materialize values from Validity and Value direct buffers instead of
calling getInt() function on the IntVector. This is implemented as a new
Unsafe reader type (
[https://github.com/animeshtrivedi/benchmarking-arrow/blob/master/src/main/java/com/github/animeshtrivedi/benchmark/ArrowReaderUnsafe.java#L31]
)

3) Optimize bitmap operation to check if a bit is set or not (
[https://github.com/animeshtrivedi/benchmarking-arrow/blob/master/src/main/java/com/github/animeshtrivedi/benchmark/ArrowReaderUnsafe.java#L23]
)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)