You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@arrow.apache.org by "Liya Fan (Jira)" <ji...@apache.org> on 2019/11/15 12:59:00 UTC

[jira] [Created] (ARROW-7177) [Java] Provide a utility to improve the performance of vector loading/unloading

Liya Fan created ARROW-7177:
-------------------------------

             Summary: [Java] Provide a utility to improve the performance of vector loading/unloading
                 Key: ARROW-7177
                 URL: https://issues.apache.org/jira/browse/ARROW-7177
             Project: Apache Arrow
          Issue Type: New Feature
          Components: Java
            Reporter: Liya Fan
            Assignee: Liya Fan


Vector loading/unloading transforms a set of vectors to and from a set of buffers with meta data. It is heavily used in flight/IPC. 

In the loading/unloading operations, only the number of type buffers are really needed. However, the current code logic gets a copy of the type buffers, which is not necessary.

In this issue, we provide a utility to get the number of type buffers, given an arrow type. It improves the performance by 

1. avoiding creating objects unnecessarily.
2. avoiding list copying for vector unloading (which calls TypeLayout#getBufferTypes).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)