You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Liya Fan (Jira)" <ji...@apache.org> on 2019/11/15 12:59:00 UTC
[jira] [Created] (ARROW-7177) [Java] Provide a utility to improve
the performance of vector loading/unloading
Liya Fan created ARROW-7177:
-------------------------------
Summary: [Java] Provide a utility to improve the performance of vector loading/unloading
Key: ARROW-7177
URL: https://issues.apache.org/jira/browse/ARROW-7177
Project: Apache Arrow
Issue Type: New Feature
Components: Java
Reporter: Liya Fan
Assignee: Liya Fan
Vector loading/unloading transforms a set of vectors to and from a set of buffers with meta data. It is heavily used in flight/IPC.
In the loading/unloading operations, only the number of type buffers are really needed. However, the current code logic gets a copy of the type buffers, which is not necessary.
In this issue, we provide a utility to get the number of type buffers, given an arrow type. It improves the performance by
1. avoiding creating objects unnecessarily.
2. avoiding list copying for vector unloading (which calls TypeLayout#getBufferTypes).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)