You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "David Li (Jira)" <ji...@apache.org> on 2022/10/03 13:13:00 UTC

[jira] [Created] (ARROW-17914) [Java] Support reading a subset of fields from an IPC file or stream

David Li created ARROW-17914:
--------------------------------

             Summary: [Java] Support reading a subset of fields from an IPC file or stream
                 Key: ARROW-17914
                 URL: https://issues.apache.org/jira/browse/ARROW-17914
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Java
            Reporter: David Li


C++ supports {{IpcReadOptions.included_fields}} which lets you load a subset of (top-level) fields from an IPC file or stream, potentially saving on I/O costs. It would be useful to support this in Java as well. Some refactoring would be required since MessageSerializer currently reads record batch messages in as a whole, and it would be good to quantify how much of a benefit this provides in different scenarios.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)