You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "David Li (Jira)" <ji...@apache.org> on 2022/10/03 13:13:00 UTC
[jira] [Created] (ARROW-17914) [Java] Support reading a subset of fields from an IPC file or stream
David Li created ARROW-17914:
--------------------------------
Summary: [Java] Support reading a subset of fields from an IPC file or stream
Key: ARROW-17914
URL: https://issues.apache.org/jira/browse/ARROW-17914
Project: Apache Arrow
Issue Type: Improvement
Components: Java
Reporter: David Li
C++ supports {{IpcReadOptions.included_fields}} which lets you load a subset of (top-level) fields from an IPC file or stream, potentially saving on I/O costs. It would be useful to support this in Java as well. Some refactoring would be required since MessageSerializer currently reads record batch messages in as a whole, and it would be good to quantify how much of a benefit this provides in different scenarios.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)