You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Francois Saint-Jacques (Jira)" <ji...@apache.org> on 2021/05/07 12:30:00 UTC
[jira] [Updated] (ARROW-12681) [Python] Expose IpcReadOptions to
ipc facility
[ https://issues.apache.org/jira/browse/ARROW-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Francois Saint-Jacques updated ARROW-12681:
-------------------------------------------
Description:
I would like to be able to read only a subset of columns from a given IPC file. To do this, we need to expose the EXPERIMENTAL (is it still?) IpcReaderOptions.include_fields option. The reason is that the file is on a remote storage and can't mmap thus I want to minimize network transfer.
I do not know the best way to "pythonize" IpcReaderOptions and would need help on this.
was:
I would like to be able to read only a subset of columns from a given IPC file. To do this, we need to expose the EXPERIMENTAL (is it still?) IpcReaderOptions.include_fields option.
I do not know the best way to "pythonize" IpcReaderOptions and would need help on this.
> [Python] Expose IpcReadOptions to ipc facility
> ----------------------------------------------
>
> Key: ARROW-12681
> URL: https://issues.apache.org/jira/browse/ARROW-12681
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Reporter: Francois Saint-Jacques
> Priority: Minor
>
> I would like to be able to read only a subset of columns from a given IPC file. To do this, we need to expose the EXPERIMENTAL (is it still?) IpcReaderOptions.include_fields option. The reason is that the file is on a remote storage and can't mmap thus I want to minimize network transfer.
> I do not know the best way to "pythonize" IpcReaderOptions and would need help on this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)