You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Andy Grove (Jira)" <ji...@apache.org> on 2020/12/23 16:29:00 UTC

[jira] [Commented] (ARROW-11016) [Rust] Parquet ArrayReader should allow reading a subset of row groups

    [ https://issues.apache.org/jira/browse/ARROW-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17254135#comment-17254135 ] 

Andy Grove commented on ARROW-11016:
------------------------------------

[~nevi_me] [~sunchao] Do either of you know if this would be a lot of work to implement or not? If you have any pointers for someone working on this ticket it would be appreciated.

> [Rust] Parquet ArrayReader should allow reading a subset of row groups
> ----------------------------------------------------------------------
>
>                 Key: ARROW-11016
>                 URL: https://issues.apache.org/jira/browse/ARROW-11016
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Rust
>            Reporter: Andy Grove
>            Priority: Major
>
> Parquet ArrayReader currently only supports reading an entire file from start to finish and does not allow selectively reading a subset of row groups. This prevents us from parallelizing work across threads when processing a single parquet file.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)