You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2022/03/01 14:17:00 UTC

[jira] [Commented] (ARROW-14890) [C++][Dataset] Add support for filter pushdown in the ORC Scanner

    [ https://issues.apache.org/jira/browse/ARROW-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17499561#comment-17499561 ] 

Joris Van den Bossche commented on ARROW-14890:
-----------------------------------------------

I don't think someone already actively started working on this.

> [C++][Dataset] Add support for filter pushdown in the ORC Scanner
> -----------------------------------------------------------------
>
>                 Key: ARROW-14890
>                 URL: https://issues.apache.org/jira/browse/ARROW-14890
>             Project: Apache Arrow
>          Issue Type: Sub-task
>          Components: C++
>            Reporter: xiangxiang Shen
>            Priority: Major
>              Labels: dataset, good-second-issue, orc
>
> In arrow dataset, Filter pushdown can improve reading files performance greatly. We notice parquet has implemented, https://github.com/apache/arrow/blob/35b3567e73423420a99dbe6116f000e3c77d2a4c/cpp/src/arrow/dataset/file_parquet.cc#L465-L484.
> But ORC fileformat has not supported Filter pushdown. It ignores the "filter" of  ScanOptions now.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)