You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "xiangxiang Shen (Jira)" <ji...@apache.org> on 2021/11/26 06:06:00 UTC

[jira] [Commented] (ARROW-14890) [C++][Dataset] Add support for filter pushdown in the ORC Scanner

    [ https://issues.apache.org/jira/browse/ARROW-14890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17449382#comment-17449382 ] 

xiangxiang Shen commented on ARROW-14890:
-----------------------------------------

Hi [~jorisvandenbossche]  ，

  Would you have plans to support ORC Filter pushdown?

Thanks

> [C++][Dataset] Add support for filter pushdown in the ORC Scanner
> -----------------------------------------------------------------
>
>                 Key: ARROW-14890
>                 URL: https://issues.apache.org/jira/browse/ARROW-14890
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++
>            Reporter: xiangxiang Shen
>            Priority: Major
>              Labels: C++, ORC, dataset
>
> In arrow dataset, Filter pushdown can improve reading files performance greatly. We notice parquet has implemented, https://github.com/apache/arrow/blob/35b3567e73423420a99dbe6116f000e3c77d2a4c/cpp/src/arrow/dataset/file_parquet.cc#L465-L484.
> But ORC fileformat has not supported Filter pushdown. It ignores the "filter" of  ScanOptions now.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)