You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@arrow.apache.org by "xiangxiang Shen (Jira)" <ji...@apache.org> on 2021/11/26 06:04:00 UTC

[jira] [Created] (ARROW-14890) [C++][Dataset] Add support for filter pushdown in the ORC Scanner

xiangxiang Shen created ARROW-14890:
---------------------------------------

             Summary: [C++][Dataset] Add support for filter pushdown in the ORC Scanner
                 Key: ARROW-14890
                 URL: https://issues.apache.org/jira/browse/ARROW-14890
             Project: Apache Arrow
          Issue Type: Improvement
          Components: C++
            Reporter: xiangxiang Shen


In arrow dataset, Filter pushdown can improve reading files performance greatly. We notice parquet has implemented, https://github.com/apache/arrow/blob/35b3567e73423420a99dbe6116f000e3c77d2a4c/cpp/src/arrow/dataset/file_parquet.cc#L465-L484.
But ORC fileformat has not supported Filter pushdown. It ignores the "filter" of  ScanOptions now.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)