You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "DB Tsai (Jira)" <ji...@apache.org> on 2020/03/03 19:24:00 UTC

[jira] [Created] (PARQUET-1809) Add new APIs for nested predicate pushdown

DB Tsai created PARQUET-1809:
--------------------------------

             Summary:  Add new APIs for nested predicate pushdown
                 Key: PARQUET-1809
                 URL: https://issues.apache.org/jira/browse/PARQUET-1809
             Project: Parquet
          Issue Type: New Feature
          Components: parquet-mr
            Reporter: DB Tsai


Currently, Parquet's *org.apache.parquet.filter2.predicate.FilterApi* is using *dot* to split the column name into multi-parts of nested fields. The drawback is that this causes issues when the field name contains *dot*.

The new APIs that will be added will take array of string directly for multi-parts of nested fields, so no confusion as using *dot* as a separator.  

See https://github.com/apache/spark/pull/27728 and [SPARK-17636] for details.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)