You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Michael Styles (JIRA)" <ji...@apache.org> on 2017/06/26 19:02:00 UTC

[jira] [Created] (SPARK-21218) Convert IN predicate to equivalent Parquet filter

Michael Styles created SPARK-21218:
--------------------------------------

             Summary: Convert IN predicate to equivalent Parquet filter
                 Key: SPARK-21218
                 URL: https://issues.apache.org/jira/browse/SPARK-21218
             Project: Spark
          Issue Type: Improvement
          Components: Optimizer
    Affects Versions: 2.1.1
            Reporter: Michael Styles


Convert IN predicate to equivalent expression involving equality conditions to allow the filter to be pushed down to Parquet.

For instance,

C1 IN (10, 20) is rewritten as (C1 = 10) OR (C1 = 20)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org