[jira] [Created] (SPARK-3109) Sql query with OR condition should be handled above PhysicalOperation layer

["Alex Liu (JIRA)" <ji...@apache.org>]

Alex Liu created SPARK-3109:
-------------------------------

             Summary: Sql query with OR condition should be handled above PhysicalOperation layer
                 Key: SPARK-3109
                 URL: https://issues.apache.org/jira/browse/SPARK-3109
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 1.0.2
            Reporter: Alex Liu


For query like 
{code}
select d, e  from test where a = 1 and b = 1 and c = 1 and d > 20 or  d < 0
{code}

Spark SQL pushes the whole query to PhysicalOperation. I haven't check how Spark SQL internal query plan works, but I think "OR" condition in the above query should be handled above physical operation. Physical operation should have the following query
{code} select d, e from test where a = 1 and b = 1 and c  = 1 and d > 20 {code}
OR
{code}select d, e from test where d < 0 {code}



--
This message was sent by Atlassian JIRA
(v6.2#6252)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org