[GitHub] [spark] windpiger opened a new pull request #24228: infer more filter from join or condition

[GitBox <gi...@apache.org>]

windpiger opened a new pull request #24228: infer more filter from join or condition
URL: https://github.com/apache/spark/pull/24228
 
 
   ## What changes were proposed in this pull request?
   current spark can handle this query to infer fitler from join condition:
   ```
   select * from t1 join t2 where ((t1.a = t2.d and t1.b = 1) or (t1.a = t2.d and t1.b = 5))
   
   (t1.b =1 or t1.b =5) can be infered, and pushed to table t1.
   ```
   but it can not handle following query:
   ```
   select * from t1 join t2 where (t1.a = t2.d and t1.b = 1 and t2.e=3 ) or (t1.a = t2.d and t1.b = 5 and t2.e=7)
   
   (t1.b=1 or t1.b=5) should be infered and push to t1
   (t2.e=3 or t2.e=7) should be infered and push to t2
   
   ```
   
   ## How was this patch tested?
   unit test added

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org