You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by cloud-fan <gi...@git.apache.org> on 2017/12/01 02:39:58 UTC

[GitHub] spark pull request #18692: [SPARK-21417][SQL] Infer join conditions using pr...

Github user cloud-fan commented on a diff in the pull request:

    https://github.com/apache/spark/pull/18692#discussion_r154256590
  
    --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/joins.scala ---
    @@ -152,3 +153,62 @@ object EliminateOuterJoin extends Rule[LogicalPlan] with PredicateHelper {
           if (j.joinType == newJoinType) f else Filter(condition, j.copy(joinType = newJoinType))
       }
     }
    +
    +/**
    + * A rule that eliminates CROSS joins by inferring join conditions from propagated constraints.
    + *
    + * The optimization is applicable only to CROSS joins. For other join types, adding inferred join
    --- End diff --
    
    can we apply this optimization to all joins after https://github.com/apache/spark/pull/19054?


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org