You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Wenchen Fan (JIRA)" <ji...@apache.org> on 2015/10/13 00:03:06 UTC

[jira] [Updated] (SPARK-11072) simplify self join handling

     [ https://issues.apache.org/jira/browse/SPARK-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Wenchen Fan updated SPARK-11072:
--------------------------------
    Description: 
self-join is a diamond problem that confuse our analyzer. Our current solution is creating new instances of leaf nodes in the right tree of join node, and update all attribute reference there. Thus there is no diamond anymore and problem fixed.

However, our execution engine can handle diamond plan and we only need to distinguish the output between left and right. So we can simplify the self-join handling by introducing a new 

> simplify self join handling
> ---------------------------
>
>                 Key: SPARK-11072
>                 URL: https://issues.apache.org/jira/browse/SPARK-11072
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Wenchen Fan
>
> self-join is a diamond problem that confuse our analyzer. Our current solution is creating new instances of leaf nodes in the right tree of join node, and update all attribute reference there. Thus there is no diamond anymore and problem fixed.
> However, our execution engine can handle diamond plan and we only need to distinguish the output between left and right. So we can simplify the self-join handling by introducing a new 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org