You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2015/02/19 15:21:12 UTC

[jira] [Created] (SPARK-5907) Selected column from DataFrame should not re-analyze logical plan

Liang-Chi Hsieh created SPARK-5907:
--------------------------------------

             Summary: Selected column from DataFrame should not re-analyze logical plan
                 Key: SPARK-5907
                 URL: https://issues.apache.org/jira/browse/SPARK-5907
             Project: Spark
          Issue Type: Bug
          Components: SQL
            Reporter: Liang-Chi Hsieh


Currently, selecting a column from DataFrame wraps the original logical plan with a Project. As the column is used, the logical plan will be analyzed again.  For some query plan, re-analyzing would side-effect that increases expression id. So when accessing the column, column's expr and its analyzed plan will point to different expressions.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org