You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2015/03/28 13:15:52 UTC

[jira] [Created] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

Liang-Chi Hsieh created SPARK-6586:
--------------------------------------

             Summary: Add the capability of retrieving original logical plan of DataFrame
                 Key: SPARK-6586
                 URL: https://issues.apache.org/jira/browse/SPARK-6586
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Liang-Chi Hsieh
            Priority: Minor


In order to solve a bug, since #5217, {{DataFrame}} now uses analyzed plan instead of logical plan. However, by doing that we can't know the logical plan of a {{DataFrame}}. But it might be still useful and important to retrieve the original logical plan in some use cases.

In this pr, we introduce the capability of retrieving original logical plan of {{DataFrame}}.

The approach is that we add an {{analyzed}} variable to {{LogicalPlan}}. Once {{Analyzer}} finishes analysis, it sets {{analyzed}} of {{LogicalPlan}} as {{true}}.  In {{QueryExecution}}, we keep the original logical plan in the analyzed plan. In {{LogicalPlan}}, a method {{originalPlan}} is added to recursively replace the analyzed logical plan with original logical plan and retrieve it.

Besides the capability of retrieving original logical plan, this modification also can avoid do plan analysis if it is already analyzed.
 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org