[jira] [Reopened] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

["Liang-Chi Hsieh (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Liang-Chi Hsieh reopened SPARK-6586:
------------------------------------

> Add the capability of retrieving original logical plan of DataFrame
> -------------------------------------------------------------------
>
>                 Key: SPARK-6586
>                 URL: https://issues.apache.org/jira/browse/SPARK-6586
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Liang-Chi Hsieh
>            Priority: Minor
>
> In order to solve a bug, since #5217, {{DataFrame}} now uses analyzed plan instead of logical plan. However, by doing that we can't know the logical plan of a {{DataFrame}}. But it might be still useful and important to retrieve the original logical plan in some use cases.
> In this pr, we introduce the capability of retrieving original logical plan of {{DataFrame}}.
> The approach is that we add an {{analyzed}} variable to {{LogicalPlan}}. Once {{Analyzer}} finishes analysis, it sets {{analyzed}} of {{LogicalPlan}} as {{true}}.  In {{QueryExecution}}, we keep the original logical plan in the analyzed plan. In {{LogicalPlan}}, a method {{originalPlan}} is added to recursively replace the analyzed logical plan with original logical plan and retrieve it.
> Besides the capability of retrieving original logical plan, this modification also can avoid do plan analysis if it is already analyzed.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org