You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2015/03/28 13:15:52 UTC
[jira] [Created] (SPARK-6586) Add the capability of retrieving
original logical plan of DataFrame
Liang-Chi Hsieh created SPARK-6586:
--------------------------------------
Summary: Add the capability of retrieving original logical plan of DataFrame
Key: SPARK-6586
URL: https://issues.apache.org/jira/browse/SPARK-6586
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Liang-Chi Hsieh
Priority: Minor
In order to solve a bug, since #5217, {{DataFrame}} now uses analyzed plan instead of logical plan. However, by doing that we can't know the logical plan of a {{DataFrame}}. But it might be still useful and important to retrieve the original logical plan in some use cases.
In this pr, we introduce the capability of retrieving original logical plan of {{DataFrame}}.
The approach is that we add an {{analyzed}} variable to {{LogicalPlan}}. Once {{Analyzer}} finishes analysis, it sets {{analyzed}} of {{LogicalPlan}} as {{true}}. In {{QueryExecution}}, we keep the original logical plan in the analyzed plan. In {{LogicalPlan}}, a method {{originalPlan}} is added to recursively replace the analyzed logical plan with original logical plan and retrieve it.
Besides the capability of retrieving original logical plan, this modification also can avoid do plan analysis if it is already analyzed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org