You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ma...@apache.org on 2015/02/26 00:37:16 UTC
spark git commit: [SPARK-5926] [SQL] make DataFrame.explain leverage
queryExecution.logical
Repository: spark
Updated Branches:
refs/heads/master 12dbf98c5 -> 41e2e5acb
[SPARK-5926] [SQL] make DataFrame.explain leverage queryExecution.logical
DataFrame.explain return wrong result when the query is DDL command.
For example, the following two queries should print out the same execution plan, but it not.
sql("create table tb as select * from src where key > 490").explain(true)
sql("explain extended create table tb as select * from src where key > 490")
This is because DataFrame.explain leverage logicalPlan which had been forced executed, we should use the unexecuted plan queryExecution.logical.
Author: Yanbo Liang <yb...@gmail.com>
Closes #4707 from yanboliang/spark-5926 and squashes the following commits:
fa6db63 [Yanbo Liang] logicalPlan is not lazy
0e40a1b [Yanbo Liang] make DataFrame.explain leverage queryExecution.logical
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/41e2e5ac
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/41e2e5ac
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/41e2e5ac
Branch: refs/heads/master
Commit: 41e2e5acb749c25641f1f8dea5a2e1d8af319486
Parents: 12dbf98
Author: Yanbo Liang <yb...@gmail.com>
Authored: Wed Feb 25 15:37:13 2015 -0800
Committer: Michael Armbrust <mi...@databricks.com>
Committed: Wed Feb 25 15:37:13 2015 -0800
----------------------------------------------------------------------
sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/41e2e5ac/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
----------------------------------------------------------------------
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala b/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
index 04bf5d9..f045da3 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/DataFrame.scala
@@ -264,7 +264,7 @@ class DataFrame protected[sql](
*/
def explain(extended: Boolean): Unit = {
ExplainCommand(
- logicalPlan,
+ queryExecution.logical,
extended = extended).queryExecution.executedPlan.executeCollect().map {
r => println(r.getString(0))
}
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org