You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/05/28 00:36:04 UTC
[jira] [Commented] (SPARK-20908) Cache Manager: Hint should be
ignored in plan matching
[ https://issues.apache.org/jira/browse/SPARK-20908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027660#comment-16027660 ]
Apache Spark commented on SPARK-20908:
--------------------------------------
User 'gatorsmile' has created a pull request for this issue:
https://github.com/apache/spark/pull/18131
> Cache Manager: Hint should be ignored in plan matching
> ------------------------------------------------------
>
> Key: SPARK-20908
> URL: https://issues.apache.org/jira/browse/SPARK-20908
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.1.1, 2.2.0
> Reporter: Xiao Li
> Assignee: Xiao Li
>
> In Cache manager, the plan matching should ignore Hint.
> {noformat}
> val df1 = spark.range(10).join(broadcast(spark.range(10)))
> df1.cache()
> spark.range(10).join(spark.range(10)).explain()
> {noformat}
> The output plan of the above query shows that the second query is not using the cached data of the first query.
> {noformat}
> BroadcastNestedLoopJoin BuildRight, Inner
> :- *Range (0, 10, step=1, splits=2)
> +- BroadcastExchange IdentityBroadcastMode
> +- *Range (0, 10, step=1, splits=2)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org