You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiao Li (JIRA)" <ji...@apache.org> on 2016/10/07 23:01:20 UTC
[jira] [Commented] (SPARK-8334) Binary logical plan should provide
more realistic statistics
[ https://issues.apache.org/jira/browse/SPARK-8334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556531#comment-15556531 ]
Xiao Li commented on SPARK-8334:
--------------------------------
This will be supported after we finish CBO. Thus, close it now. Thanks!
> Binary logical plan should provide more realistic statistics
> ------------------------------------------------------------
>
> Key: SPARK-8334
> URL: https://issues.apache.org/jira/browse/SPARK-8334
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Navis
> Priority: Minor
>
> Currently, spark-sql multiplies size of two children for output size, which makes following join hash the other side of input. In multi way joins something like (A join B) join C, C will be marked as 'buildHash' target if size of C is not bigger than (size of A * size of B). Some results of TPC-H queries are greatly affected by this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org