You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Davies Liu (JIRA)" <ji...@apache.org> on 2016/06/23 05:57:16 UTC

[jira] [Created] (SPARK-16163) Statistics of logical plan is super slow on large query

Davies Liu created SPARK-16163:
----------------------------------

             Summary: Statistics of logical plan is super slow on large query
                 Key: SPARK-16163
                 URL: https://issues.apache.org/jira/browse/SPARK-16163
             Project: Spark
          Issue Type: Bug
          Components: SQL
            Reporter: Davies Liu


It took several minutes to plan TPC-DS Q64, because the canBroadcast() is super slow on large plan.

Right now, we are considering the schema in statistics(), it's not trivial anymore, we should cache the result (using lazy val rather than def).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org