You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Tanel Kiis (Jira)" <ji...@apache.org> on 2020/10/12 20:19:00 UTC

[jira] [Created] (SPARK-33122) Remove redundant aggregates in the Optimzier

Tanel Kiis created SPARK-33122:
----------------------------------

             Summary: Remove redundant aggregates in the Optimzier
                 Key: SPARK-33122
                 URL: https://issues.apache.org/jira/browse/SPARK-33122
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.0.1
            Reporter: Tanel Kiis


It is possible to have two or more consecutive aggregates whose sole purpose is to keep only distinct values (for example TPCDS q87). We can remove all but the last one do improve performance.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org