You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2020/10/12 20:58:00 UTC

[jira] [Updated] (SPARK-33122) Remove redundant aggregates in the Optimzier

     [ https://issues.apache.org/jira/browse/SPARK-33122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun updated SPARK-33122:
----------------------------------
    Affects Version/s:     (was: 3.0.1)
                       3.1.0

> Remove redundant aggregates in the Optimzier
> --------------------------------------------
>
>                 Key: SPARK-33122
>                 URL: https://issues.apache.org/jira/browse/SPARK-33122
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.1.0
>            Reporter: Tanel Kiis
>            Priority: Major
>
> It is possible to have two or more consecutive aggregates whose sole purpose is to keep only distinct values (for example TPCDS q87). We can remove all but the last one do improve performance.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org