You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2020/10/12 20:34:00 UTC

[jira] [Assigned] (SPARK-33122) Remove redundant aggregates in the Optimzier

     [ https://issues.apache.org/jira/browse/SPARK-33122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-33122:
------------------------------------

    Assignee: Apache Spark

> Remove redundant aggregates in the Optimzier
> --------------------------------------------
>
>                 Key: SPARK-33122
>                 URL: https://issues.apache.org/jira/browse/SPARK-33122
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.0.1
>            Reporter: Tanel Kiis
>            Assignee: Apache Spark
>            Priority: Major
>
> It is possible to have two or more consecutive aggregates whose sole purpose is to keep only distinct values (for example TPCDS q87). We can remove all but the last one do improve performance.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org