[jira] [Updated] (SPARK-38832) Remove unnecessary distinct in aggregate expression by distinctKeys

["XiDuo You (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-38832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

XiDuo You updated SPARK-38832:
------------------------------
    Description: 
We can remove the distinct in aggregate expression if the child distinct semantics is guaranteed.

For example:
{code:java}
SELECT count(distinct c) FROM (
  SELECT c FROM t GROUP BY c
){code}
 

 

 

  was:
We can remove the distinct in aggregate expression if the child distinct semantics is guaranteed.

For example:

 
{code:java}
SELECT count(distinct c) FROM (
  SELECT c FROM t GROUP BY c
){code}
 

 

 


> Remove unnecessary distinct in aggregate expression by distinctKeys
> -------------------------------------------------------------------
>
>                 Key: SPARK-38832
>                 URL: https://issues.apache.org/jira/browse/SPARK-38832
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 3.4.0
>            Reporter: XiDuo You
>            Priority: Major
>
> We can remove the distinct in aggregate expression if the child distinct semantics is guaranteed.
> For example:
> {code:java}
> SELECT count(distinct c) FROM (
>   SELECT c FROM t GROUP BY c
> ){code}
>  
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org