You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yin Huai (JIRA)" <ji...@apache.org> on 2015/10/19 22:26:27 UTC

[jira] [Resolved] (SPARK-11027) Better group distinct columns in query compilation

     [ https://issues.apache.org/jira/browse/SPARK-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yin Huai resolved SPARK-11027.
------------------------------
    Resolution: Won't Fix

> Better group distinct columns in query compilation
> --------------------------------------------------
>
>                 Key: SPARK-11027
>                 URL: https://issues.apache.org/jira/browse/SPARK-11027
>             Project: Spark
>          Issue Type: Sub-task
>          Components: SQL
>            Reporter: Yin Huai
>
> In AggregationQuerySuite, we have a test
> {code}
> checkAnswer(
>       sqlContext.sql(
>         """
>           |SELECT sum(distinct value1), kEY - 100, count(distinct value1)
>           |FROM agg2
>           |GROUP BY Key - 100
>         """.stripMargin),
>       Row(40, -99, 2) :: Row(0, -98, 2) :: Row(null, -97, 0) :: Row(30, null, 3) :: Nil)
> {code}
> We will treat it as having two distinct columns because sum causes a cast on value1. Maybe we can ignore the cast when we group distinct columns. So, it will not be treated as having two distinct columns.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org