You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yin Huai (JIRA)" <ji...@apache.org> on 2015/10/19 22:26:27 UTC
[jira] [Resolved] (SPARK-11027) Better group distinct columns in
query compilation
[ https://issues.apache.org/jira/browse/SPARK-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yin Huai resolved SPARK-11027.
------------------------------
Resolution: Won't Fix
> Better group distinct columns in query compilation
> --------------------------------------------------
>
> Key: SPARK-11027
> URL: https://issues.apache.org/jira/browse/SPARK-11027
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Yin Huai
>
> In AggregationQuerySuite, we have a test
> {code}
> checkAnswer(
> sqlContext.sql(
> """
> |SELECT sum(distinct value1), kEY - 100, count(distinct value1)
> |FROM agg2
> |GROUP BY Key - 100
> """.stripMargin),
> Row(40, -99, 2) :: Row(0, -98, 2) :: Row(null, -97, 0) :: Row(30, null, 3) :: Nil)
> {code}
> We will treat it as having two distinct columns because sum causes a cast on value1. Maybe we can ignore the cast when we group distinct columns. So, it will not be treated as having two distinct columns.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org