You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "lyc (JIRA)" <ji...@apache.org> on 2017/05/27 09:52:04 UTC
[jira] [Commented] (SPARK-20320) AnalysisException: Columns of
grouping_id (count(value#17L)) does not match grouping columns
(count(value#17L))
[ https://issues.apache.org/jira/browse/SPARK-20320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027384#comment-16027384 ]
lyc commented on SPARK-20320:
-----------------------------
It seems `count("value")` should not be in `cube`, there should only be column names.Like in `groupBy`, it is invalid to `group by count("value")`.
> AnalysisException: Columns of grouping_id (count(value#17L)) does not match grouping columns (count(value#17L))
> ---------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-20320
> URL: https://issues.apache.org/jira/browse/SPARK-20320
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Jacek Laskowski
> Priority: Minor
>
> I'm not questioning the {{AnalysisException}} (which I don't know whether should be reported or not), but the exception message that tells...nothing helpful.
> {code}
> val records = spark.range(5).flatMap(n => Seq.fill(n.toInt)(n))
> scala> records.cube(count("value")).agg(grouping_id(count("value"))).queryExecution.logical
> org.apache.spark.sql.AnalysisException: Columns of grouping_id (count(value#17L)) does not match grouping columns (count(value#17L));
> at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveGroupingAnalytics$$anonfun$org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveGroupingAnalytics$$replaceGroupingFunc$1.applyOrElse(Analyzer.scala:313)
> at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveGroupingAnalytics$$anonfun$org$apache$spark$sql$catalyst$analysis$Analyzer$ResolveGroupingAnalytics$$replaceGroupingFunc$1.applyOrElse(Analyzer.scala:308)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org