You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Reynold Xin (JIRA)" <ji...@apache.org> on 2015/05/19 06:55:00 UTC

[jira] [Resolved] (SPARK-7687) DataFrame.describe() should cast all aggregates to String

     [ https://issues.apache.org/jira/browse/SPARK-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Reynold Xin resolved SPARK-7687.
--------------------------------
       Resolution: Fixed
    Fix Version/s: 1.4.0

> DataFrame.describe() should cast all aggregates to String
> ---------------------------------------------------------
>
>                 Key: SPARK-7687
>                 URL: https://issues.apache.org/jira/browse/SPARK-7687
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.3.1
>            Reporter: Josh Rosen
>            Assignee: Josh Rosen
>            Priority: Critical
>             Fix For: 1.4.0
>
>
> In DataFrame.describe(), the count aggregate produces an integer, the avg and stdev aggregates produce doubles, and min and max aggregates can produce varying types depending on what type of column they're applied to. As a result, we should cast all aggregate results to String so that describe()'s output types match its declared output schema.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org