You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2016/08/09 08:56:20 UTC

[jira] [Created] (SPARK-16971) Strip trailing zeros for decimals when using show() API in Dataset

Hyukjin Kwon created SPARK-16971:
------------------------------------

             Summary: Strip trailing zeros for decimals when using show() API in Dataset
                 Key: SPARK-16971
                 URL: https://issues.apache.org/jira/browse/SPARK-16971
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Hyukjin Kwon


Currently, `Dataset.show()` prints all the trailing zeros for decimals. For example,

{code}
spark.range(11).toDF("a").select('a.cast(DecimalType(30, 20))).show()
{code}

prints below:

{code}
+--------------------+
|                   a|
+--------------------+
|               0E-20|
|1.000000000000000...|
|2.000000000000000...|
|3.000000000000000...|
|4.000000000000000...|
|5.000000000000000...|
|6.000000000000000...|
|7.000000000000000...|
|8.000000000000000...|
|9.000000000000000...|
|10.00000000000000...|
+--------------------+
{code}

It might be confusing, in particualr, for {{0E-20}}. Also, I think we can strip the trailing zeros.

So, the desired output might be as below:

{code}
+---+
|  a|
+---+
|  0|
|  1|
|  2|
|  3|
|  4|
|  5|
|  6|
|  7|
|  8|
|  9|
| 10|
+---+
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org