You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jaya Krishna (JIRA)" <ji...@apache.org> on 2018/11/14 05:28:00 UTC

[jira] [Created] (SPARK-26054) Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.

Jaya Krishna created SPARK-26054:
------------------------------------

             Summary: Creating a computed column applying the spark sql rounding on a column of type decimal affects the orginal column as well.
                 Key: SPARK-26054
                 URL: https://issues.apache.org/jira/browse/SPARK-26054
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.4.0
            Reporter: Jaya Krishna
         Attachments: sparksql-rounding.png

When a computed column that rounds the value is added to a dataframe, it is affecting the value of the original column as well. The behavior depends on the database column type - If it is either float or double, the result is as expected - the original column will have its own formatting and the computed column will be rounded as per the rounding definition specified for it. However if the column type in the database is decimal, then Spark SQL is applying the rounding even to the original column.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org