You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2015/05/01 11:05:06 UTC

[jira] [Assigned] (SPARK-7299) saving Oracle-source DataFrame to Hive changes scale

     [ https://issues.apache.org/jira/browse/SPARK-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Apache Spark reassigned SPARK-7299:
-----------------------------------

    Assignee:     (was: Apache Spark)

> saving Oracle-source DataFrame to Hive changes scale
> ----------------------------------------------------
>
>                 Key: SPARK-7299
>                 URL: https://issues.apache.org/jira/browse/SPARK-7299
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 1.3.1
>            Reporter: Ken Geis
>
> When I load data from Oracle, save it to a table, then select from it, the scale is changed.
> For example, I have a column defined as NUMBER(12, 2). I insert 19999 into the column. When I write that to a table and select from it, the result is 199.99.
> Some databases (e.g. H2) will return this as 19999.00, but Oracle returns it as 19999. I believe that when the file is written out to parquet, the scale information is taken from the schema, not the value. In an Oracle (at least) JDBC DataFrame, the scale may be different from row to row.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org