You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Liang-Chi Hsieh (JIRA)" <ji...@apache.org> on 2015/04/30 18:32:06 UTC
[jira] [Comment Edited] (SPARK-7196) decimal precision lost when
loading DataFrame from JDBC
[ https://issues.apache.org/jira/browse/SPARK-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521776#comment-14521776 ]
Liang-Chi Hsieh edited comment on SPARK-7196 at 4/30/15 4:31 PM:
-----------------------------------------------------------------
[~kgeis] thanks. I think I know where the problem is. I update the jdbc_precision branch. Please apply it and test again.
was (Author: viirya):
[~kgeis] thanks. I think I know where is the problem. I update the jdbc_precision branch. Please apply it and test again.
> decimal precision lost when loading DataFrame from JDBC
> -------------------------------------------------------
>
> Key: SPARK-7196
> URL: https://issues.apache.org/jira/browse/SPARK-7196
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.3.1
> Reporter: Ken Geis
>
> I have a decimal database field that is defined as 10.2 (i.e. ##########.##). When I load it into Spark via sqlContext.jdbc(..), the type of the corresponding field in the DataFrame is DecimalType, with precisionInfo None. Because of that loss of precision information, SPARK-4176 is triggered when I try to .saveAsTable(..).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org