You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean R. Owen (Jira)" <ji...@apache.org> on 2020/12/07 15:47:00 UTC
[jira] [Resolved] (SPARK-33395) Spark reading data in scientific
notation
[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean R. Owen resolved SPARK-33395.
----------------------------------
Resolution: Not A Problem
> Spark reading data in scientific notation
> -----------------------------------------
>
> Key: SPARK-33395
> URL: https://issues.apache.org/jira/browse/SPARK-33395
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.3.4, 2.4.8, 3.1.0
> Reporter: Nilesh Patil
> Priority: Major
>
> File is having below data
> DAta
> 1200404151072.121111111111
> 1200404151073
> 1200404151074.1232323
> 1200404151075.124344
> 1200404151076.12
> 1200404151077.123433333
> 1200404151078.12
> 1200404151079.12544545454554
> 1251080.1234444444444444444444
> 10000000000000000000000000000
>
> Spark is reading with scientific notation as we wanted to read data as it is available in file with accurate datatype not with string datatype.
> +--------------------+
> | DAta|
> +--------------------+
> |1.200404151072121E12|
> | 1.200404151073E12|
> |1.200404151074123...|
> |1.200404151075124...|
> | 1.20040415107612E12|
> |1.200404151077123...|
> | 1.20040415107812E12|
> |1.200404151079125...|
> | 1251080.1234444445|
> | 1.0E28|
> +--------------------
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org