You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wei Zhang (Jira)" <ji...@apache.org> on 2020/11/14 04:23:00 UTC
[jira] [Commented] (SPARK-33395) Spark reading data in scientific
notation
[ https://issues.apache.org/jira/browse/SPARK-33395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231928#comment-17231928 ]
Wei Zhang commented on SPARK-33395:
-----------------------------------
Hi, i want to know what do you expect, it is like this:
|1.200404151072121E12|
|1.200404151073E12|
|1.200404151074123...|
|1.200404151075124...|
|1.20040415107612E12|
|1.200404151077123...|
|1.20040415107812E12|
|1.200404151079125...|
|1251080.1234444445|
|1.0E28|
can you give the code that you read the data in the file?
> Spark reading data in scientific notation
> -----------------------------------------
>
> Key: SPARK-33395
> URL: https://issues.apache.org/jira/browse/SPARK-33395
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.4
> Reporter: Nilesh Patil
> Priority: Critical
>
> File is having below data
> DAta
> 1200404151072.121111111111
> 1200404151073
> 1200404151074.1232323
> 1200404151075.124344
> 1200404151076.12
> 1200404151077.123433333
> 1200404151078.12
> 1200404151079.12544545454554
> 1251080.1234444444444444444444
> 10000000000000000000000000000
>
> Spark is reading with scientific notation as we wanted to read data as it is available in file with accurate datatype not with string datatype.
> +--------------------+
> | DAta|
> +--------------------+
> |1.200404151072121E12|
> | 1.200404151073E12|
> |1.200404151074123...|
> |1.200404151075124...|
> | 1.20040415107612E12|
> |1.200404151077123...|
> | 1.20040415107812E12|
> |1.200404151079125...|
> | 1251080.1234444445|
> | 1.0E28|
> +--------------------
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org