You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Nilesh Patil (Jira)" <ji...@apache.org> on 2020/11/09 10:54:00 UTC

[jira] [Created] (SPARK-33395) Spark reading data in scientific notation

Nilesh Patil created SPARK-33395:
------------------------------------

             Summary: Spark reading data in scientific notation
                 Key: SPARK-33395
                 URL: https://issues.apache.org/jira/browse/SPARK-33395
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.3.4
            Reporter: Nilesh Patil


File is having below data

DAta
1200404151072.121111111111
1200404151073
1200404151074.1232323
1200404151075.124344
1200404151076.12
1200404151077.123433333
1200404151078.12
1200404151079.12544545454554
1251080.1234444444444444444444
10000000000000000000000000000

 

Spark is reading with scientific notation as we wanted to read data as it is available in file with accurate datatype not with string datatype.

+--------------------+
| DAta|
+--------------------+
|1.200404151072121E12|
| 1.200404151073E12|
|1.200404151074123...|
|1.200404151075124...|
| 1.20040415107612E12|
|1.200404151077123...|
| 1.20040415107812E12|
|1.200404151079125...|
| 1251080.1234444445|
| 1.0E28|
+--------------------

 

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org