[jira] [Created] (SPARK-21263) Exception is not thrown while converting an invalid string to float/double

["Navya Krishnappa (JIRA)" <ji...@apache.org>]

Navya Krishnappa created SPARK-21263:
----------------------------------------

             Summary: Exception is not thrown while converting an invalid string to float/double
                 Key: SPARK-21263
                 URL: https://issues.apache.org/jira/browse/SPARK-21263
             Project: Spark
          Issue Type: Bug
          Components: Java API
    Affects Versions: 2.1.1
            Reporter: Navya Krishnappa


When reading a below-mentioned data by specifying user-defined schema, exception is not thrown.

Data
'PatientID','PatientName','TotalBill'
'1000','Patient1','10u000'
'1001','Patient2','30000'
'1002','Patient3','40000'
'1003','Patient4','50000'
'1004','Patient5','60000'

Schema1: 
[StructField(PatientID,IntegerType,true), StructField(PatientName,StringType,true), StructField(TotalBill,IntegerType,true)]
Result : Throws NumerFormatException 
Caused by: java.lang.NumberFormatException: For input string: "10u000"

Schema2: 
[StructField(PatientID,IntegerType,true), StructField(PatientName,StringType,true), StructField(TotalBill,DoubleType,true)]
Actual Result: 
"PatientID": 1000,
"NumberOfVisits": "400",
"TotalBill": 10,
Expected Result: Should throw NumberFormatException for input string "10u000"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org