[jira] [Created] (CARBONDATA-2263) Date data is loaded incorrectly.

["Sangeeta Gulia (JIRA)" <ji...@apache.org>]

Sangeeta Gulia created CARBONDATA-2263:
------------------------------------------

             Summary: Date data is loaded incorrectly.
                 Key: CARBONDATA-2263
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-2263
             Project: CarbonData
          Issue Type: Bug
    Affects Versions: 1.3.0
            Reporter: Sangeeta Gulia
         Attachments: dataSample.csv

When we set :

CarbonProperties.getInstance()
.addProperty(CarbonCommonConstants.CARBON_DATE_FORMAT, "yyyy/mm/dd")

and run below commands: 

spark.sql("DROP TABLE IF EXISTS t3")

spark.sql(
s"""
| CREATE TABLE IF NOT EXISTS t3(
| ID Int,
| date Date,
| country String,
| name String,
| phonetype String,
| serialname String,
| salary Int,
| floatField float
| ) STORED BY 'carbondata'
""".stripMargin)

spark.sql(s"""
LOAD DATA LOCAL INPATH '$testData' into table t3
options('ALL_DICTIONARY_PATH'='$allDictFile', 'SINGLE_PASS'='true')
""")

spark.sql("""
SELECT * FROM t3
""").show()

spark.sql("""
SELECT * FROM t3 where floatField=3.5
""").show()

spark.sql("DROP TABLE IF EXISTS t3")

Date data is loaded as below: 

+---+----------+-------+-----+---------+----------+------+----------+
| id| date|country| name|phonetype|serialname|salary|floatfield|
+---+----------+-------+-----+---------+----------+------+----------+
| 9|2015-01-18| china| aaa9| phone706| ASD86717| 15008| 2.34|
| 10|2015-01-19| usa|aaa10| phone685| ASD30505| 15009| 2.34|
| 1|2015-01-23| china| aaa1| phone197| ASD69643| 15000| 2.34|
| 2|2015-01-24| china| aaa2| phone756| ASD42892| 15001| 2.34|
| 3|2015-01-25| china| aaa3|phone1904| ASD37014| 15002| 2.34|
| 4|2015-01-26| china| aaa4|phone2435| ASD66902| 15003| 2.34|
| 5|2015-01-27| china| aaa5|phone2441| ASD90633| 15004| 2.34|
| 6|2015-01-28| china| aaa6| phone294| ASD59961| 15005| 3.5|
| 7|2015-01-29| china| aaa7| phone610| ASD14875| 15006| 2.34|
| 8|2015-01-30| china| aaa8|phone1848| ASD57308| 15007| 2.34|
+---+----------+-------+-----+---------+----------+------+----------+

 

However correct data is : 

ID,date,country,name,phonetype,serialname,salary,floatField
1,2015/7/23,china,aaa1,phone197,ASD69643,15000,2.34
2,2015/7/24,china,aaa2,phone756,ASD42892,15001,2.34
3,2015/7/25,china,aaa3,phone1904,ASD37014,15002,2.34
4,2015/7/26,china,aaa4,phone2435,ASD66902,15003,2.34
5,2015/7/27,china,aaa5,phone2441,ASD90633,15004,2.34
6,2015/7/28,china,aaa6,phone294,ASD59961,15005,3.5
7,2015/7/29,china,aaa7,phone610,ASD14875,15006,2.34
8,2015/7/30,china,aaa8,phone1848,ASD57308,15007,2.34
9,2015/7/18,china,aaa9,phone706,ASD86717,15008,2.34
10,2015/7/19,usa,aaa10,phone685,ASD30505,15009,2.34

 

which says Month data is loaded incorrectly.

 

Similarly, if we use :

CarbonProperties.getInstance()
.addProperty(CarbonCommonConstants.CARBON_DATE_FORMAT, "YYYY/mm/dd")

it again store incorrect data for date.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)