[jira] [Resolved] (CARBONDATA-1945) documentation for bad records action needs to be updated

["Liang Chen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/CARBONDATA-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Liang Chen resolved CARBONDATA-1945.
------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.3.0

> documentation for bad records action needs to be updated
> --------------------------------------------------------
>
>                 Key: CARBONDATA-1945
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1945
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: docs
>    Affects Versions: 1.3.0
>         Environment: spark 2.1
>            Reporter: Vandana Yadav
>            Assignee: Vandana Yadav
>            Priority: Trivial
>             Fix For: 1.3.0
>
>         Attachments: 2000_UniqData.csv
>
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> We should update bad record action's default value as while creating and loading data with some empty or bad record it is giving exception 
> Error: java.lang.Exception: Data load failed due to bad record:
> Steps to reproduce:
> 1) Create Table:
> CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB")
> 2) Load data:
> LOAD DATA inpath 'hdfs://localhost:54310/Data/uniqdata/2000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1','TIMESTAMPFORMAT'='yyyy-MM-dd HH:mm:ss');
> 3) Output: 
> Expected output: data should be loaded successfully.
> Actual Output: Error: java.lang.Exception: Data load failed due to bad record: The value with column name dob and column data type TIMESTAMP is not a valid TIMESTAMP type. (state=,code=0)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)