You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Vandana Yadav (JIRA)" <ji...@apache.org> on 2017/12/28 05:42:00 UTC

[jira] [Created] (CARBONDATA-1945) documentation for bad records action needs to be updated

Vandana Yadav created CARBONDATA-1945:
-----------------------------------------

             Summary: documentation for bad records action needs to be updated
                 Key: CARBONDATA-1945
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-1945
             Project: CarbonData
          Issue Type: Improvement
          Components: docs
    Affects Versions: 1.3.0
         Environment: spark 2.1
            Reporter: Vandana Yadav
            Assignee: Vandana Yadav
            Priority: Trivial
         Attachments: 2000_UniqData.csv

We should update bad record action's default value as while creating and loading data with some empty or bad record it is giving exception 

Error: java.lang.Exception: Data load failed due to bad record:

Steps to reproduce:

1) Create Table:
CREATE TABLE uniqdata (CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1 int) STORED BY 'org.apache.carbondata.format' TBLPROPERTIES ("TABLE_BLOCKSIZE"= "256 MB")

2) Load data:
LOAD DATA inpath 'hdfs://localhost:54310/Data/uniqdata/2000_UniqData.csv' INTO table uniqdata options('DELIMITER'=',', 'FILEHEADER'='CUST_ID, CUST_NAME, ACTIVE_EMUI_VERSION, DOB, DOJ, BIGINT_COLUMN1, BIGINT_COLUMN2, DECIMAL_COLUMN1, DECIMAL_COLUMN2, Double_COLUMN1, Double_COLUMN2, INTEGER_COLUMN1','TIMESTAMPFORMAT'='yyyy-MM-dd HH:mm:ss');

3) Output: 

Expected output: data should be loaded successfully.

Actual Output: Error: java.lang.Exception: Data load failed due to bad record: The value with column name dob and column data type TIMESTAMP is not a valid TIMESTAMP type. (state=,code=0)




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)