You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Ravindra Pesala (JIRA)" <ji...@apache.org> on 2017/05/09 06:30:12 UTC

[jira] [Resolved] (CARBONDATA-646) Bad record handling is not correct for Int data type

     [ https://issues.apache.org/jira/browse/CARBONDATA-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala resolved CARBONDATA-646.
----------------------------------------
    Resolution: Duplicate

Duplicated to CARBONDATA-542

> Bad record handling is not correct for Int data type
> ----------------------------------------------------
>
>                 Key: CARBONDATA-646
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-646
>             Project: CarbonData
>          Issue Type: Bug
>    Affects Versions: 1.0.0-incubating, 0.1.1-incubating
>         Environment: Spark 1.6
>            Reporter: Ramakrishna
>            Assignee: Manish Gupta
>            Priority: Minor
>         Attachments: 646_1.PNG, 646_2.PNG
>
>
> With Bad record handling as default,
> If Char value is given for Int data type, that is handled properly(moving NULL).
> If Decimal values is given for Int Data type, it is stripping the decimal, where it should consider this as bad record and move NULL.
> Bad record csv:
> TRUE,2.7,423.0,A,200000000003454300, 121.5,4.99,2.44,SE3423ee,asfdsffdfg,EtryTRWT,2012-01-12 03:14:05.123456729,2012-01-20
> 0: jdbc:hive2://172.168.100.212:23040> select * from t_carbn01 where qty_total is NULL;
> +----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+--------------+--+
> | active_status  | item_type_cd  | qty_day_avg  | qty_total  |     sell_price      | sell_pricep  | discount_price  | profit  | item_code  |  item_name  | outlet_name  |      update_time       | create_date  |
> +----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+--------------+--+
> | TRUE           | 2             | 423          | NULL       | 200000000003454304  | 121.5        | 4.99            | 2.44    | SE3423ee   | asfdsffdfg  | EtryTRWT     | 2012-01-12 03:14:05.0  | 2012-01-20   |
> +----------------+---------------+--------------+------------+---------------------+--------------+-----------------+---------+------------+-------------+--------------+------------------------+----------
> 0: jdbc:hive2://172.168.100.212:23040> desc t_carbn01;
> +-----------------+---------------+----------+--+
> |    col_name     |   data_type   | comment  |
> +-----------------+---------------+----------+--+
> | active_status   | string        |          |
> | item_type_cd    | bigint        |          |
> | qty_day_avg     | bigint        |          |
> | qty_total       | bigint        |          |
> | sell_price      | bigint        |          |
> | sell_pricep     | double        |          |
> | discount_price  | double        |          |
> | profit          | decimal(3,2)  |          |
> | item_code       | string        |          |
> | item_name       | string        |          |
> | outlet_name     | string        |          |
> | update_time     | timestamp     |          |
> | create_date     | string        |          |
> +-----------------+---------------+----------+--+
>  



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)