You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Ravindra Pesala (JIRA)" <ji...@apache.org> on 2017/03/07 06:45:33 UTC

[jira] [Resolved] (CARBONDATA-691) After Compaction records count are mismatched.

     [ https://issues.apache.org/jira/browse/CARBONDATA-691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ravindra Pesala resolved CARBONDATA-691.
----------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.0.1-incubating

> After Compaction records count are mismatched.
> ----------------------------------------------
>
>                 Key: CARBONDATA-691
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-691
>             Project: CarbonData
>          Issue Type: Bug
>          Components: data-load, data-query, docs
>    Affects Versions: 1.0.0-incubating
>            Reporter: Babulal
>            Assignee: sounak chakraborty
>             Fix For: 1.0.1-incubating
>
>         Attachments: createLoadcmd.txt, driverlog.txt
>
>          Time Spent: 3.5h
>  Remaining Estimate: 0h
>
> Spark version - Spark 1.6.2 and spark2.1 
> After Compaction data showing is wrong.
> create table and load 4 times s( compaction threshold is 4,3)
> Load 4 times same data .each load 105 records as attached in file . 
> --+--+
> | SegmentSequenceId  |   Status   |     Load Start Time      |      Load End Time       |
> +--------------------+------------+--------------------------+--------------------------+--+
> | 3                  | Compacted  | 2017-02-01 14:07:51.922  | 2017-02-01 14:07:52.591  |
> | 2                  | Compacted  | 2017-02-01 14:07:33.481  | 2017-02-01 14:07:34.443  |
> | 1                  | Compacted  | 2017-02-01 14:07:23.495  | 2017-02-01 14:07:24.167  |
> | 0.1                | Success    | 2017-02-01 14:07:52.815  | 2017-02-01 14:07:57.201  |
> | 0                  | Compacted  | 2017-02-01 14:07:07.541  | 2017-02-01 14:07:11.983  |
> +--------------------+------------+--------------------------+--------------------------+--+
> 5 rows selected (0.021 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(*) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +-----------+--+
> | count(1)  |
> +-----------+--+
> | 1680      |
> +-----------+--+
> 1 row selected (4.468 seconds)
> 0: jdbc:hive2://8.99.61.4:23040> select count(imei) from Comp_VMALL_DICTIONARY_INCLUDE_7;
> +--------------+--+
> | count(imei)  |
> +--------------+--+
> | 1680         |
> +--------------+--+
> Expected :-  total records should be 420 . 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)