[jira] [Commented] (CARBONDATA-4116) Concurrent Data Loading Issue

["Ajantha Bhat (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CARBONDATA-4116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17277836#comment-17277836 ] 

Ajantha Bhat commented on CARBONDATA-4116:
------------------------------------------

we have tested these concurrent load and compaction scenario heavily and fixed these defects in carbondata 2.1.0. 

please use the latest version. 

 

we don't have plan to fix these in older version. 

> Concurrent Data Loading Issue
> -----------------------------
>
>                 Key: CARBONDATA-4116
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4116
>             Project: CarbonData
>          Issue Type: Improvement
>          Components: core
>    Affects Versions: 1.6.1, 2.0.1
>         Environment: Apache carbondata 2.0.1
>            Reporter: suyash yadav
>            Priority: Major
>
> Even carbon claim that it can support the concurrent data loading together with table compaction, in fact it cannot. We have faced data inconsistent issue in carbon 1.6.1 when loading data concurrently into the table together with compaction. That is why we implement table locking for load data, compact and clean files command. All this is due to the manipulation of the table’s metadata file, i.e .tablestatus.
>  
> We are facing issue in concurrent data loading together with compaction - gets us to data inconsistency - what is the way out to fix this as we want concurrent loading with compaction



--
This message was sent by Atlassian Jira
(v8.3.4#803005)