[jira] [Created] (CARBONDATA-4116) Concurrent Data Loading Issue

["suyash yadav (Jira)" <ji...@apache.org>]

suyash yadav created CARBONDATA-4116:
----------------------------------------

             Summary: Concurrent Data Loading Issue
                 Key: CARBONDATA-4116
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4116
             Project: CarbonData
          Issue Type: Improvement
          Components: core
    Affects Versions: 1.6.1, 2.0.1
         Environment: Apache carbondata 2.0.1
            Reporter: suyash yadav


Even carbon claim that it can support the concurrent data loading together with table compaction, in fact it cannot. We have faced data inconsistent issue in carbon 1.6.1 when loading data concurrently into the table together with compaction. That is why we implement table locking for load data, compact and clean files command. All this is due to the manipulation of the table’s metadata file, i.e .tablestatus.

 

We are facing issue in concurrent data loading together with compaction - gets us to data inconsistency - what is the way out to fix this as we want concurrent loading with compaction



--
This message was sent by Atlassian Jira
(v8.3.4#803005)