You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@carbondata.apache.org by "Ajantha Bhat (Jira)" <ji...@apache.org> on 2020/10/22 12:00:14 UTC

[jira] [Created] (CARBONDATA-4040) Data mismatch incase of compaction failure and retry success

Ajantha Bhat created CARBONDATA-4040:
----------------------------------------

             Summary: Data mismatch incase of compaction failure and retry success
                 Key: CARBONDATA-4040
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4040
             Project: CarbonData
          Issue Type: Bug
            Reporter: Ajantha Bhat
            Assignee: Ajantha Bhat


For compaction we don't register inprogress segment. so, when unable to get table status lock. compaction can fail. That time compaction partial segment need to be cleaned. If the partial segment is failed to cleanup due to unable to get lock or IO issues. When the user retries the compaction. carbon uses same segment id. so while writing the segment file for new compaction. list only the files mapping to the current compaction, not all the files which contains stale files.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)