You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@carbondata.apache.org by "Jiayu Shen (Jira)" <ji...@apache.org> on 2021/07/26 09:39:00 UTC

[jira] [Created] (CARBONDATA-4251) optimize clean index file performance

Jiayu Shen created CARBONDATA-4251:
--------------------------------------

             Summary: optimize clean index file performance
                 Key: CARBONDATA-4251
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4251
             Project: CarbonData
          Issue Type: Improvement
          Components: core
    Affects Versions: 2.2.0
            Reporter: Jiayu Shen
             Fix For: 2.2.1


When cleanfile cleans up data, it cleans up all the carbonindex and carbonmergeindex that once existed, even though many carbonindex have been all deleted, which have been merged into carbonergeindex. considering that there are tens of thousands of carbonindex that once existed after the completion of the compaction, the clean file command will take serveral hours.
Here, we just need to clean up the existing files, carbonmergeindex or carbonindex files



--
This message was sent by Atlassian Jira
(v8.3.4#803005)