[jira] [Created] (HBASE-29185) How to ensure the atomicity of data files during compaction

["yuting sun (Jira)" <ji...@apache.org>]

yuting sun created HBASE-29185:
----------------------------------

             Summary: How to ensure the atomicity of data files during compaction
                 Key: HBASE-29185
                 URL: https://issues.apache.org/jira/browse/HBASE-29185
             Project: HBase
          Issue Type: Sub-task
          Components: Compaction
    Affects Versions: 2.6.0
            Reporter: yuting sun


{code:java}
//代码占位符
{code}
protected List<HStoreFile> doCompaction(CompactionRequestImpl cr, Collection<HStoreFile> filesToCompact, User user, long compactionStartTime, List<Path> newFiles) throws IOException \{ // Do the steps necessary to complete the compaction. setStoragePolicyFromFileName(newFiles); List<HStoreFile> sfs = storeEngine.commitStoreFiles(newFiles, true); if (this.getCoprocessorHost() != null) { for (HStoreFile sf : sfs) { getCoprocessorHost().postCompact(this, sf, cr.getTracker(), cr, user); } } replaceStoreFiles(filesToCompact, sfs, true); long outputBytes = getTotalSize(sfs); // At this point the store will use new files for all new scanners. refreshStoreSizeAndTotalBytes(); // update store size. long now = EnvironmentEdgeManager.currentTime(); if ( region.getRegionServerServices() != null && region.getRegionServerServices().getMetrics() != null ) \{ region.getRegionServerServices().getMetrics().updateCompaction( region.getTableDescriptor().getTableName().getNameAsString(), cr.isMajor(), now - compactionStartTime, cr.getFiles().size(), newFiles.size(), cr.getSize(), outputBytes); } logCompactionEndMessage(cr, sfs, now, compactionStartTime); return sfs; }
{code:java}
//代码占位符{code}
In the commitStoreFiles logic and replaceStoreFiles logic, after the sfs file is moved to the data directory and before it is loaded by storeFile, if compaction abort occurs, how should the sfs collection be handled? It seems that it is retained in the data directory and waits for the next loading.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)