You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Szabolcs Bukros (Jira)" <ji...@apache.org> on 2022/08/17 13:10:00 UTC
[jira] [Comment Edited] (HBASE-26969) Eliminate MOB renames when SFT is enabled
[ https://issues.apache.org/jira/browse/HBASE-26969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17580779#comment-17580779 ]
Szabolcs Bukros edited comment on HBASE-26969 at 8/17/22 1:09 PM:
------------------------------------------------------------------
[~apurtell] [~huaxiangsun] Please find [#4712|https://github.com/apache/hbase/pull/4712] with the branch-2 backport.
Please note I made some additional changes:
* [#4617|https://github.com/apache/hbase/pull/4617] left 2 test classes in the code that the original commit deleted and I had to delete them here.
* HBASE-25970 is another dependency I missed in HBASE-27154. To shorten the review cycles instead of backporting it separately I included the changes it contained in this PR. Please let me know if that would not be acceptable and I prepare a separate PR for that backport.
was (Author: bszabolcs):
[~apurtell] [~huaxiangsun] Please find #4712 with the branch-2 backport.
Please note I made some additional changes:
* [#4617|https://github.com/apache/hbase/pull/4617] left 2 test classes in the code that the original commit deleted and I had to delete them here.
* HBASE-25970 is another dependency I missed in HBASE-27154. To shorten the review cycles instead of backporting it separately I included the changes it contained in this PR. Please let me know if that would not be acceptable and I prepare a separate PR for that backport.
> Eliminate MOB renames when SFT is enabled
> -----------------------------------------
>
> Key: HBASE-26969
> URL: https://issues.apache.org/jira/browse/HBASE-26969
> Project: HBase
> Issue Type: Sub-task
> Components: mob
> Affects Versions: 2.5.0, 3.0.0-alpha-3
> Reporter: Szabolcs Bukros
> Assignee: Szabolcs Bukros
> Priority: Major
> Fix For: 2.5.0, 3.0.0-alpha-4
>
>
> MOB file compaction and flush still relies on renames even when SFT is enabled.
> My proposed changes are:
> * when requireWritingToTmpDirFirst is false during mob flush/compact instead of using the temp writer we should create a different writer using a {color:#000000}StoreFileWriterCreationTracker that writes directly to the mob store folder{color}
> * {color:#000000}these StoreFileWriterCreationTracker should be stored in the MobStore. This would requires us to extend MobStore with a createWriter and a finalizeWriter method to handle this{color}
> * {color:#000000}refactor {color}MobFileCleanerChore to run on the RS instead on Master to allow access to the {color:#000000}StoreFileWriterCreationTracker{color}s to make sure the currently written files are not cleaned up
--
This message was sent by Atlassian Jira
(v8.20.10#820010)