You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Josh Elser <el...@apache.org> on 2021/12/22 19:55:18 UTC

[RESULT] [VOTE] Merge HBASE-26067 (storefile tracking) into master and branch-2

This merge vote passes with 4 binding +1's and 3 non-binding +1's.

Thanks everyone. I'll go ahead with the merge into master and see how 
easily it comes back to branch-2.

On 2021/12/16 21:30:09 Josh Elser wrote:
> Hi!
> 
> I'm extremely pleased to send this official vote to merge the feature 
> branch for HBASE-26067[1] into master and backport into branch-2 (2.x, 
> not 2.5.x). This feature branch introduces the pluggable 
> StoreFileTracker interface.
> 
> The StoreFileTracker allows the StoreFileEngine to be decoupled from 
> where the HFiles can be found. The DEFAULT implementation of this 
> StoreFileTracker (e.g. files in a family's directory) is still the 
> default implementation. This merge would introduce a FILE implementation 
> which uses a flat-file in each column family to track the files which 
> make up this Store. This feature is notable for HBase as it invalidate 
> the need for HBOSS (a distributed locking layer in hbase-filesystem) 
> when Amazon S3 is used for HBase data.
> 
> We had a DISCUSS thread [2] in which the overall sentiment was positive 
> to merge.
> 
> Covering some high-level details/FAQ on this work:
> * Wellington and Szabolcs have successfully run ITBLL with Chaos Monkies 
> using this feature.
> * YCSB (load) indicates a slight performance improvement when using S3 
> as the storage system for HBase as compared to using HBOSS [3]
> * A new section was added to the HBase book which covers the feature and 
> how to use it.
> * There is some follow-on work expected, tracked in HBASE-26584 [4], 
> which includes things like making user consumption easier and additional 
> metrics to measure effectiveness of the feature.
> 
> As is customary, this vote will be open for at least 3 days (2021/12/19 
> 2130 GMT). We'll follow the standard ASF lazy-consensus rules for code 
> modification (though I do not expect to need the lazy-consensus caveat). 
> Please vote:
> 
> +1: Merge the changes from HBASE-26067 to master and branch-2
> -1: Do not merge these changes because ...
> 
> Big thank you to all of the super hard work that Duo, Wellington, and 
> Szabolcs have put into this feature.
> 
> - Josh
> 
> [1] https://issues.apache.org/jira/browse/HBASE-26067
> [2] https://lists.apache.org/thread/6dblom3tc2oz05d263pvmrywlthqq1c1
> [3] 
> https://issues.apache.org/jira/browse/HBASE-26067?focusedCommentId=17448499&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17448499
> [4] https://issues.apache.org/jira/browse/HBASE-26584
>