You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hbase.apache.org by gx...@apache.org on 2021/12/20 04:41:51 UTC

svn commit: r51613 - /dev/hbase/hbase-operator-tools-1.2.0RC1/

Author: gxcheng
Date: Mon Dec 20 04:41:51 2021
New Revision: 51613

Log:
prepare for 1.2.0RC1

Added:
    dev/hbase/hbase-operator-tools-1.2.0RC1/
    dev/hbase/hbase-operator-tools-1.2.0RC1/CHANGES.md
    dev/hbase/hbase-operator-tools-1.2.0RC1/RELEASENOTES.md
    dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz   (with props)
    dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.asc
    dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.sha512
    dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz   (with props)
    dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.asc
    dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.sha512

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/CHANGES.md
==============================================================================
--- dev/hbase/hbase-operator-tools-1.2.0RC1/CHANGES.md (added)
+++ dev/hbase/hbase-operator-tools-1.2.0RC1/CHANGES.md Mon Dec 20 04:41:51 2021
@@ -0,0 +1,222 @@
+# HBASE Operator Tools Changelog
+
+<!---
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# Be careful doing manual edits in this file. Do not change format
+# of release header or remove the below marker. This file is generated.
+# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
+## Release hbase-operator-tools-1.2.0 - Unreleased (as of 2021-12-14)
+
+### NEW FEATURES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-25874](https://issues.apache.org/jira/browse/HBASE-25874) | [hbase-operator-tools]Add tool for identifying "unknown servers" from master logs, then submit SCPs for each of those. |  Major |  |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-26257](https://issues.apache.org/jira/browse/HBASE-26257) | Improve Performance of HBCK when specifying a subset of tables |  Major | hbase-operator-tools,hbck2 |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-26338](https://issues.apache.org/jira/browse/HBASE-26338) | hbck2 setRegionState cannot set replica region state |  Major | hbck2 |
+| [HBASE-26072](https://issues.apache.org/jira/browse/HBASE-26072) | Upgrade hbase version in hbase-operator-tools to 2.4.4 |  Trivial | hbase-operator-tools |
+| [HBASE-26054](https://issues.apache.org/jira/browse/HBASE-26054) | Fix hbase-operator-tools build with HBase 2.4.4 |  Minor | hbase-operator-tools |
+| [HBASE-25965](https://issues.apache.org/jira/browse/HBASE-25965) | Move delete of WAL directory out of LOG.info and avoid left over directory |  Minor | hbase-operator-tools |
+| [HBASE-25921](https://issues.apache.org/jira/browse/HBASE-25921) | Fix Wrong FileSystem when running `filesystem` on non-HDFS storage |  Major | hbase-operator-tools |
+| [HBASE-25885](https://issues.apache.org/jira/browse/HBASE-25885) | [hbase-operator-tools] Extra checks on RegionsMerger to avoid submitting merge requests for regions with merge qualifiers |  Major | hbase-operator-tools |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-26571](https://issues.apache.org/jira/browse/HBASE-26571) | [hbase-operator-tools] Upgrade to log4j 2.16.0 |  Major | hbase-operator-tools |
+| [HBASE-25659](https://issues.apache.org/jira/browse/HBASE-25659) | [hbck2] Add hbase-operator-tools command for scheduleSCPsForUnknownServers |  Major | hbase-operator-tools |
+
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-26608](https://issues.apache.org/jira/browse/HBASE-26608) | [hbase-operator-tools] Upgrade log4j2 to 2.17.0 |  Major | hbase-operator-tools, logging, security |
+| [HBASE-26561](https://issues.apache.org/jira/browse/HBASE-26561) | [hbase-operator-tools] Upgrade log4j2 to 2.15.0 to address CVE-2021-44228 |  Major | hbase-operator-tools,logging,security |
+| [HBASE-25794](https://issues.apache.org/jira/browse/HBASE-25794) | Fix checkstyle violations in hbase-table-reporter module |  Trivial | hbase-operator-tools |
+| [HBASE-25577](https://issues.apache.org/jira/browse/HBASE-25577) | HBase operator tools pom should include nexus staging repo management |  Major | hbase-operator-tools,community |
+
+
+## Release hbase-operator-tools-1.1.0 - Unreleased (as of 2021-02-13)
+
+
+
+### NEW FEATURES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-25266](https://issues.apache.org/jira/browse/HBASE-25266) | [hbase-operator-tools] Add a repair tool for moving stale regions dir not present in meta away from table dir |  Major | hbase-operator-tools |
+| [HBASE-23562](https://issues.apache.org/jira/browse/HBASE-23562) | [operator tools] Add a RegionsMerge tool that allows for merging multiple adjacent regions until a desired number of regions is reached. |  Minor | hbase-operator-tools |
+| [HBASE-23371](https://issues.apache.org/jira/browse/HBASE-23371) | [HBCK2] Provide client side method for removing "ghost" regions in meta. |  Major | hbase-operator-tools |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-25297](https://issues.apache.org/jira/browse/HBASE-25297) | [HBCK2] Regenerate missing table descriptors by hbck2 |  Major | hbase-operator-tools, hbck2 |
+| [HBASE-24626](https://issues.apache.org/jira/browse/HBASE-24626) | [HBCK2] Remove reference to hase I.A. private class CommonFsUtils from FsRegionsMetaRecoverer |  Major | hbase-operator-tools, hbck2 |
+| [HBASE-23927](https://issues.apache.org/jira/browse/HBASE-23927) | hbck2 assigns command should accept one or more files containing a list of region names |  Major | hbase-operator-tools, hbck2, Operability, Usability |
+| [HBASE-24039](https://issues.apache.org/jira/browse/HBASE-24039) | HBCK2 feature negotiation to check what commands are supported |  Critical | hbck2, Operability |
+| [HBASE-24116](https://issues.apache.org/jira/browse/HBASE-24116) | Update Apache POM to version 23 for hbase-operator-tools |  Minor | hbase-operator-tools |
+| [HBASE-23934](https://issues.apache.org/jira/browse/HBASE-23934) | [operator tools] Add forbiddennapis plugin to pom.xml so that we can permanently ban references to hbase I.A. private classes from hbck2 |  Major | hbase-operator-tools |
+| [HBASE-23791](https://issues.apache.org/jira/browse/HBASE-23791) | [operator tools] Remove reference to I.A. Private interface MetaTableAccessor |  Major | hbase-operator-tools |
+| [HBASE-23610](https://issues.apache.org/jira/browse/HBASE-23610) | Update Apache POM to version 21 for hbase-operator-tools |  Trivial | hbck2 |
+| [HBASE-23609](https://issues.apache.org/jira/browse/HBASE-23609) | Clean up tests in hbase-operator-tools |  Minor | hbck2 |
+| [HBASE-23611](https://issues.apache.org/jira/browse/HBASE-23611) | Enforcer plugin does not use configured version in hbase-operator-tools |  Minor | hbck2 |
+| [HBASE-23577](https://issues.apache.org/jira/browse/HBASE-23577) | Bump Checkstyle from 8.11 to 8.18 in hbase-operator-tools |  Minor | hbase-operator-tools |
+| [HBASE-23256](https://issues.apache.org/jira/browse/HBASE-23256) | fix hbck2 assigns/unassigns usage |  Minor | hbck2 |
+| [HBASE-23031](https://issues.apache.org/jira/browse/HBASE-23031) | Upgrade Yetus version in RM scripts |  Minor | hbase-operator-tools |
+| [HBASE-23109](https://issues.apache.org/jira/browse/HBASE-23109) | [hbase-operator-tools] Fix checkstyle issues |  Minor | hbase-operator-tools |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-25529](https://issues.apache.org/jira/browse/HBASE-25529) | [hbase-operator-tools]Fix OOME "unable to create new native thread" on UTs |  Major | hbase-operator-tools |
+| [HBASE-24997](https://issues.apache.org/jira/browse/HBASE-24997) | [hbase-operator-tools] NPE in RegionsMerger#mergeRegions |  Major | hbase-operator-tools |
+| [HBASE-24889](https://issues.apache.org/jira/browse/HBASE-24889) | [hbase-operator-tools] Add missing ASF headers |  Major | hbase-operator-tools |
+| [HBASE-24778](https://issues.apache.org/jira/browse/HBASE-24778) | [hbase-operator-tools] Merging regions failed when the table is not default namespace |  Major | hbase-operator-tools |
+| [HBASE-24571](https://issues.apache.org/jira/browse/HBASE-24571) | HBCK2 fix addFsRegionsMissingInMeta to add regions in CLOSED state again |  Major | hbase-operator-tools |
+| [HBASE-24482](https://issues.apache.org/jira/browse/HBASE-24482) | [hbase-operator-tools] build of hbck2 fails with HBase branch-2.3, due to missing dependencies |  Major | hbase-operator-tools |
+| [HBASE-24398](https://issues.apache.org/jira/browse/HBASE-24398) | [hbase-operator-tools] RegionsMerger ConcurrentModificationException |  Major | hbase-operator-tools |
+| [HBASE-24239](https://issues.apache.org/jira/browse/HBASE-24239) | [HBCK2] Remove removeExtraRegionsFromMeta from HBCK2 doc |  Minor | documentation, hbase-operator-tools |
+| [HBASE-23112](https://issues.apache.org/jira/browse/HBASE-23112) | [hbase-operator-tools] fixMeta in hbck2 is porcelain, in hbck1 it was plumbing; fix |  Major | hbase-operator-tools |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-25137](https://issues.apache.org/jira/browse/HBASE-25137) | Migrate HBase-Operator-Tools-PreCommit jenkins job from Hadoop to hbase |  Major | hbase-operator-tools, jenkins |
+| [HBASE-24397](https://issues.apache.org/jira/browse/HBASE-24397) | [hbase-operator-tools] Tool to Report on row sizes and column counts |  Major | hbase-operator-tools, tooling |
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-24882](https://issues.apache.org/jira/browse/HBASE-24882) | Migrate hbase-operator-tools testing to ci-hadoop |  Major | build, hbase-operator-tools |
+| [HBASE-23180](https://issues.apache.org/jira/browse/HBASE-23180) | Add a hbck2 testing tool |  Major | hbase-operator-tools |
+| [HBASE-23714](https://issues.apache.org/jira/browse/HBASE-23714) | Move to Apache parent POM version 22 for operator-tools |  Minor | dependencies, hbase-operator-tools |
+| [HBASE-23641](https://issues.apache.org/jira/browse/HBASE-23641) | Use ReplicationPeerConfig.needToReplicate in HBaseFsck |  Major | hbase-operator-tools |
+| [HBASE-23124](https://issues.apache.org/jira/browse/HBASE-23124) | [hbase-operator-tools] Remove commons-lang3 dependency |  Minor | hbase-operator-tools |
+
+
+## Release hbase-operator-tools-1.0.0 - Unreleased (as of 2019-09-20)
+
+
+
+### NEW FEATURES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22567](https://issues.apache.org/jira/browse/HBASE-22567) | [HBCK2] Add new methods for dealing with missing regions in META while Master is online |  Major | hbck2 |
+| [HBASE-22183](https://issues.apache.org/jira/browse/HBASE-22183) | [hbck2] Update hbck2 README to explain new "setRegionState" method. |  Minor | documentation, hbck2 |
+| [HBASE-22143](https://issues.apache.org/jira/browse/HBASE-22143) | HBCK2 setRegionState command |  Minor | hbase-operator-tools, hbck2 |
+
+
+### IMPROVEMENTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-22691](https://issues.apache.org/jira/browse/HBASE-22691) | [hbase-operator-tools] Move Checkstyle suppression file to different location |  Trivial | hbck2 |
+| [HBASE-23018](https://issues.apache.org/jira/browse/HBASE-23018) | [HBCK2] Add useful messages when report/fixing missing regions in meta |  Minor | hbase-operator-tools, hbck2, Operability |
+| [HBASE-22999](https://issues.apache.org/jira/browse/HBASE-22999) | Fix non-varargs compile warnings |  Minor | hbase-operator-tools |
+
+
+### BUG FIXES:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-23057](https://issues.apache.org/jira/browse/HBASE-23057) | Add commons-lang3 dependency to HBCK2 |  Critical | hbase-operator-tools |
+| [HBASE-23039](https://issues.apache.org/jira/browse/HBASE-23039) | HBCK2 bypass -r command does not work |  Major | hbase-operator-tools |
+| [HBASE-23033](https://issues.apache.org/jira/browse/HBASE-23033) | Do not run git-commit-id-plugin when .git is missing |  Blocker | hbase-operator-tools |
+| [HBASE-23029](https://issues.apache.org/jira/browse/HBASE-23029) | Handle hbase-operator-tools releasenotes in release making script |  Minor | hbase-operator-tools |
+| [HBASE-23026](https://issues.apache.org/jira/browse/HBASE-23026) | docker run command should not quote JAVA\_VOL |  Major | hbase-operator-tools |
+| [HBASE-23025](https://issues.apache.org/jira/browse/HBASE-23025) | Do not quote GPG command |  Major | hbase-operator-tools |
+| [HBASE-22984](https://issues.apache.org/jira/browse/HBASE-22984) | [HBCK2] HBCKMetaTableAccessor.deleteFromMetaTable throwing java.lang.UnsupportedOperationException at runtime |  Major | hbck2 |
+| [HBASE-22951](https://issues.apache.org/jira/browse/HBASE-22951) | [HBCK2] hbase hbck throws IOE "No FileSystem for scheme: hdfs" |  Major | documentation, hbck2 |
+| [HBASE-22952](https://issues.apache.org/jira/browse/HBASE-22952) | HBCK2 replication command is incompatible with 2.0.x |  Critical | hbase-operator-tools |
+| [HBASE-22949](https://issues.apache.org/jira/browse/HBASE-22949) | [HBCK2] Add lang3 as explicit dependency |  Major | . |
+| [HBASE-22687](https://issues.apache.org/jira/browse/HBASE-22687) | [hbase-operator-tools] Add checkstyle plugin and configs from hbase |  Major | . |
+| [HBASE-22674](https://issues.apache.org/jira/browse/HBASE-22674) | precommit docker image installs JRE over JDK (multiple repos) |  Critical | build, hbase-connectors |
+| [HBASE-21763](https://issues.apache.org/jira/browse/HBASE-21763) | [HBCK2] hbck2 options does not work and throws exceptions |  Minor | hbck2 |
+| [HBASE-21484](https://issues.apache.org/jira/browse/HBASE-21484) | [HBCK2] hbck2 should default to a released hbase version |  Major | hbck2 |
+| [HBASE-21483](https://issues.apache.org/jira/browse/HBASE-21483) | [HBCK2] version string checking should look for exactly the version we know doesn't work |  Major | hbck2 |
+| [HBASE-21378](https://issues.apache.org/jira/browse/HBASE-21378) | [hbck2] add --skip version check to hbck2 tool (checkHBCKSupport blocks assigning hbase:meta or hbase:namespace when master is not initialized) |  Major | hbase-operator-tools, hbck2 |
+| [HBASE-21335](https://issues.apache.org/jira/browse/HBASE-21335) | Change the default wait time of HBCK2 tool |  Critical | . |
+| [HBASE-21317](https://issues.apache.org/jira/browse/HBASE-21317) | [hbck2] Add version, version handling, and misc override to assigns/unassigns |  Major | hbase-operator-tools, hbck2 |
+
+
+### TESTS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-21353](https://issues.apache.org/jira/browse/HBASE-21353) | TestHBCKCommandLineParsing#testCommandWithOptions hangs on call to HBCK2#checkHBCKSupport |  Major | hbase-operator-tools, hbck2 |
+
+
+### SUB-TASKS:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-23021](https://issues.apache.org/jira/browse/HBASE-23021) | [hbase-operator-tools] README edits in prep for release |  Major | . |
+| [HBASE-22997](https://issues.apache.org/jira/browse/HBASE-22997) | Move to SLF4J |  Major | hbase-operator-tools |
+| [HBASE-22998](https://issues.apache.org/jira/browse/HBASE-22998) | Fix NOTICE and LICENSE |  Blocker | hbase-operator-tools |
+| [HBASE-22859](https://issues.apache.org/jira/browse/HBASE-22859) | [HBCK2] Fix the orphan regions on filesystem |  Major | documentation, hbck2 |
+| [HBASE-22825](https://issues.apache.org/jira/browse/HBASE-22825) | [HBCK2] Add a client-side to hbase-operator-tools that can exploit fixMeta added in server side |  Major | hbck2 |
+| [HBASE-22957](https://issues.apache.org/jira/browse/HBASE-22957) | [HBCK2] reference file check fails if compiled with old version but check against new |  Major | . |
+| [HBASE-22865](https://issues.apache.org/jira/browse/HBASE-22865) | [HBCK2] shows the whole help/usage message after the error message |  Minor | hbck2 |
+| [HBASE-22843](https://issues.apache.org/jira/browse/HBASE-22843) | [HBCK2] Fix HBCK2 after HBASE-22777 & HBASE-22758 |  Blocker | hbase-operator-tools |
+| [HBASE-22717](https://issues.apache.org/jira/browse/HBASE-22717) | [HBCK2] Expose replication fixes from hbck1 |  Major | . |
+| [HBASE-22713](https://issues.apache.org/jira/browse/HBASE-22713) | [HBCK2] Add hdfs integrity report to 'filesystem' command |  Major | hbck2 |
+| [HBASE-21393](https://issues.apache.org/jira/browse/HBASE-21393) | Add an API  ScheduleSCP() to HBCK2 |  Major | hbase-operator-tools, hbck2 |
+| [HBASE-22688](https://issues.apache.org/jira/browse/HBASE-22688) | [HBCK2] Add filesystem fixup to hbck2 |  Major | hbck2 |
+| [HBASE-22680](https://issues.apache.org/jira/browse/HBASE-22680) | [HBCK2] OfflineMetaRepair for hbase2/hbck2 |  Major | hbck2 |
+| [HBASE-21322](https://issues.apache.org/jira/browse/HBASE-21322) | Add a scheduleServerCrashProcedure() API to HbckService |  Critical | hbck2 |
+| [HBASE-21210](https://issues.apache.org/jira/browse/HBASE-21210) | Add bypassProcedure() API to HBCK2 |  Major | hbase-operator-tools, hbck2 |
+
+
+### OTHER:
+
+| JIRA | Summary | Priority | Component |
+|:---- |:---- | :--- |:---- |
+| [HBASE-19121](https://issues.apache.org/jira/browse/HBASE-19121) | HBCK for AMv2 (A.K.A HBCK2) |  Major | hbck, hbck2 |
+| [HBASE-23003](https://issues.apache.org/jira/browse/HBASE-23003) | [HBCK2/hbase-operator-tools] Release-making scripts |  Major | . |
+| [HBASE-23002](https://issues.apache.org/jira/browse/HBASE-23002) | [HBCK2/hbase-operator-tools] Create an assembly that builds an hbase-operator-tools tgz |  Major | . |
+| [HBASE-22906](https://issues.apache.org/jira/browse/HBASE-22906) | Clean up checkstyle complaints in hbase-operator-tools |  Trivial | hbase-operator-tools |
+| [HBASE-22675](https://issues.apache.org/jira/browse/HBASE-22675) | Use commons-cli from hbase-thirdparty |  Major | hbase-operator-tools |
+| [HBASE-21433](https://issues.apache.org/jira/browse/HBASE-21433) | [hbase-operator-tools] Add Apache Yetus integration for hbase-operator-tools repository |  Major | build, hbase-operator-tools |
+
+

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/RELEASENOTES.md
==============================================================================
--- dev/hbase/hbase-operator-tools-1.2.0RC1/RELEASENOTES.md (added)
+++ dev/hbase/hbase-operator-tools-1.2.0RC1/RELEASENOTES.md Mon Dec 20 04:41:51 2021
@@ -0,0 +1,340 @@
+# RELEASENOTES
+
+<!---
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# Be careful doing manual edits in this file. Do not change format
+# of release header or remove the below marker. This file is generated.
+# DO NOT REMOVE THIS MARKER; FOR INTERPOLATING CHANGES!-->
+# HBASE  hbase-operator-tools-1.2.0 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements.
+
+---
+
+* [HBASE-26608](https://issues.apache.org/jira/browse/HBASE-26608) | *Major* | ** [hbase-operator-tools] Upgrade log4j2 to 2.17.0**
+
+Upgrade log4j2 to 2.17.0 to address CVE-2021-45105.
+
+---
+
+* [HBASE-26571](https://issues.apache.org/jira/browse/HBASE-26571) | *Major* | **[hbase-operator-tools] Upgrade to log4j 2.16.0**
+
+Upgrade log4j to 2.16.0.
+
+---
+
+* [HBASE-26561](https://issues.apache.org/jira/browse/HBASE-26561) | *Major* | **[hbase-operator-tools] Upgrade log4j2 to 2.15.0 to address CVE-2021-44228**
+
+Upgrade log4j2 to 2.15.0 for addressing CVE-2021-44228.
+
+
+---
+
+* [HBASE-26338](https://issues.apache.org/jira/browse/HBASE-26338) | *Major* | **hbck2 setRegionState cannot set replica region state**
+
+To set the replica region's state, it needs the primary region's
+encoded regionname and replica id, the command will be "setRegionState <PRIMARY_ENCODED_REGIONNAME>,<replicaId> <STATE>".
+
+
+---
+
+* [HBASE-25874](https://issues.apache.org/jira/browse/HBASE-25874) | *Major* | **[hbase-operator-tools]Add tool for identifying "unknown servers" from master logs, then submit SCPs for each of those.**
+
+RegionsOnUnknownServersRecoverer parses the master log to identify unknown servers with regions assigned with, in meta table. This condition may happen in the event of recovering previously destroyed clusters, where new Master/RS names completely differ from the previous ones currently stored in meta table (see HBASE-24286).
+
+NOTE: This tool is useful for clusters runing hbase versions lower than 2.2.7, 2.3.5 and 2.4.7.
+For any of these versions or higher, HBCK2 'recoverUnknown' option can be used as a much simpler solution.
+
+This tool requires the master logs path as parameter. Assuming classpath is properly set, can be run as follows:
+
+$ hbase org.apache.hbase.RegionsOnUnknownServersRecoverer PATH_TO_MASTER_LOGS [dryRun]
+
+The dryRun optional parameter will just parse the logs and print the list of unknown servers, without invoking hbck2 scheduleRecoveries command.
+
+RegionsOnUnknownServersRecoverer parses master log file searching for specific messages mentioning "unknown servers". Once "unknown servers" are found, it then uses HBCK2.scheduleRecoveries to submit SCPs for each of these "unknown servers".
+
+
+---
+
+* [HBASE-26338](https://issues.apache.org/jira/browse/HBASE-26338) | *Major* | **hbck2 setRegionState cannot set replica region state**
+
+To set the replica region's state, it needs the primary region's
+encoded regionname and replica id, the command will be "setRegionState <PRIMARY_ENCODED_REGIONNAME>,<replicaId> <STATE>".
+
+
+# HBASE  hbase-operator-tools-1.1.0 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements.
+
+
+---
+
+* [HBASE-24482](https://issues.apache.org/jira/browse/HBASE-24482) | *Major* | **[hbase-operator-tools] build of hbck2 fails with HBase branch-2.3, due to missing dependencies**
+
+Make it so tests and compile works against hbase-2.3.x as well as hbase-2.1.x.
+
+
+---
+
+* [HBASE-23927](https://issues.apache.org/jira/browse/HBASE-23927) | *Major* | **hbck2 assigns command should accept one or more files containing a list of region names**
+
+This adds a new option -i or --inputFile to assigns function to allow one or more files to read the region list from for region assignment. Each file contains encoded region names, one per line. White spaces will be trimmed. For example:
+     $ HBCK2 assigns -i file1 file2
+The files can be generated or piped from operator running grep/sed over log files.
+
+
+---
+
+* [HBASE-23180](https://issues.apache.org/jira/browse/HBASE-23180) | *Major* | **Add a hbck2 testing tool**
+
+This adds a new tool that spins up hbase on hadoop minicluster and mimicks actions of hbck2 to verify it's functionalities. The tool has been designed for easy addition of more compound actions (i.e. collection of actions) to verify hbck2. deleteRegionInMeta.sh is one such example of a compound action script.
+
+
+---
+
+* [HBASE-23610](https://issues.apache.org/jira/browse/HBASE-23610) | *Trivial* | **Update Apache POM to version 21 for hbase-operator-tools**
+
+Updated parent POM from version 18 to version 21 - https://github.com/apache/maven-apache-parent/compare/apache-18...apache-21
+
+
+---
+
+* [HBASE-23577](https://issues.apache.org/jira/browse/HBASE-23577) | *Minor* | **Bump Checkstyle from 8.11 to 8.18 in hbase-operator-tools**
+
+Bumped the Checkstyle version from 8.11 to 8.18
+
+
+
+# HBASE  hbase-operator-tools-1.0.0 Release Notes
+
+These release notes cover new developer and user-facing incompatibilities, important issues, features, and major improvements.
+
+
+---
+
+* [HBASE-23002](https://issues.apache.org/jira/browse/HBASE-23002) | *Major* | **[HBCK2/hbase-operator-tools] Create an assembly that builds an hbase-operator-tools tgz**
+
+First cut at an assembly for hbase-operator-tools project.
+
+
+---
+
+* [HBASE-22997](https://issues.apache.org/jira/browse/HBASE-22997) | *Major* | **Move to SLF4J**
+
+Added SLF4J binding for LOG4J 2.
+
+
+---
+
+* [HBASE-22567](https://issues.apache.org/jira/browse/HBASE-22567) | *Major* | **[HBCK2] Add new methods for dealing with missing regions in META while Master is online**
+
+Adds new, lightweight option for recovering missing regions in meta, "addFsRegionsMissingInMeta" command, as well "readonly" "reportMissingRegionsInMeta" to show the list of regions to be readded in meta. This is a less intrusive alternative to OfflineMetaRepair, can be used when master and meta are still capable of coming online.
+
+Detailed description as provided by the command usage help:
+
+{noformat}
+ addFsRegionsMissingInMeta \<NAMESPACE\|NAMESPACE:TABLENAME\>...
+   Options:
+    -d,--force\_disable aborts fix for table if disable fails.
+   To be used in scenarios where some regions may be missing in META,
+   but there's still a valid 'regioninfo' metadata file on HDFS.
+   This is a lighter version of 'OfflineMetaRepair tool commonly used for
+   similar issues on 1.x release line.
+   This command needs META to be online. For each table name passed as
+   parameter, it performs a diff between regions available in META,
+   against existing regions dirs on HDFS. Then, for region dirs with
+   no matches in META, it reads regioninfo metadata file and
+   re-creates given region in META. Regions are re-created in 'CLOSED'
+   state at META table only, but not in Masters' cache, and are not
+   assigned either. To get these regions online, run HBCK2
+'assigns'command
+   printed at the end of this command results for convenience.
+
+   NOTE: If using hbase releases older than 2.3.0, a rolling restart of
+   HMasters is needed prior to executing the provided 'assigns' command.
+
+   An example adding missing regions for tables 'tbl\_1' on default
+   namespace, 'tbl\_2' on namespace 'n1' and for all tables from
+   namespace 'n2':
+     $ HBCK2 addFsRegionsMissingInMeta default:tbl\_1 n1:tbl\_2 n2
+   Returns HBCK2 'assigns' command with all re-inserted regions.
+   SEE ALSO: reportMissingRegionsInMeta
+...
+ reportMissingRegionsInMeta \<NAMESPACE\|NAMESPACE:TABLENAME\>...
+   To be used in scenarios where some regions may be missing in META,
+   but there's still a valid 'regioninfo metadata file on HDFS.
+   This is a checking only method, designed for reporting purposes and
+   doesn't perform any fixes, providing a view of which regions (if any)
+   would get re-added to meta, grouped by respective table/namespace.
+   To effectively re-add regions in meta, addFsRegionsMissingInMeta should be executed.
+   This command needs META to be online. For each namespace/table passed
+   as parameter, it performs a diff between regions available in META,
+   against existing regions dirs on HDFS. Region dirs with no matches
+   are printed grouped under its related table name. Tables with no
+   missing regions will show a 'no missing regions' message. If no
+   namespace or table is specified, it will verify all existing regions.
+   It accepts a combination of multiple namespace and tables. Table names
+   should include the namespace portion, even for tables in the default
+   namespace, otherwise it will assume as a namespace value.
+   An example triggering missing regions report for tables 'table\_1'
+   and 'table\_2', under default namespace:
+     $ HBCK2 reportMissingRegionsInMeta default:table\_1 default:table\_2
+   An example triggering missing regions report for table 'table\_1'
+   under default namespace, and for all tables from namespace 'ns1':
+     $ HBCK2 reportMissingRegionsInMeta default:table\_1 ns1
+   Returns list of missing regions for each table passed as parameter, or
+   for each table on namespaces specified as parameter.
+...
+{noformat}
+
+
+---
+
+* [HBASE-22717](https://issues.apache.org/jira/browse/HBASE-22717) | *Major* | **[HBCK2] Expose replication fixes from hbck1**
+
+Adds 'replication' command to HBCK2. Will clear old deleted peer queues and if a table name is passed, can clear replication barrier flags.
+
+Exposes the old hbck1 code that did this.
+
+
+---
+
+* [HBASE-21393](https://issues.apache.org/jira/browse/HBASE-21393) | *Major* | **Add an API  ScheduleSCP() to HBCK2**
+
+Adds scheduleRecoveries verb to HBCK2 tool for scheduling ServerCrashProcedures.
+
+Also adds a version checker and a refactor so we check version before trying a command (unless --skip is passed on command-line).
+
+
+---
+
+* [HBASE-22688](https://issues.apache.org/jira/browse/HBASE-22688) | *Major* | **[HBCK2] Add filesystem fixup to hbck2**
+
+Adds a 'filesystem' command to HBCK2. Checks for bad references, links, and corrupt hfiles with the option of sidelining if pass --fix option.
+
+
+---
+
+* [HBASE-22680](https://issues.apache.org/jira/browse/HBASE-22680) | *Major* | **[HBCK2] OfflineMetaRepair for hbase2/hbck2**
+
+Adds a version of the old OfflineMetaRepair tool from hbck1 updated to work against hbase2. Here is how you'd run it:
+
+ $ HBASE\_CLASSPATH\_PREFIX=~/checkouts/hbase-operator-tools/hbase-hbck2/target/hbase-hbck2-1.0.0-SNAPSHOT.jar ./bin/hbase org.apache.hbase.hbck1.OfflineMetaRepair -details
+
+See section "hbase:meta region/table restore/rebuild" in hbase-hbck README in operator tools for more detail on how to run it (https://github.com/apache/hbase-operator-tools/tree/master/hbase-hbck2)
+
+
+---
+
+* [HBASE-22143](https://issues.apache.org/jira/browse/HBASE-22143) | *Minor* | **HBCK2 setRegionState command**
+
+Adds a new feature to HBCK2: setRegionState.
+
+Given the encoded name of a Region, this command allows you to change the state of that Region recorded in Meta.
+
+
+---
+
+* [HBASE-21322](https://issues.apache.org/jira/browse/HBASE-21322) | *Critical* | **Add a scheduleServerCrashProcedure() API to HbckService**
+
+Adds scheduleServerCrashProcedure to the HbckService.
+
+
+---
+
+* [HBASE-21378](https://issues.apache.org/jira/browse/HBASE-21378) | *Major* | **[hbck2] add --skip version check to hbck2 tool (checkHBCKSupport blocks assigning hbase:meta or hbase:namespace when master is not initialized)**
+
+Adds a general -s,--skip option to hbck2 so you can run the command it first checking it is version compatible.
+
+Should not be needed going forward but in the spirt of our not knowing all the conditions under which we'll be trying to run hbck2, adding it.
+
+
+---
+
+* [HBASE-21335](https://issues.apache.org/jira/browse/HBASE-21335) | *Critical* | **Change the default wait time of HBCK2 tool**
+
+Changed waitTime parameter to lockWait on bypass. Changed default waitTime from 0 -- i.e. wait for ever -- to 1ms so if lock is held, we'll go past it and if override enforce bypass.
+
+
+---
+
+* [HBASE-21317](https://issues.apache.org/jira/browse/HBASE-21317) | *Major* | **[hbck2] Add version, version handling, and misc override to assigns/unassigns**
+
+Adds --override to assigns and unassigns.
+Adds --recursive to bypass
+Adds dump of version info
+Adds fail if remote cluster doesn't support hbck2
+
+
+---
+
+* [HBASE-21210](https://issues.apache.org/jira/browse/HBASE-21210) | *Major* | **Add bypassProcedure() API to HBCK2**
+
+Added a bypass to hbck2:
+
+{code}
+$ HBASE\_CLASSPATH\_PREFIX=../hbase-operator-tools/hbase-hbck2/target/hbase-hbck2-1.0.0-SNAPSHOT.jar ./bin/hbase org.apache.hbase.HBCK2
+usage: HBCK2 [OPTIONS] COMMAND \<ARGS\>
+
+Options:
+ -d,--debug                                 run with debug output
+ -h,--help                                  output this help message
+ -p,--hbase.zookeeper.property.clientPort   peerport of target hbase
+                                            ensemble
+ -q,--hbase.zookeeper.quorum \<arg\>          ensemble of target hbase
+ -z,--zookeeper.znode.parent                parent znode of target hbase
+
+Commands:
+ setTableState \<TABLENAME\> \<STATE\>
+   Possible table states: ENABLED, DISABLED, DISABLING, ENABLING
+   To read current table state, in the hbase shell run:
+     hbase\> get 'hbase:meta', '\<TABLENAME\>', 'table:state'
+   A value of \\x08\\x00 == ENABLED, \\x08\\x01 == DISABLED, etc.
+   An example making table name 'user' ENABLED:
+     $ HBCK2 setTableState users ENABLED
+   Returns whatever the previous table state was.
+
+ assigns \<ENCODED\_REGIONNAME\>...
+   A 'raw' assign that can be used even during Master initialization.
+   Skirts Coprocessors. Pass one or more encoded RegionNames:
+   e.g. 1588230740 is hard-coded encoding for hbase:meta region and
+   de00010733901a05f5a2a3a382e27dd4 is an example of what a random
+   user-space encoded Region name looks like. For example:
+     $ HBCK2 assign 1588230740 de00010733901a05f5a2a3a382e27dd4
+   Returns the pid of the created AssignProcedure or -1 if none.
+
+ bypass [OPTIONS] \<PID\>...
+   Pass one (or more) procedure 'pid's to skip to the procedure finish.
+   Parent of this procedures will also skip to its finish. Entities will
+   be left in an inconsistent state and will require manual fixup.
+   Pass --force to break any outstanding locks.
+   Pass --waitTime=\<seconds\> to wait on entity lock before giving up.
+   Default: force=false and waitTime=0. Returns true if succeeded.
+
+ unassigns \<ENCODED\_REGIONNAME\>...
+   A 'raw' unassign that can be used even during Master initialization.
+   Skirts Coprocessors. Pass one or more encoded RegionNames:
+   Skirts Coprocessors. Pass one or more encoded RegionNames:
+   de00010733901a05f5a2a3a382e27dd4 is an example of what a random
+   user-space encoded Region name looks like. For example:
+     $ HBCK2 unassign 1588230740 de00010733901a05f5a2a3a382e27dd4
+   Returns the pid of the created UnassignProcedure or -1 if none.
+{code}
+
+
+

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz
==============================================================================
Binary file - no diff available.

Propchange: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.asc
==============================================================================
--- dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.asc (added)
+++ dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.asc Mon Dec 20 04:41:51 2021
@@ -0,0 +1,16 @@
+-----BEGIN PGP SIGNATURE-----
+
+iQIzBAABCAAdFiEEmxLCIovf9PTP6ElEXvOmbVfsZHoFAmG/+S0ACgkQXvOmbVfs
+ZHpBSQ/7Bl1xtoAz0Ymq14Dcka8QfeP6T5P7XSib7Vphs8FXpbNFlOh7/pdgmy/O
+Oc6vTR+lhSxqiG/8jo6Olq8/VsLG9HFK4X1y1ZM6eDjpqli9+/AXDrkW58sNZMM9
+363Q+bSLDw+A06Cf1JEyYq5dF1vKl+eYytNzca5PUpTW9hS5tVEJsPlGo+6BZKIc
+acP+riwwOc0QShdoSYExHd6UNzF5dR5RFG3OR09MWMOLNrv4cRnpInEC4ocO2vWr
+4ZGhIqO18jpju8eOYfdpbq/LIvrHUsL0k4itki/EH9b4OmZs+pL5tM8Oi3lOzXTo
+VDozQDsHlzlFicliXDt6ujxtLJ8W4UNAorqA9tqKacC7WQ5gW4PZhxEHNLxm1oaa
+Bydj7LkwdWJrzLx1XZexh5/yLOWfO4/WYsU6gcdDYqpDf4RM4yylwrLnXjNEonL9
+StE30VAoOQD7Mwc+k3QIuMc0CiaU4l4CD7+HvAyPqbQwKPAoI6ZVL6d3JXpiy8Y7
+WimV3CPYqnuQ3QUbK5xK0CpQggCFyo2KcVt5EEdaJJhBg2cQjqfOEvvTjaiuhgVz
+WvJnizROfWS/7ppuxu7+CQEoaSDTn1+s4s/4FKMqM/huvJn68qYXWo9GWqZq6m2t
+z6pOiFwjMTVLNJRKn0DGp4UsqY4VEb4UJ1BmdhVVQeWb2IAtxxs=
+=qPHR
+-----END PGP SIGNATURE-----

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.sha512
==============================================================================
--- dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.sha512 (added)
+++ dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-bin.tar.gz.sha512 Mon Dec 20 04:41:51 2021
@@ -0,0 +1,4 @@
+hbase-operator-tools-1.2.0-bin.tar.gz: C05381CD 084F1F0A 1363AA6F 6478710A
+                                       60EC23C4 D08A31A9 2497C0F8 73E86F68
+                                       96E3F865 DD8EB038 3D3DE44B ADD9067A
+                                       A6CCEB5B 3A7DF9BC E95B7B82 E9ED2A11

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz
==============================================================================
Binary file - no diff available.

Propchange: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz
------------------------------------------------------------------------------
    svn:mime-type = application/octet-stream

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.asc
==============================================================================
--- dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.asc (added)
+++ dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.asc Mon Dec 20 04:41:51 2021
@@ -0,0 +1,16 @@
+-----BEGIN PGP SIGNATURE-----
+
+iQIzBAABCAAdFiEEmxLCIovf9PTP6ElEXvOmbVfsZHoFAmG/+S0ACgkQXvOmbVfs
+ZHo5Ng//a5qT+ODXdSRRqts5n6O+R/qBN6K7oeUUm7Ul7xnbmr3udCGx5MvEX1R2
+a7bCk018sxOxpJ0hwBiokhuG9m5/665aCBmNSWkdvlp4Dmm2/kLL+590hDUSdrni
+4uueaZs+Z3dQcdWPRDheCGLqw04YCtWE8wBYbBKisVqmQDPcmehQDsaitsJuTZFj
+b7NboI+5Z8hIWDs2D3u6wvHFBAno0hE98Zuy5pzH6eCo2xDs8gIOhdsoRQruMUOu
+91BuzmHSJTx8XhUYkorX8xkRaJir/TV9QluJIFW9kVaZ3IHd5wpOGWI3NBtLyAoz
+WI5znmyqpXLKXfAd41rjZUotjYCTW2PJF51XAPFY1PI5NVlfKhNCyLjKk1BNsT4k
+VcA89Ki+7Df3cefgpCnaoHgnlt7uCh3tr6+iPmctRPCrcLV+oI20J0/pIXweVtqa
+Oze5dmxKqhpWILMq7M9Bqd6w0n9BPRUFsKy/hMzwFVUFUzPELOYHUL6xgkGBnrjd
+tew+csLLx/rWWOA7Kxvhv9lp9kJJKO7KTBPfrH0mhbSZ5a92m8Y0MfwSoFNw/bso
+n3jRFsfPnoLSB8m5KrQoTbOAW9lJxYnrbSXszSt7hGrOhyYUIcV/cLMj90DuILIg
+01SCuIpP+2BkZTyT5ZonNwkh7uwRo2458XurGHN7m6z1QQmzLeQ=
+=vl8l
+-----END PGP SIGNATURE-----

Added: dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.sha512
==============================================================================
--- dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.sha512 (added)
+++ dev/hbase/hbase-operator-tools-1.2.0RC1/hbase-operator-tools-1.2.0-src.tar.gz.sha512 Mon Dec 20 04:41:51 2021
@@ -0,0 +1,4 @@
+hbase-operator-tools-1.2.0-src.tar.gz: 25459A90 8359EFB6 4C07536C DB4AB78B
+                                       5CBDC849 D4CBC811 25EF0D8F 5F96E9FC
+                                       32D5F1D1 9FE06AEE 53BE9348 E2887219
+                                       F1BD5772 D49D3669 E14560B5 4AD5E717