You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hbase.apache.org by bu...@apache.org on 2018/05/31 02:33:53 UTC
[1/2] hbase git commit: HBASE-20501 update minimum supported Hadoop
version to 2.7.1.
Repository: hbase
Updated Branches:
refs/heads/branch-1 f4ac15999 -> d576e9a13
refs/heads/branch-2 aaec02e0f -> 9431ee3f4
HBASE-20501 update minimum supported Hadoop version to 2.7.1.
Signed-off-by: Andrew Purtell <ap...@apache.org>
Conflicts:
src/main/asciidoc/_chapters/configuration.adoc
Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/9431ee3f
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/9431ee3f
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/9431ee3f
Branch: refs/heads/branch-2
Commit: 9431ee3f4981031521a927af1a651081b860a36a
Parents: aaec02e
Author: Sean Busbey <bu...@apache.org>
Authored: Wed May 30 21:22:42 2018 -0500
Committer: Sean Busbey <bu...@apache.org>
Committed: Wed May 30 21:28:06 2018 -0500
----------------------------------------------------------------------
dev-support/hbase-personality.sh | 25 ++++++++++++++-------
src/main/asciidoc/_chapters/configuration.adoc | 24 +++++++++++---------
src/main/asciidoc/_chapters/upgrading.adoc | 12 ++++++++--
3 files changed, 40 insertions(+), 21 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hbase/blob/9431ee3f/dev-support/hbase-personality.sh
----------------------------------------------------------------------
diff --git a/dev-support/hbase-personality.sh b/dev-support/hbase-personality.sh
index b010503..878f438 100755
--- a/dev-support/hbase-personality.sh
+++ b/dev-support/hbase-personality.sh
@@ -442,23 +442,32 @@ function hadoopcheck_rebuild
# All supported Hadoop versions that we want to test the compilation with
# See the Hadoop section on prereqs in the HBase Reference Guide
- hbase_common_hadoop2_versions="2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4"
- if [[ "${PATCH_BRANCH}" = branch-1* ]]; then
- yetus_info "Setting Hadoop versions to test based on branch-1-ish rules."
+ hbase_common_hadoop2_versions="2.7.1 2.7.2 2.7.3 2.7.4"
+ if [[ "${PATCH_BRANCH}" = branch-1.* ]] && [[ "${PATCH_BRANCH#branch-1.}" -lt "5" ]]; then
+ yetus_info "Setting Hadoop 2 versions to test based on before-branch-1.5 rules."
if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
hbase_hadoop2_versions="2.4.1 2.5.2 2.6.5 2.7.4"
else
- hbase_hadoop2_versions="2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 ${hbase_common_hadoop2_versions}"
+ hbase_hadoop2_versions="2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 ${hbase_common_hadoop2_versions}"
fi
- hbase_hadoop3_versions=""
- else # master or a feature branch
- yetus_info "Setting Hadoop versions to test based on branch-2/master/feature branch rules."
+ elif [[ "${PATCH_BRANCH}" = branch-2.0 ]]; then
+ yetus_info "Setting Hadoop 2 versions to test based on branch-2.0 rules."
if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
hbase_hadoop2_versions="2.6.5 2.7.4"
else
+ hbase_hadoop2_versions="2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 ${hbase_common_hadoop2_versions}"
+ fi
+ else
+ yetus_info "Setting Hadoop 2 versions to test based on branch-1.5+/branch-2.1+/master/feature branch rules."
+ if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
+ hbase_hadoop2_versions="2.7.4"
+ else
hbase_hadoop2_versions="${hbase_common_hadoop2_versions}"
fi
- hbase_hadoop3_versions="3.0.0"
+ fi
+ hbase_hadoop3_versions="3.0.0"
+ if [[ "${PATCH_BRANCH}" = branch-1* ]]; then
+ hbase_hadoop3_versions=""
fi
export MAVEN_OPTS="${MAVEN_OPTS}"
http://git-wip-us.apache.org/repos/asf/hbase/blob/9431ee3f/src/main/asciidoc/_chapters/configuration.adoc
----------------------------------------------------------------------
diff --git a/src/main/asciidoc/_chapters/configuration.adoc b/src/main/asciidoc/_chapters/configuration.adoc
index 504826a..66fe5dd 100644
--- a/src/main/asciidoc/_chapters/configuration.adoc
+++ b/src/main/asciidoc/_chapters/configuration.adoc
@@ -198,18 +198,20 @@ Use the following legend to interpret this table:
* "X" = not supported
* "NT" = Not tested
-[cols="1,1,1,1", options="header"]
+[cols="1,1,1,1,1,1", options="header"]
|===
-| | HBase-1.2.x | HBase-1.3.x | HBase-2.0.x
-|Hadoop-2.4.x | S | S | X
-|Hadoop-2.5.x | S | S | X
-|Hadoop-2.6.0 | X | X | X
-|Hadoop-2.6.1+ | S | S | S
-|Hadoop-2.7.0 | X | X | X
-|Hadoop-2.7.1+ | S | S | S
-|Hadoop-2.8.0 | X | X | X
-|Hadoop-2.8.1 | X | X | X
-|Hadoop-3.0.0 | NT | NT | NT
+| | HBase-1.2.x | HBase-1.3.x | HBase-1.5.x | HBase-2.0.x | HBase-2.1.x
+|Hadoop-2.4.x | S | S | X | X | X
+|Hadoop-2.5.x | S | S | X | X | X
+|Hadoop-2.6.0 | X | X | X | X | X
+|Hadoop-2.6.1+ | S | S | X | S | X
+|Hadoop-2.7.0 | X | X | X | X | X
+|Hadoop-2.7.1+ | S | S | S | S | S
+|Hadoop-2.8.[0-1] | X | X | X | X | X
+|Hadoop-2.8.2 | NT | NT | NT | NT | NT
+|Hadoop-2.8.3+ | NT | NT | NT | S | S
+|Hadoop-2.9.0 | X | X | X | X | X
+|Hadoop-3.0.0 | NT | NT | NT | NT | NT
|===
.Hadoop Pre-2.6.1 and JDK 1.8 Kerberos
http://git-wip-us.apache.org/repos/asf/hbase/blob/9431ee3f/src/main/asciidoc/_chapters/upgrading.adoc
----------------------------------------------------------------------
diff --git a/src/main/asciidoc/_chapters/upgrading.adoc b/src/main/asciidoc/_chapters/upgrading.adoc
index 79ade65..ef20c7d 100644
--- a/src/main/asciidoc/_chapters/upgrading.adoc
+++ b/src/main/asciidoc/_chapters/upgrading.adoc
@@ -86,8 +86,16 @@ for warning about incompatible changes). All effort will be made to provide a de
* Example: Old compiled Coprocessor, Filter, or Plugin code will work unchanged with the new jars.
.Dependency Compatibility
-* An upgrade of HBase will not require an incompatible upgrade of a dependent project, including the Java runtime.
-* Example: An upgrade of Hadoop will not invalidate any of the compatibilities guarantees we made.
+* An upgrade of HBase will not require an incompatible upgrade of a dependent project, except for Apache Hadoop.
+* An upgrade of HBase will not require an incompatible upgrade of the Java runtime.
+* Example: Upgrading HBase to a version that supports _Dependency Compatibility_ won't require that you upgrade your Apache ZooKeeper service.
+* Example: If your current version of HBase supported running on JDK 8, then an upgrade to a version that supports _Dependency Compatibility_ will also run on JDK 8.
+
+.Hadoop Versions
+[TIP]
+====
+Previously, we tried to maintain dependency compatibility for the underly Hadoop service but over the last few years this has proven untenable. While the HBase project attempts to maintain support for older versions of Hadoop, we drop the "supported" designator for minor versions that fail to continue to see releases. Additionally, the Hadoop project has its own set of compatibility guidelines, which means in some cases having to update to a newer supported minor release might break some of our compatibility promises.
+====
.Operational Compatibility
* Metric changes
[2/2] hbase git commit: HBASE-20501 update minimum supported Hadoop
version to 2.7.1.
Posted by bu...@apache.org.
HBASE-20501 update minimum supported Hadoop version to 2.7.1.
Signed-off-by: Andrew Purtell <ap...@apache.org>
Conflicts:
src/main/asciidoc/_chapters/configuration.adoc
Conflicts:
dev-support/hbase-personality.sh
src/main/asciidoc/_chapters/configuration.adoc
Project: http://git-wip-us.apache.org/repos/asf/hbase/repo
Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/d576e9a1
Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/d576e9a1
Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/d576e9a1
Branch: refs/heads/branch-1
Commit: d576e9a13f69db286843ccbb2e39a53e5fa29906
Parents: f4ac159
Author: Sean Busbey <bu...@apache.org>
Authored: Wed May 30 21:22:42 2018 -0500
Committer: Sean Busbey <bu...@apache.org>
Committed: Wed May 30 21:32:51 2018 -0500
----------------------------------------------------------------------
dev-support/hbase-personality.sh | 25 ++++++++++++------
src/main/asciidoc/_chapters/configuration.adoc | 28 ++++++++++-----------
src/main/asciidoc/_chapters/upgrading.adoc | 12 +++++++--
3 files changed, 40 insertions(+), 25 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/hbase/blob/d576e9a1/dev-support/hbase-personality.sh
----------------------------------------------------------------------
diff --git a/dev-support/hbase-personality.sh b/dev-support/hbase-personality.sh
index bae7163..9828564 100755
--- a/dev-support/hbase-personality.sh
+++ b/dev-support/hbase-personality.sh
@@ -442,23 +442,32 @@ function hadoopcheck_rebuild
# All supported Hadoop versions that we want to test the compilation with
# See the Hadoop section on prereqs in the HBase Reference Guide
- hbase_common_hadoop2_versions="2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 2.7.4"
- if [[ "${PATCH_BRANCH}" = branch-1* ]]; then
- yetus_info "Setting Hadoop versions to test based on branch-1-ish rules."
+ hbase_common_hadoop2_versions="2.7.1 2.7.2 2.7.3 2.7.4"
+ if [[ "${PATCH_BRANCH}" = branch-1.* ]] && [[ "${PATCH_BRANCH#branch-1.}" -lt "5" ]]; then
+ yetus_info "Setting Hadoop 2 versions to test based on before-branch-1.5 rules."
if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
hbase_hadoop2_versions="2.4.1 2.5.2 2.6.5 2.7.4"
else
- hbase_hadoop2_versions="2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 ${hbase_common_hadoop2_versions}"
+ hbase_hadoop2_versions="2.4.0 2.4.1 2.5.0 2.5.1 2.5.2 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 ${hbase_common_hadoop2_versions}"
fi
- hbase_hadoop3_versions=""
- else # master or a feature branch
- yetus_info "Setting Hadoop versions to test based on branch-2/master/feature branch rules."
+ elif [[ "${PATCH_BRANCH}" = branch-2.0 ]]; then
+ yetus_info "Setting Hadoop 2 versions to test based on branch-2.0 rules."
if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
hbase_hadoop2_versions="2.6.5 2.7.4"
else
+ hbase_hadoop2_versions="2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 ${hbase_common_hadoop2_versions}"
+ fi
+ else
+ yetus_info "Setting Hadoop 2 versions to test based on branch-1.5+/branch-2.1+/master/feature branch rules."
+ if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
+ hbase_hadoop2_versions="2.7.4"
+ else
hbase_hadoop2_versions="${hbase_common_hadoop2_versions}"
fi
- hbase_hadoop3_versions="3.0.0-beta1"
+ fi
+ hbase_hadoop3_versions="3.0.0"
+ if [[ "${PATCH_BRANCH}" = branch-1* ]]; then
+ hbase_hadoop3_versions=""
fi
export MAVEN_OPTS="${MAVEN_OPTS}"
http://git-wip-us.apache.org/repos/asf/hbase/blob/d576e9a1/src/main/asciidoc/_chapters/configuration.adoc
----------------------------------------------------------------------
diff --git a/src/main/asciidoc/_chapters/configuration.adoc b/src/main/asciidoc/_chapters/configuration.adoc
index 01f2eb7..6e930aa 100644
--- a/src/main/asciidoc/_chapters/configuration.adoc
+++ b/src/main/asciidoc/_chapters/configuration.adoc
@@ -210,22 +210,20 @@ Use the following legend to interpret this table:
* "X" = not supported
* "NT" = Not tested
-[cols="1,1,1,1,1,1,1", options="header"]
+[cols="1,1,1,1,1,1", options="header"]
|===
-| | HBase-0.92.x | HBase-0.94.x | HBase-0.96.x | HBase-0.98.x (Support for Hadoop 1.1+ is deprecated.) | HBase-1.0.x (Hadoop 1.x is NOT supported) | HBase-1.1.x
-|Hadoop-0.20.205 | S | X | X | X | X | X
-|Hadoop-0.22.x | S | X | X | X | X | X
-|Hadoop-1.0.x |X | X | X | X | X | X
-|Hadoop-1.1.x | NT | S | S | NT | X | X
-|Hadoop-0.23.x | X | S | NT | X | X | X
-|Hadoop-2.0.x-alpha | X | NT | X | X | X | X
-|Hadoop-2.1.0-beta | X | NT | S | X | X | X
-|Hadoop-2.2.0 | X | NT | S | S | NT | NT
-|Hadoop-2.3.x | X | NT | S | S | NT | NT
-|Hadoop-2.4.x | X | NT | S | S | S | S
-|Hadoop-2.5.x | X | NT | S | S | S | S
-|Hadoop-2.6.x | X | NT | NT | NT | S | S
-|Hadoop-2.7.x | X | NT | NT | NT | NT | NT
+| | HBase-1.2.x | HBase-1.3.x | HBase-1.5.x | HBase-2.0.x | HBase-2.1.x
+|Hadoop-2.4.x | S | S | X | X | X
+|Hadoop-2.5.x | S | S | X | X | X
+|Hadoop-2.6.0 | X | X | X | X | X
+|Hadoop-2.6.1+ | S | S | X | S | X
+|Hadoop-2.7.0 | X | X | X | X | X
+|Hadoop-2.7.1+ | S | S | S | S | S
+|Hadoop-2.8.[0-1] | X | X | X | X | X
+|Hadoop-2.8.2 | NT | NT | NT | NT | NT
+|Hadoop-2.8.3+ | NT | NT | NT | S | S
+|Hadoop-2.9.0 | X | X | X | X | X
+|Hadoop-3.0.0 | NT | NT | NT | NT | NT
|===
.Replace the Hadoop Bundled With HBase!
http://git-wip-us.apache.org/repos/asf/hbase/blob/d576e9a1/src/main/asciidoc/_chapters/upgrading.adoc
----------------------------------------------------------------------
diff --git a/src/main/asciidoc/_chapters/upgrading.adoc b/src/main/asciidoc/_chapters/upgrading.adoc
index 4256e47..7fdc84f 100644
--- a/src/main/asciidoc/_chapters/upgrading.adoc
+++ b/src/main/asciidoc/_chapters/upgrading.adoc
@@ -86,8 +86,16 @@ In addition to the usual API versioning considerations HBase has other compatibi
* Example: Old compiled Coprocessor, Filter, or Plugin code will work unchanged with the new jars.
.Dependency Compatibility
-* An upgrade of HBase will not require an incompatible upgrade of a dependent project, including the Java runtime.
-* Example: An upgrade of Hadoop will not invalidate any of the compatibilities guarantees we made.
+* An upgrade of HBase will not require an incompatible upgrade of a dependent project, except for Apache Hadoop.
+* An upgrade of HBase will not require an incompatible upgrade of the Java runtime.
+* Example: Upgrading HBase to a version that supports _Dependency Compatibility_ won't require that you upgrade your Apache ZooKeeper service.
+* Example: If your current version of HBase supported running on JDK 8, then an upgrade to a version that supports _Dependency Compatibility_ will also run on JDK 8.
+
+.Hadoop Versions
+[TIP]
+====
+Previously, we tried to maintain dependency compatibility for the underly Hadoop service but over the last few years this has proven untenable. While the HBase project attempts to maintain support for older versions of Hadoop, we drop the "supported" designator for minor versions that fail to continue to see releases. Additionally, the Hadoop project has its own set of compatibility guidelines, which means in some cases having to update to a newer supported minor release might break some of our compatibility promises.
+====
.Operational Compatibility
* Metric changes