You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Enis Söztutar <en...@apache.org> on 2015/02/02 03:38:00 UTC
[VOTE] Fourth release candidate for HBase 1.0.0 (RC3) is available.
Please vote by Feb 11 2015
It gives me great pleasure to announce that the fourth release candidate
for the release
1.0.0 (HBase-1.0.0RC3), is available for download at
https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC3/
Maven artifacts are also available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1061
Signed with my code signing key E964B5FF. Can be found here:
https://people.apache.org/keys/committer/enis.asc
Signed tag in the repository can be found here:
https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=46d9c29d83b535781e8fa8a044c12ee990a002c3
HBase 1.0.0 is the next stable release, and the start of "semantic
versioned"
releases (See [1]).
The theme of 1.0.0 release is to become a stable base for future 1.x series
of releases. We aim to achieve at least the same level of stability of 0.98
releases.
1.0.0 release contains 167 fixes on top of 0.99.2 release. Together with the
previous 0.99.x releases, major changes in 1.0.0 are listed (but not
limited to)
below. Note that all previous 0.99.x releases are developer preview
releases, and will
NOT be supported in any form.
API Cleanup and changes
1.0.0 introduces new APIs, and deprecates some of commonly-used
client side APIs (HTableInterface, HTable and HBaseAdmin).
We advise to update your application to use the new style of APIs, since
deprecated APIs might be removed in future releases (2.x). See [2] and [3]
for an overview of changes. All Client side API's are marked with
InterfaceAudience.Public class, indicating that the class/method is an
official "client API" for HBase. All 1.x releases are planned to be API
compatible for these classes. See [1] for an overview.
Master runs a Region Server as well
Starting with 1.0.0, the HBase master server and backup master servers
will
also act as a region server. RPC port and info port for web UI is shared
for
the master and region server roles. Active master can host regions of
defined tables if configured (disabled by default). Backup masters will
not
host regions.
Read availability using timeline consistent region replicas
This release contains Phase 1 items for experimental "Read availability
using
timeline consistent region replicas" feature. A region can be hosted in
multiple region servers in read-only mode. One of the replicas for the
region
will be primary, accepting writes, and other replicas will be sharing the
same
data files. Read requests can be done against any replica for the region
with
backup RPCs for high availability with timeline consistency guarantees.
More
information can be found at HBASE-10070.
Online config change and other forward ports from 0.89-fb branch
HBASE-12147 forward ported online config change which enables some of the
configuration from the server to be reloaded without restarting the region
servers.
Other notable improvements in 1.0.0 (including previous 0.99.x) are
- A new web skin in time for 1.0 (http://hbase.apache.org)
- Automatic tuning of global memstore and block cache sizes
- Various security, tags and visibility labels improvements
- Bucket cache improvements (usability and compressed data blocks)
- A new pluggable replication endpoint to plug in to HBase's inter-cluster
replication to replicate to a custom data store
- A Dockerfile to easily build and run HBase from source
- Truncate table command
- Region assignment to use hbase:meta table instead of zookeeper for faster
region assignment (disabled by default)
- Extensive documentation improvements
- [HBASE-12511] - namespace permissions - add support from table creation
privilege in a namespace 'C'
- [HBASE-12568] - Adopt Semantic Versioning and document it in the book
- [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
- [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
configuration capability' to branch-1
- [HBASE-10560] - Per cell TTLs
- [HBASE-11997] - CopyTable with bulkload
- [HBASE-11990] - Make setting the start and stop row for a specific
prefix easier
- [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
- [HBASE-12090] - Bytes: more Unsafe, more Faster
- [HBASE-12032] - Script to stop regionservers via RPC
- [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
in RegexStringComparator
- [HBASE-11796] - Add client support for atomic checkAndMutate
- [HBASE-11804] - Raise default heap size if unspecified
- [HBASE-11890] - HBase REST Client is hard coded to http protocol
- [HBASE-12126] - Region server coprocessor endpoint
- [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
- [HBASE-12075] - Preemptive Fast Fail
- [HBASE-12354] - Update dependencies in time for 1.0 release
- [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
- [HBASE-12434] - Add a command to compact all the regions in a
regionserver
- [HBASE-8707] - Add LongComparator for filter
- [HBASE-12286] - [shell] Add server/cluster online load of configuration
changes
- [HBASE-12361] - Show data locality of region in table page
- [HBASE-12496] - A blockedRequestsCount metric
- [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
branch-1
- [HBASE-12731] - Heap occupancy based client pushback
- [HBASE-12728] - buffered writes substantially less useful after removal
of HTablePool
- [HBASE-5699] - Run with > 1 WAL in HRegionServer
- Various fixes to REST server
- Internal refactoring for abstracting away zookeeper usage
- Better support for Cell interface internally in read and write paths for
better performance and flexibility
- Combining internal mvcc and seqId infrastructure
- Ring buffer based WAL improvements
- Switch to using new style of client APIs internally (in a lot of places)
- Improvements in visibility labels
- Perf improvements
- Numerous improvements in other areas and bug fixes.
1.0.0 release has these changes in default behavior (see [4])
- Zookeeper 3.4.x is required
- Hadoop-2.x is required
- JDK-1.7 is required
- Default ports have changed from 600XX range into out of ephemeral 160XX
range.
- Hfile version 3 has been enabled by default.
- Slab cache has been removed (use bucket cache instead)
- Default heap for region servers (and master) is changed from 1GB to
the jdk's default. On most platforms, it will default to 1/4 of physical
memory
- Some client facing APIs (HTableInterface, etc) has been deprecated and
replaced.
- Custom Filter implementations should switch to using the new recommended
APIs.
- Some authorization permissions (especially regarding namespaces) have
been
changed (HBASE-12511, HBASE-8015)
- Mapred package and classes under there has been un-deprecated.
- Two new modules (jar files): hbase-annotations and hbase-rest.
- HTrace dependency is moved to the Apache artifacts (
https://htrace.incubator.apache.org/)
- Various updates to dependency versions
Full list of the issues can be found at:
- 1.0.0 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
- 0.99.2 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
- 0.99.1 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
- 0.99.0 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
Compatibility
-------------
Source Compatibility:
Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
versions. Some minor API changes might be needed from the client side.
Wire Compatibility:
HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
servers running in different versions as long as new features are not used
should be possible.
A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
introduces a new file format (hfile v3) that is enabled by default that
0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
is
not supported.
1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
Binary Compatibility:
Binary compatibility at the Java API layer with earlier versions (0.98.x,
0.96.x and 0.94.x) is not supported. You may have to recompile your client
code and any server side code (coprocessors, filters etc) referring to
hbase jars.
Upgrading
---------
See [4] for upgrade instructions and extended discussion on the changes.
>From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
fashion
is supported.
>From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
of
the cluster.
>From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
metadata.
See [5] for details.
Supported Hadoop versions
-------------------------
1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x releases
are the most tested hadoop releases and we recommend running with those
versions
(or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
2.3.x)
are not tested to the full extend. More information can be found here:
https://hbase.apache.org/book/configuration.html#hadoop
Supported Java versions
-------------------------
1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
is experimental. More information can be found here:
https://hbase.apache.org/book/configuration.html#java
Voting
------
Please try to test and vote on this release by Feb 11 2015 11:59PM PDT.
Due to the importance of 1.0 release we will have a 10 day voting period
to cover sufficient testing. Please notify here if you need more time to
test the RC.
[] +1 Release the artifacts as 1.0.0
[] -1 DO NOT release the artifacts as 1.0.0, because...
Gratitute
---------
Last but not least, 1.0.0 release has been in a long time making with
contributions from a very large group of awesome people and hard work from
committers and contributors. We would like to extend our thanks to everybody
who worked on this release or contributed to HBase over the years.
References
----------
[1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
[2] http://www.slideshare.net/xefyr/apache-hbase-10-release
[3] http://s.apache.org/hbase-1.0-api
[4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
[5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
Enis
Re: [VOTE] Fourth release candidate for HBase 1.0.0 (RC3) is
available. Please vote by Feb 11 2015
Posted by Enis Söztutar <en...@gmail.com>.
Thanks for the tests so far. Unfortunately, I think HBASE-12956 is an
important regression to fix. I'll let RC3 sink as well, and will spin up a
new one when that is fixed.
Please feel free to continue the testing on this RC though for other tests.
The changes in the next RC should not be too much.
Enis
On Thu, Feb 5, 2015 at 12:47 PM, Ted Yu <yu...@gmail.com> wrote:
> Did some more testing:
>
> Compiled Hive trunk against published maven artifacts
> Used shell to exercise various commands, including update_all_config
> command (verified by reloading regionserver:60030/conf)
>
> All looked good.
>
> On Tue, Feb 3, 2015 at 10:32 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > +1 based on the following:
> >
> > Checked signature
> > Ran test suite
> > Loaded tarball on a 5-node cluster
> > Ran LoadTestTool which passed
> >
> > Will continue testing.
> >
> > On Mon, Feb 2, 2015 at 5:11 PM, Enis Söztutar <en...@apache.org> wrote:
> >
> >> To get the ball rolling, here are the tests that I have done so far. No
> >> official +1 yet, since I will spend some more time on this.
> >>
> >> - checked checksums, sigs
> >> - checked the bin and src artifacts
> >> - checked layouts
> >> - checked java files in src tarball, and jar files in bin tarball
> >> - checked the book and the site (they are new style)
> >> - checked javadocs for both devapi and userapi
> >> - checked reported version, build time, revision
> >> - run some smoke tests using shell
> >> - started local mode
> >> - run LTT local mode
> >> - checked the webUI in local mode
> >> - checked JMX dump and debug dump
> >>
> >> I had run most of the ITs on the other RC's, but I'll repeat them for
> this
> >> and report here when done.
> >>
> >> Happy testing,
> >> Enis
> >>
> >> On Sun, Feb 1, 2015 at 6:38 PM, Enis Söztutar <en...@apache.org> wrote:
> >>
> >> > It gives me great pleasure to announce that the fourth release
> candidate
> >> > for the release
> >> > 1.0.0 (HBase-1.0.0RC3), is available for download at
> >> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC3/
> >> >
> >> > Maven artifacts are also available in the temporary repository
> >> >
> https://repository.apache.org/content/repositories/orgapachehbase-1061
> >> >
> >> > Signed with my code signing key E964B5FF. Can be found here:
> >> > https://people.apache.org/keys/committer/enis.asc
> >> >
> >> > Signed tag in the repository can be found here:
> >> >
> >> >
> >>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=46d9c29d83b535781e8fa8a044c12ee990a002c3
> >> >
> >> > HBase 1.0.0 is the next stable release, and the start of "semantic
> >> > versioned"
> >> > releases (See [1]).
> >> >
> >> > The theme of 1.0.0 release is to become a stable base for future 1.x
> >> series
> >> > of releases. We aim to achieve at least the same level of stability of
> >> 0.98
> >> > releases.
> >> >
> >> > 1.0.0 release contains 167 fixes on top of 0.99.2 release. Together
> with
> >> > the
> >> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> >> > limited to)
> >> > below. Note that all previous 0.99.x releases are developer preview
> >> > releases, and will
> >> > NOT be supported in any form.
> >> >
> >> > API Cleanup and changes
> >> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> >> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> >> > We advise to update your application to use the new style of APIs,
> >> since
> >> > deprecated APIs might be removed in future releases (2.x). See [2]
> and
> >> > [3]
> >> > for an overview of changes. All Client side API's are marked with
> >> > InterfaceAudience.Public class, indicating that the class/method is
> an
> >> > official "client API" for HBase. All 1.x releases are planned to be
> >> API
> >> > compatible for these classes. See [1] for an overview.
> >> >
> >> > Master runs a Region Server as well
> >> > Starting with 1.0.0, the HBase master server and backup master
> servers
> >> > will
> >> > also act as a region server. RPC port and info port for web UI is
> >> shared
> >> > for
> >> > the master and region server roles. Active master can host regions
> of
> >> > defined tables if configured (disabled by default). Backup masters
> >> will
> >> > not
> >> > host regions.
> >> >
> >> > Read availability using timeline consistent region replicas
> >> > This release contains Phase 1 items for experimental "Read
> >> availability
> >> > using
> >> > timeline consistent region replicas" feature. A region can be hosted
> >> in
> >> > multiple region servers in read-only mode. One of the replicas for
> the
> >> > region
> >> > will be primary, accepting writes, and other replicas will be
> sharing
> >> > the same
> >> > data files. Read requests can be done against any replica for the
> >> region
> >> > with
> >> > backup RPCs for high availability with timeline consistency
> >> guarantees.
> >> > More
> >> > information can be found at HBASE-10070.
> >> >
> >> > Online config change and other forward ports from 0.89-fb branch
> >> > HBASE-12147 forward ported online config change which enables some
> of
> >> the
> >> > configuration from the server to be reloaded without restarting the
> >> > region
> >> > servers.
> >> >
> >> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> >> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> >> > - Automatic tuning of global memstore and block cache sizes
> >> > - Various security, tags and visibility labels improvements
> >> > - Bucket cache improvements (usability and compressed data blocks)
> >> > - A new pluggable replication endpoint to plug in to HBase's
> >> inter-cluster
> >> > replication to replicate to a custom data store
> >> > - A Dockerfile to easily build and run HBase from source
> >> > - Truncate table command
> >> > - Region assignment to use hbase:meta table instead of zookeeper for
> >> > faster
> >> > region assignment (disabled by default)
> >> > - Extensive documentation improvements
> >> > - [HBASE-12511] - namespace permissions - add support from table
> >> creation
> >> > privilege in a namespace 'C'
> >> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the
> book
> >> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> >> Server
> >> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> >> online
> >> > configuration capability' to branch-1
> >> > - [HBASE-10560] - Per cell TTLs
> >> > - [HBASE-11997] - CopyTable with bulkload
> >> > - [HBASE-11990] - Make setting the start and stop row for a specific
> >> > prefix easier
> >> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> >> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> >> > - [HBASE-12032] - Script to stop regionservers via RPC
> >> > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> >> j.u.regex
> >> > in RegexStringComparator
> >> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> >> > - [HBASE-11804] - Raise default heap size if unspecified
> >> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> >> > - [HBASE-12126] - Region server coprocessor endpoint
> >> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> >> > - [HBASE-12075] - Preemptive Fast Fail
> >> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> >> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> >> MIN_VERSIONS
> >> > - [HBASE-12434] - Add a command to compact all the regions in a
> >> > regionserver
> >> > - [HBASE-8707] - Add LongComparator for filter
> >> > - [HBASE-12286] - [shell] Add server/cluster online load of
> >> configuration
> >> > changes
> >> > - [HBASE-12361] - Show data locality of region in table page
> >> > - [HBASE-12496] - A blockedRequestsCount metric
> >> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> mechanism)
> >> > to branch-1
> >> > - [HBASE-12731] - Heap occupancy based client pushback
> >> > - [HBASE-12728] - buffered writes substantially less useful after
> >> removal
> >> > of HTablePool
> >> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> >> > - Various fixes to REST server
> >> > - Internal refactoring for abstracting away zookeeper usage
> >> > - Better support for Cell interface internally in read and write
> paths
> >> for
> >> > better performance and flexibility
> >> > - Combining internal mvcc and seqId infrastructure
> >> > - Ring buffer based WAL improvements
> >> > - Switch to using new style of client APIs internally (in a lot of
> >> places)
> >> > - Improvements in visibility labels
> >> > - Perf improvements
> >> > - Numerous improvements in other areas and bug fixes.
> >> >
> >> > 1.0.0 release has these changes in default behavior (see [4])
> >> > - Zookeeper 3.4.x is required
> >> > - Hadoop-2.x is required
> >> > - JDK-1.7 is required
> >> > - Default ports have changed from 600XX range into out of ephemeral
> >> 160XX
> >> > range.
> >> > - Hfile version 3 has been enabled by default.
> >> > - Slab cache has been removed (use bucket cache instead)
> >> > - Default heap for region servers (and master) is changed from 1GB to
> >> > the jdk's default. On most platforms, it will default to 1/4 of
> >> physical
> >> > memory
> >> > - Some client facing APIs (HTableInterface, etc) has been deprecated
> >> and
> >> > replaced.
> >> > - Custom Filter implementations should switch to using the new
> >> > recommended APIs.
> >> > - Some authorization permissions (especially regarding namespaces)
> have
> >> > been
> >> > changed (HBASE-12511, HBASE-8015)
> >> > - Mapred package and classes under there has been un-deprecated.
> >> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> >> > - HTrace dependency is moved to the Apache artifacts (
> >> > https://htrace.incubator.apache.org/)
> >> > - Various updates to dependency versions
> >> >
> >> > Full list of the issues can be found at:
> >> > - 1.0.0 issues :
> >> >
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> >> > - 0.99.2 issues :
> >> >
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> >> > - 0.99.1 issues :
> >> >
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> >> > - 0.99.0 issues :
> >> >
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >> >
> >> > Compatibility
> >> > -------------
> >> > Source Compatibility:
> >> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> >> earlier
> >> > versions. Some minor API changes might be needed from the client side.
> >> >
> >> >
> >> > Wire Compatibility:
> >> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients
> and
> >> > servers running in different versions as long as new features are not
> >> used
> >> > should be possible.
> >> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> >> 1.0.0
> >> > introduces a new file format (hfile v3) that is enabled by default
> that
> >> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> >> 1.0.0
> >> > is
> >> > not supported.
> >> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >> >
> >> > Binary Compatibility:
> >> > Binary compatibility at the Java API layer with earlier versions
> >> (0.98.x,
> >> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> >> client
> >> > code and any server side code (coprocessors, filters etc) referring to
> >> > hbase jars.
> >> >
> >> > Upgrading
> >> > ---------
> >> > See [4] for upgrade instructions and extended discussion on the
> changes.
> >> >
> >> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling
> upgrade
> >> > fashion
> >> > is supported.
> >> >
> >> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> >> restart
> >> > of
> >> > the cluster.
> >> >
> >> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> >> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster
> level
> >> > metadata.
> >> > See [5] for details.
> >> >
> >> >
> >> > Supported Hadoop versions
> >> > -------------------------
> >> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> >> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> >> > releases
> >> > are the most tested hadoop releases and we recommend running with
> those
> >> > versions
> >> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> >> > 2.3.x)
> >> > are not tested to the full extend. More information can be found here:
> >> > https://hbase.apache.org/book/configuration.html#hadoop
> >> >
> >> >
> >> > Supported Java versions
> >> > -------------------------
> >> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> >> support
> >> > is experimental. More information can be found here:
> >> > https://hbase.apache.org/book/configuration.html#java
> >> >
> >> >
> >> > Voting
> >> > ------
> >> > Please try to test and vote on this release by Feb 11 2015 11:59PM
> PDT.
> >> > Due to the importance of 1.0 release we will have a 10 day voting
> period
> >> > to cover sufficient testing. Please notify here if you need more time
> to
> >> > test the RC.
> >> >
> >> > [] +1 Release the artifacts as 1.0.0
> >> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >> >
> >> > Gratitute
> >> > ---------
> >> > Last but not least, 1.0.0 release has been in a long time making with
> >> > contributions from a very large group of awesome people and hard work
> >> from
> >> > committers and contributors. We would like to extend our thanks to
> >> > everybody
> >> > who worked on this release or contributed to HBase over the years.
> >> >
> >> >
> >> > References
> >> > ----------
> >> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> >> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> >> > [3] http://s.apache.org/hbase-1.0-api
> >> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> >> > [5]
> https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >> >
> >> > Enis
> >> >
> >>
> >
> >
>
Re: [VOTE] Fourth release candidate for HBase 1.0.0 (RC3) is
available. Please vote by Feb 11 2015
Posted by Ted Yu <yu...@gmail.com>.
Did some more testing:
Compiled Hive trunk against published maven artifacts
Used shell to exercise various commands, including update_all_config
command (verified by reloading regionserver:60030/conf)
All looked good.
On Tue, Feb 3, 2015 at 10:32 AM, Ted Yu <yu...@gmail.com> wrote:
> +1 based on the following:
>
> Checked signature
> Ran test suite
> Loaded tarball on a 5-node cluster
> Ran LoadTestTool which passed
>
> Will continue testing.
>
> On Mon, Feb 2, 2015 at 5:11 PM, Enis Söztutar <en...@apache.org> wrote:
>
>> To get the ball rolling, here are the tests that I have done so far. No
>> official +1 yet, since I will spend some more time on this.
>>
>> - checked checksums, sigs
>> - checked the bin and src artifacts
>> - checked layouts
>> - checked java files in src tarball, and jar files in bin tarball
>> - checked the book and the site (they are new style)
>> - checked javadocs for both devapi and userapi
>> - checked reported version, build time, revision
>> - run some smoke tests using shell
>> - started local mode
>> - run LTT local mode
>> - checked the webUI in local mode
>> - checked JMX dump and debug dump
>>
>> I had run most of the ITs on the other RC's, but I'll repeat them for this
>> and report here when done.
>>
>> Happy testing,
>> Enis
>>
>> On Sun, Feb 1, 2015 at 6:38 PM, Enis Söztutar <en...@apache.org> wrote:
>>
>> > It gives me great pleasure to announce that the fourth release candidate
>> > for the release
>> > 1.0.0 (HBase-1.0.0RC3), is available for download at
>> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC3/
>> >
>> > Maven artifacts are also available in the temporary repository
>> > https://repository.apache.org/content/repositories/orgapachehbase-1061
>> >
>> > Signed with my code signing key E964B5FF. Can be found here:
>> > https://people.apache.org/keys/committer/enis.asc
>> >
>> > Signed tag in the repository can be found here:
>> >
>> >
>> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=46d9c29d83b535781e8fa8a044c12ee990a002c3
>> >
>> > HBase 1.0.0 is the next stable release, and the start of "semantic
>> > versioned"
>> > releases (See [1]).
>> >
>> > The theme of 1.0.0 release is to become a stable base for future 1.x
>> series
>> > of releases. We aim to achieve at least the same level of stability of
>> 0.98
>> > releases.
>> >
>> > 1.0.0 release contains 167 fixes on top of 0.99.2 release. Together with
>> > the
>> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
>> > limited to)
>> > below. Note that all previous 0.99.x releases are developer preview
>> > releases, and will
>> > NOT be supported in any form.
>> >
>> > API Cleanup and changes
>> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
>> > client side APIs (HTableInterface, HTable and HBaseAdmin).
>> > We advise to update your application to use the new style of APIs,
>> since
>> > deprecated APIs might be removed in future releases (2.x). See [2] and
>> > [3]
>> > for an overview of changes. All Client side API's are marked with
>> > InterfaceAudience.Public class, indicating that the class/method is an
>> > official "client API" for HBase. All 1.x releases are planned to be
>> API
>> > compatible for these classes. See [1] for an overview.
>> >
>> > Master runs a Region Server as well
>> > Starting with 1.0.0, the HBase master server and backup master servers
>> > will
>> > also act as a region server. RPC port and info port for web UI is
>> shared
>> > for
>> > the master and region server roles. Active master can host regions of
>> > defined tables if configured (disabled by default). Backup masters
>> will
>> > not
>> > host regions.
>> >
>> > Read availability using timeline consistent region replicas
>> > This release contains Phase 1 items for experimental "Read
>> availability
>> > using
>> > timeline consistent region replicas" feature. A region can be hosted
>> in
>> > multiple region servers in read-only mode. One of the replicas for the
>> > region
>> > will be primary, accepting writes, and other replicas will be sharing
>> > the same
>> > data files. Read requests can be done against any replica for the
>> region
>> > with
>> > backup RPCs for high availability with timeline consistency
>> guarantees.
>> > More
>> > information can be found at HBASE-10070.
>> >
>> > Online config change and other forward ports from 0.89-fb branch
>> > HBASE-12147 forward ported online config change which enables some of
>> the
>> > configuration from the server to be reloaded without restarting the
>> > region
>> > servers.
>> >
>> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
>> > - A new web skin in time for 1.0 (http://hbase.apache.org)
>> > - Automatic tuning of global memstore and block cache sizes
>> > - Various security, tags and visibility labels improvements
>> > - Bucket cache improvements (usability and compressed data blocks)
>> > - A new pluggable replication endpoint to plug in to HBase's
>> inter-cluster
>> > replication to replicate to a custom data store
>> > - A Dockerfile to easily build and run HBase from source
>> > - Truncate table command
>> > - Region assignment to use hbase:meta table instead of zookeeper for
>> > faster
>> > region assignment (disabled by default)
>> > - Extensive documentation improvements
>> > - [HBASE-12511] - namespace permissions - add support from table
>> creation
>> > privilege in a namespace 'C'
>> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
>> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
>> Server
>> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
>> online
>> > configuration capability' to branch-1
>> > - [HBASE-10560] - Per cell TTLs
>> > - [HBASE-11997] - CopyTable with bulkload
>> > - [HBASE-11990] - Make setting the start and stop row for a specific
>> > prefix easier
>> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
>> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
>> > - [HBASE-12032] - Script to stop regionservers via RPC
>> > - [HBASE-11907] - Use the joni byte[] regex engine in place of
>> j.u.regex
>> > in RegexStringComparator
>> > - [HBASE-11796] - Add client support for atomic checkAndMutate
>> > - [HBASE-11804] - Raise default heap size if unspecified
>> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
>> > - [HBASE-12126] - Region server coprocessor endpoint
>> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
>> > - [HBASE-12075] - Preemptive Fast Fail
>> > - [HBASE-12354] - Update dependencies in time for 1.0 release
>> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
>> MIN_VERSIONS
>> > - [HBASE-12434] - Add a command to compact all the regions in a
>> > regionserver
>> > - [HBASE-8707] - Add LongComparator for filter
>> > - [HBASE-12286] - [shell] Add server/cluster online load of
>> configuration
>> > changes
>> > - [HBASE-12361] - Show data locality of region in table page
>> > - [HBASE-12496] - A blockedRequestsCount metric
>> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
>> > to branch-1
>> > - [HBASE-12731] - Heap occupancy based client pushback
>> > - [HBASE-12728] - buffered writes substantially less useful after
>> removal
>> > of HTablePool
>> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
>> > - Various fixes to REST server
>> > - Internal refactoring for abstracting away zookeeper usage
>> > - Better support for Cell interface internally in read and write paths
>> for
>> > better performance and flexibility
>> > - Combining internal mvcc and seqId infrastructure
>> > - Ring buffer based WAL improvements
>> > - Switch to using new style of client APIs internally (in a lot of
>> places)
>> > - Improvements in visibility labels
>> > - Perf improvements
>> > - Numerous improvements in other areas and bug fixes.
>> >
>> > 1.0.0 release has these changes in default behavior (see [4])
>> > - Zookeeper 3.4.x is required
>> > - Hadoop-2.x is required
>> > - JDK-1.7 is required
>> > - Default ports have changed from 600XX range into out of ephemeral
>> 160XX
>> > range.
>> > - Hfile version 3 has been enabled by default.
>> > - Slab cache has been removed (use bucket cache instead)
>> > - Default heap for region servers (and master) is changed from 1GB to
>> > the jdk's default. On most platforms, it will default to 1/4 of
>> physical
>> > memory
>> > - Some client facing APIs (HTableInterface, etc) has been deprecated
>> and
>> > replaced.
>> > - Custom Filter implementations should switch to using the new
>> > recommended APIs.
>> > - Some authorization permissions (especially regarding namespaces) have
>> > been
>> > changed (HBASE-12511, HBASE-8015)
>> > - Mapred package and classes under there has been un-deprecated.
>> > - Two new modules (jar files): hbase-annotations and hbase-rest.
>> > - HTrace dependency is moved to the Apache artifacts (
>> > https://htrace.incubator.apache.org/)
>> > - Various updates to dependency versions
>> >
>> > Full list of the issues can be found at:
>> > - 1.0.0 issues :
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
>> > - 0.99.2 issues :
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
>> > - 0.99.1 issues :
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
>> > - 0.99.0 issues :
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>> >
>> > Compatibility
>> > -------------
>> > Source Compatibility:
>> > Client side code in HBase-1.0.0 is (mostly) source compatible with
>> earlier
>> > versions. Some minor API changes might be needed from the client side.
>> >
>> >
>> > Wire Compatibility:
>> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
>> > servers running in different versions as long as new features are not
>> used
>> > should be possible.
>> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
>> 1.0.0
>> > introduces a new file format (hfile v3) that is enabled by default that
>> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
>> 1.0.0
>> > is
>> > not supported.
>> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>> >
>> > Binary Compatibility:
>> > Binary compatibility at the Java API layer with earlier versions
>> (0.98.x,
>> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
>> client
>> > code and any server side code (coprocessors, filters etc) referring to
>> > hbase jars.
>> >
>> > Upgrading
>> > ---------
>> > See [4] for upgrade instructions and extended discussion on the changes.
>> >
>> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
>> > fashion
>> > is supported.
>> >
>> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
>> restart
>> > of
>> > the cluster.
>> >
>> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
>> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
>> > metadata.
>> > See [5] for details.
>> >
>> >
>> > Supported Hadoop versions
>> > -------------------------
>> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
>> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
>> > releases
>> > are the most tested hadoop releases and we recommend running with those
>> > versions
>> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
>> > 2.3.x)
>> > are not tested to the full extend. More information can be found here:
>> > https://hbase.apache.org/book/configuration.html#hadoop
>> >
>> >
>> > Supported Java versions
>> > -------------------------
>> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
>> support
>> > is experimental. More information can be found here:
>> > https://hbase.apache.org/book/configuration.html#java
>> >
>> >
>> > Voting
>> > ------
>> > Please try to test and vote on this release by Feb 11 2015 11:59PM PDT.
>> > Due to the importance of 1.0 release we will have a 10 day voting period
>> > to cover sufficient testing. Please notify here if you need more time to
>> > test the RC.
>> >
>> > [] +1 Release the artifacts as 1.0.0
>> > [] -1 DO NOT release the artifacts as 1.0.0, because...
>> >
>> > Gratitute
>> > ---------
>> > Last but not least, 1.0.0 release has been in a long time making with
>> > contributions from a very large group of awesome people and hard work
>> from
>> > committers and contributors. We would like to extend our thanks to
>> > everybody
>> > who worked on this release or contributed to HBase over the years.
>> >
>> >
>> > References
>> > ----------
>> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
>> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
>> > [3] http://s.apache.org/hbase-1.0-api
>> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
>> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>> >
>> > Enis
>> >
>>
>
>
Re: [VOTE] Fourth release candidate for HBase 1.0.0 (RC3) is
available. Please vote by Feb 11 2015
Posted by Ted Yu <yu...@gmail.com>.
+1 based on the following:
Checked signature
Ran test suite
Loaded tarball on a 5-node cluster
Ran LoadTestTool which passed
Will continue testing.
On Mon, Feb 2, 2015 at 5:11 PM, Enis Söztutar <en...@apache.org> wrote:
> To get the ball rolling, here are the tests that I have done so far. No
> official +1 yet, since I will spend some more time on this.
>
> - checked checksums, sigs
> - checked the bin and src artifacts
> - checked layouts
> - checked java files in src tarball, and jar files in bin tarball
> - checked the book and the site (they are new style)
> - checked javadocs for both devapi and userapi
> - checked reported version, build time, revision
> - run some smoke tests using shell
> - started local mode
> - run LTT local mode
> - checked the webUI in local mode
> - checked JMX dump and debug dump
>
> I had run most of the ITs on the other RC's, but I'll repeat them for this
> and report here when done.
>
> Happy testing,
> Enis
>
> On Sun, Feb 1, 2015 at 6:38 PM, Enis Söztutar <en...@apache.org> wrote:
>
> > It gives me great pleasure to announce that the fourth release candidate
> > for the release
> > 1.0.0 (HBase-1.0.0RC3), is available for download at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC3/
> >
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1061
> >
> > Signed with my code signing key E964B5FF. Can be found here:
> > https://people.apache.org/keys/committer/enis.asc
> >
> > Signed tag in the repository can be found here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=46d9c29d83b535781e8fa8a044c12ee990a002c3
> >
> > HBase 1.0.0 is the next stable release, and the start of "semantic
> > versioned"
> > releases (See [1]).
> >
> > The theme of 1.0.0 release is to become a stable base for future 1.x
> series
> > of releases. We aim to achieve at least the same level of stability of
> 0.98
> > releases.
> >
> > 1.0.0 release contains 167 fixes on top of 0.99.2 release. Together with
> > the
> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > limited to)
> > below. Note that all previous 0.99.x releases are developer preview
> > releases, and will
> > NOT be supported in any form.
> >
> > API Cleanup and changes
> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > We advise to update your application to use the new style of APIs,
> since
> > deprecated APIs might be removed in future releases (2.x). See [2] and
> > [3]
> > for an overview of changes. All Client side API's are marked with
> > InterfaceAudience.Public class, indicating that the class/method is an
> > official "client API" for HBase. All 1.x releases are planned to be API
> > compatible for these classes. See [1] for an overview.
> >
> > Master runs a Region Server as well
> > Starting with 1.0.0, the HBase master server and backup master servers
> > will
> > also act as a region server. RPC port and info port for web UI is
> shared
> > for
> > the master and region server roles. Active master can host regions of
> > defined tables if configured (disabled by default). Backup masters will
> > not
> > host regions.
> >
> > Read availability using timeline consistent region replicas
> > This release contains Phase 1 items for experimental "Read availability
> > using
> > timeline consistent region replicas" feature. A region can be hosted in
> > multiple region servers in read-only mode. One of the replicas for the
> > region
> > will be primary, accepting writes, and other replicas will be sharing
> > the same
> > data files. Read requests can be done against any replica for the
> region
> > with
> > backup RPCs for high availability with timeline consistency guarantees.
> > More
> > information can be found at HBASE-10070.
> >
> > Online config change and other forward ports from 0.89-fb branch
> > HBASE-12147 forward ported online config change which enables some of
> the
> > configuration from the server to be reloaded without restarting the
> > region
> > servers.
> >
> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > - Automatic tuning of global memstore and block cache sizes
> > - Various security, tags and visibility labels improvements
> > - Bucket cache improvements (usability and compressed data blocks)
> > - A new pluggable replication endpoint to plug in to HBase's
> inter-cluster
> > replication to replicate to a custom data store
> > - A Dockerfile to easily build and run HBase from source
> > - Truncate table command
> > - Region assignment to use hbase:meta table instead of zookeeper for
> > faster
> > region assignment (disabled by default)
> > - Extensive documentation improvements
> > - [HBASE-12511] - namespace permissions - add support from table
> creation
> > privilege in a namespace 'C'
> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> Server
> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> > configuration capability' to branch-1
> > - [HBASE-10560] - Per cell TTLs
> > - [HBASE-11997] - CopyTable with bulkload
> > - [HBASE-11990] - Make setting the start and stop row for a specific
> > prefix easier
> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > - [HBASE-12032] - Script to stop regionservers via RPC
> > - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> > in RegexStringComparator
> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > - [HBASE-11804] - Raise default heap size if unspecified
> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > - [HBASE-12126] - Region server coprocessor endpoint
> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > - [HBASE-12075] - Preemptive Fast Fail
> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> > - [HBASE-12434] - Add a command to compact all the regions in a
> > regionserver
> > - [HBASE-8707] - Add LongComparator for filter
> > - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> > changes
> > - [HBASE-12361] - Show data locality of region in table page
> > - [HBASE-12496] - A blockedRequestsCount metric
> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> > to branch-1
> > - [HBASE-12731] - Heap occupancy based client pushback
> > - [HBASE-12728] - buffered writes substantially less useful after
> removal
> > of HTablePool
> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > - Various fixes to REST server
> > - Internal refactoring for abstracting away zookeeper usage
> > - Better support for Cell interface internally in read and write paths
> for
> > better performance and flexibility
> > - Combining internal mvcc and seqId infrastructure
> > - Ring buffer based WAL improvements
> > - Switch to using new style of client APIs internally (in a lot of
> places)
> > - Improvements in visibility labels
> > - Perf improvements
> > - Numerous improvements in other areas and bug fixes.
> >
> > 1.0.0 release has these changes in default behavior (see [4])
> > - Zookeeper 3.4.x is required
> > - Hadoop-2.x is required
> > - JDK-1.7 is required
> > - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> > range.
> > - Hfile version 3 has been enabled by default.
> > - Slab cache has been removed (use bucket cache instead)
> > - Default heap for region servers (and master) is changed from 1GB to
> > the jdk's default. On most platforms, it will default to 1/4 of
> physical
> > memory
> > - Some client facing APIs (HTableInterface, etc) has been deprecated and
> > replaced.
> > - Custom Filter implementations should switch to using the new
> > recommended APIs.
> > - Some authorization permissions (especially regarding namespaces) have
> > been
> > changed (HBASE-12511, HBASE-8015)
> > - Mapred package and classes under there has been un-deprecated.
> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > - HTrace dependency is moved to the Apache artifacts (
> > https://htrace.incubator.apache.org/)
> > - Various updates to dependency versions
> >
> > Full list of the issues can be found at:
> > - 1.0.0 issues :
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > - 0.99.2 issues :
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > - 0.99.1 issues :
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > - 0.99.0 issues :
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >
> > Compatibility
> > -------------
> > Source Compatibility:
> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> > versions. Some minor API changes might be needed from the client side.
> >
> >
> > Wire Compatibility:
> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> > servers running in different versions as long as new features are not
> used
> > should be possible.
> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> 1.0.0
> > introduces a new file format (hfile v3) that is enabled by default that
> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> > is
> > not supported.
> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >
> > Binary Compatibility:
> > Binary compatibility at the Java API layer with earlier versions (0.98.x,
> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> > code and any server side code (coprocessors, filters etc) referring to
> > hbase jars.
> >
> > Upgrading
> > ---------
> > See [4] for upgrade instructions and extended discussion on the changes.
> >
> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > fashion
> > is supported.
> >
> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> > of
> > the cluster.
> >
> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > metadata.
> > See [5] for details.
> >
> >
> > Supported Hadoop versions
> > -------------------------
> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > releases
> > are the most tested hadoop releases and we recommend running with those
> > versions
> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > 2.3.x)
> > are not tested to the full extend. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#hadoop
> >
> >
> > Supported Java versions
> > -------------------------
> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> > is experimental. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#java
> >
> >
> > Voting
> > ------
> > Please try to test and vote on this release by Feb 11 2015 11:59PM PDT.
> > Due to the importance of 1.0 release we will have a 10 day voting period
> > to cover sufficient testing. Please notify here if you need more time to
> > test the RC.
> >
> > [] +1 Release the artifacts as 1.0.0
> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >
> > Gratitute
> > ---------
> > Last but not least, 1.0.0 release has been in a long time making with
> > contributions from a very large group of awesome people and hard work
> from
> > committers and contributors. We would like to extend our thanks to
> > everybody
> > who worked on this release or contributed to HBase over the years.
> >
> >
> > References
> > ----------
> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > [3] http://s.apache.org/hbase-1.0-api
> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >
> > Enis
> >
>
Re: [VOTE] Fourth release candidate for HBase 1.0.0 (RC3) is
available. Please vote by Feb 11 2015
Posted by Enis Söztutar <en...@apache.org>.
To get the ball rolling, here are the tests that I have done so far. No
official +1 yet, since I will spend some more time on this.
- checked checksums, sigs
- checked the bin and src artifacts
- checked layouts
- checked java files in src tarball, and jar files in bin tarball
- checked the book and the site (they are new style)
- checked javadocs for both devapi and userapi
- checked reported version, build time, revision
- run some smoke tests using shell
- started local mode
- run LTT local mode
- checked the webUI in local mode
- checked JMX dump and debug dump
I had run most of the ITs on the other RC's, but I'll repeat them for this
and report here when done.
Happy testing,
Enis
On Sun, Feb 1, 2015 at 6:38 PM, Enis Söztutar <en...@apache.org> wrote:
> It gives me great pleasure to announce that the fourth release candidate
> for the release
> 1.0.0 (HBase-1.0.0RC3), is available for download at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC3/
>
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1061
>
> Signed with my code signing key E964B5FF. Can be found here:
> https://people.apache.org/keys/committer/enis.asc
>
> Signed tag in the repository can be found here:
>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=46d9c29d83b535781e8fa8a044c12ee990a002c3
>
> HBase 1.0.0 is the next stable release, and the start of "semantic
> versioned"
> releases (See [1]).
>
> The theme of 1.0.0 release is to become a stable base for future 1.x series
> of releases. We aim to achieve at least the same level of stability of 0.98
> releases.
>
> 1.0.0 release contains 167 fixes on top of 0.99.2 release. Together with
> the
> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> limited to)
> below. Note that all previous 0.99.x releases are developer preview
> releases, and will
> NOT be supported in any form.
>
> API Cleanup and changes
> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> client side APIs (HTableInterface, HTable and HBaseAdmin).
> We advise to update your application to use the new style of APIs, since
> deprecated APIs might be removed in future releases (2.x). See [2] and
> [3]
> for an overview of changes. All Client side API's are marked with
> InterfaceAudience.Public class, indicating that the class/method is an
> official "client API" for HBase. All 1.x releases are planned to be API
> compatible for these classes. See [1] for an overview.
>
> Master runs a Region Server as well
> Starting with 1.0.0, the HBase master server and backup master servers
> will
> also act as a region server. RPC port and info port for web UI is shared
> for
> the master and region server roles. Active master can host regions of
> defined tables if configured (disabled by default). Backup masters will
> not
> host regions.
>
> Read availability using timeline consistent region replicas
> This release contains Phase 1 items for experimental "Read availability
> using
> timeline consistent region replicas" feature. A region can be hosted in
> multiple region servers in read-only mode. One of the replicas for the
> region
> will be primary, accepting writes, and other replicas will be sharing
> the same
> data files. Read requests can be done against any replica for the region
> with
> backup RPCs for high availability with timeline consistency guarantees.
> More
> information can be found at HBASE-10070.
>
> Online config change and other forward ports from 0.89-fb branch
> HBASE-12147 forward ported online config change which enables some of the
> configuration from the server to be reloaded without restarting the
> region
> servers.
>
> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> - A new web skin in time for 1.0 (http://hbase.apache.org)
> - Automatic tuning of global memstore and block cache sizes
> - Various security, tags and visibility labels improvements
> - Bucket cache improvements (usability and compressed data blocks)
> - A new pluggable replication endpoint to plug in to HBase's inter-cluster
> replication to replicate to a custom data store
> - A Dockerfile to easily build and run HBase from source
> - Truncate table command
> - Region assignment to use hbase:meta table instead of zookeeper for
> faster
> region assignment (disabled by default)
> - Extensive documentation improvements
> - [HBASE-12511] - namespace permissions - add support from table creation
> privilege in a namespace 'C'
> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> configuration capability' to branch-1
> - [HBASE-10560] - Per cell TTLs
> - [HBASE-11997] - CopyTable with bulkload
> - [HBASE-11990] - Make setting the start and stop row for a specific
> prefix easier
> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> - [HBASE-12032] - Script to stop regionservers via RPC
> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> in RegexStringComparator
> - [HBASE-11796] - Add client support for atomic checkAndMutate
> - [HBASE-11804] - Raise default heap size if unspecified
> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> - [HBASE-12126] - Region server coprocessor endpoint
> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> - [HBASE-12075] - Preemptive Fast Fail
> - [HBASE-12354] - Update dependencies in time for 1.0 release
> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> - [HBASE-12434] - Add a command to compact all the regions in a
> regionserver
> - [HBASE-8707] - Add LongComparator for filter
> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
> changes
> - [HBASE-12361] - Show data locality of region in table page
> - [HBASE-12496] - A blockedRequestsCount metric
> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> to branch-1
> - [HBASE-12731] - Heap occupancy based client pushback
> - [HBASE-12728] - buffered writes substantially less useful after removal
> of HTablePool
> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> - Various fixes to REST server
> - Internal refactoring for abstracting away zookeeper usage
> - Better support for Cell interface internally in read and write paths for
> better performance and flexibility
> - Combining internal mvcc and seqId infrastructure
> - Ring buffer based WAL improvements
> - Switch to using new style of client APIs internally (in a lot of places)
> - Improvements in visibility labels
> - Perf improvements
> - Numerous improvements in other areas and bug fixes.
>
> 1.0.0 release has these changes in default behavior (see [4])
> - Zookeeper 3.4.x is required
> - Hadoop-2.x is required
> - JDK-1.7 is required
> - Default ports have changed from 600XX range into out of ephemeral 160XX
> range.
> - Hfile version 3 has been enabled by default.
> - Slab cache has been removed (use bucket cache instead)
> - Default heap for region servers (and master) is changed from 1GB to
> the jdk's default. On most platforms, it will default to 1/4 of physical
> memory
> - Some client facing APIs (HTableInterface, etc) has been deprecated and
> replaced.
> - Custom Filter implementations should switch to using the new
> recommended APIs.
> - Some authorization permissions (especially regarding namespaces) have
> been
> changed (HBASE-12511, HBASE-8015)
> - Mapred package and classes under there has been un-deprecated.
> - Two new modules (jar files): hbase-annotations and hbase-rest.
> - HTrace dependency is moved to the Apache artifacts (
> https://htrace.incubator.apache.org/)
> - Various updates to dependency versions
>
> Full list of the issues can be found at:
> - 1.0.0 issues :
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> - 0.99.2 issues :
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> - 0.99.1 issues :
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> - 0.99.0 issues :
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>
> Compatibility
> -------------
> Source Compatibility:
> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
> versions. Some minor API changes might be needed from the client side.
>
>
> Wire Compatibility:
> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> servers running in different versions as long as new features are not used
> should be possible.
> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
> introduces a new file format (hfile v3) that is enabled by default that
> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
> is
> not supported.
> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>
> Binary Compatibility:
> Binary compatibility at the Java API layer with earlier versions (0.98.x,
> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
> code and any server side code (coprocessors, filters etc) referring to
> hbase jars.
>
> Upgrading
> ---------
> See [4] for upgrade instructions and extended discussion on the changes.
>
> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> fashion
> is supported.
>
> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
> of
> the cluster.
>
> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> metadata.
> See [5] for details.
>
>
> Supported Hadoop versions
> -------------------------
> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> releases
> are the most tested hadoop releases and we recommend running with those
> versions
> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> 2.3.x)
> are not tested to the full extend. More information can be found here:
> https://hbase.apache.org/book/configuration.html#hadoop
>
>
> Supported Java versions
> -------------------------
> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
> is experimental. More information can be found here:
> https://hbase.apache.org/book/configuration.html#java
>
>
> Voting
> ------
> Please try to test and vote on this release by Feb 11 2015 11:59PM PDT.
> Due to the importance of 1.0 release we will have a 10 day voting period
> to cover sufficient testing. Please notify here if you need more time to
> test the RC.
>
> [] +1 Release the artifacts as 1.0.0
> [] -1 DO NOT release the artifacts as 1.0.0, because...
>
> Gratitute
> ---------
> Last but not least, 1.0.0 release has been in a long time making with
> contributions from a very large group of awesome people and hard work from
> committers and contributors. We would like to extend our thanks to
> everybody
> who worked on this release or contributed to HBase over the years.
>
>
> References
> ----------
> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> [3] http://s.apache.org/hbase-1.0-api
> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>
> Enis
>