You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Enis Söztutar <en...@apache.org> on 2015/02/15 06:55:49 UTC
[VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is available.
Please vote by Feb 19 2015
It gives me great pleasure to announce that the sixth release candidate for
the release
1.0.0 (HBase-1.0.0RC5), is available for download at
https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
Maven artifacts are also available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1065
Signed with my code signing key E964B5FF. Can be found here:
https://people.apache.org/keys/committer/enis.asc
Signed tag in the repository can be found here:
https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
HBase 1.0.0 is the next stable release, and the start of "semantic
versioned"
releases (See [1]).
The theme of 1.0.0 release is to become a stable base for future 1.x series
of releases. We aim to achieve at least the same level of stability of 0.98
releases.
1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with the
previous 0.99.x releases, major changes in 1.0.0 are listed (but not
limited to)
below. Note that all previous 0.99.x releases are developer preview
releases, and will
NOT be supported in any form.
API Cleanup and changes
1.0.0 introduces new APIs, and deprecates some of commonly-used
client side APIs (HTableInterface, HTable and HBaseAdmin).
We advise to update your application to use the new style of APIs, since
deprecated APIs might be removed in future releases (2.x). See [2] and [3]
for an overview of changes. All Client side API's are marked with
InterfaceAudience.Public class, indicating that the class/method is an
official "client API" for HBase. All 1.x releases are planned to be API
compatible for these classes. See [1] for an overview.
Master runs a Region Server as well
Starting with 1.0.0, the HBase master server and backup master servers
will
also act as a region server. RPC port and info port for web UI is shared
for
the master and region server roles. Active master can host regions of
defined tables if configured (disabled by default). Backup masters will
not
host regions.
Read availability using timeline consistent region replicas
This release contains Phase 1 items for experimental "Read availability
using
timeline consistent region replicas" feature. A region can be hosted in
multiple region servers in read-only mode. One of the replicas for the
region
will be primary, accepting writes, and other replicas will be sharing the
same
data files. Read requests can be done against any replica for the region
with
backup RPCs for high availability with timeline consistency guarantees.
More
information can be found at HBASE-10070.
Online config change and other forward ports from 0.89-fb branch
HBASE-12147 forward ported online config change which enables some of the
configuration from the server to be reloaded without restarting the region
servers.
Other notable improvements in 1.0.0 (including previous 0.99.x) are
- A new web skin in time for 1.0 (http://hbase.apache.org)
- Automatic tuning of global memstore and block cache sizes
- Various security, tags and visibility labels improvements
- Bucket cache improvements (usability and compressed data blocks)
- A new pluggable replication endpoint to plug in to HBase's inter-cluster
replication to replicate to a custom data store
- A Dockerfile to easily build and run HBase from source
- Truncate table command
- Region assignment to use hbase:meta table instead of zookeeper for faster
region assignment (disabled by default)
- Extensive documentation improvements
- [HBASE-12511] - namespace permissions - add support from table creation
privilege in a namespace 'C'
- [HBASE-12568] - Adopt Semantic Versioning and document it in the book
- [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
- [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
configuration capability' to branch-1
- [HBASE-10560] - Per cell TTLs
- [HBASE-11997] - CopyTable with bulkload
- [HBASE-11990] - Make setting the start and stop row for a specific
prefix easier
- [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
- [HBASE-12090] - Bytes: more Unsafe, more Faster
- [HBASE-12032] - Script to stop regionservers via RPC
- [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
in RegexStringComparator
- [HBASE-11796] - Add client support for atomic checkAndMutate
- [HBASE-11804] - Raise default heap size if unspecified
- [HBASE-11890] - HBase REST Client is hard coded to http protocol
- [HBASE-12126] - Region server coprocessor endpoint
- [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
- [HBASE-12075] - Preemptive Fast Fail
- [HBASE-12354] - Update dependencies in time for 1.0 release
- [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
- [HBASE-12434] - Add a command to compact all the regions in a
regionserver
- [HBASE-8707] - Add LongComparator for filter
- [HBASE-12286] - [shell] Add server/cluster online load of configuration
changes
- [HBASE-12361] - Show data locality of region in table page
- [HBASE-12496] - A blockedRequestsCount metric
- [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
branch-1
- [HBASE-12731] - Heap occupancy based client pushback
- [HBASE-12728] - buffered writes substantially less useful after removal
of HTablePool
- [HBASE-5699] - Run with > 1 WAL in HRegionServer
- Various fixes to REST server
- Internal refactoring for abstracting away zookeeper usage
- Better support for Cell interface internally in read and write paths for
better performance and flexibility
- Combining internal mvcc and seqId infrastructure
- Ring buffer based WAL improvements
- Switch to using new style of client APIs internally (in a lot of places)
- Improvements in visibility labels
- Perf improvements
- Numerous improvements in other areas and bug fixes.
1.0.0 release has these changes in default behavior (see [4])
- Zookeeper 3.4.x is required
- Hadoop-2.x is required
- JDK-1.7 is required
- Default ports have changed from 600XX range into out of ephemeral 160XX
range.
- Hfile version 3 has been enabled by default.
- Slab cache has been removed (use bucket cache instead)
- Default heap for region servers (and master) is changed from 1GB to
the jdk's default. On most platforms, it will default to 1/4 of physical
memory
- Some client facing APIs (HTableInterface, etc) has been deprecated and
replaced.
- Custom Filter implementations should switch to using the new recommended
APIs.
- Some authorization permissions (especially regarding namespaces) have
been
changed (HBASE-12511, HBASE-8015)
- Mapred package and classes under there has been un-deprecated.
- Two new modules (jar files): hbase-annotations and hbase-rest.
- HTrace dependency is moved to the Apache artifacts (
https://htrace.incubator.apache.org/)
- Various updates to dependency versions
Full list of the issues can be found at:
- 1.0.0 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
- 0.99.2 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
- 0.99.1 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
- 0.99.0 issues :
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
Compatibility
-------------
Source Compatibility:
Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
versions. Some minor API changes might be needed from the client side.
Wire Compatibility:
HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
servers running in different versions as long as new features are not used
should be possible.
A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
introduces a new file format (hfile v3) that is enabled by default that
0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
is
not supported.
1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
Binary Compatibility:
Binary compatibility at the Java API layer with earlier versions (0.98.x,
0.96.x and 0.94.x) is not supported. You may have to recompile your client
code and any server side code (coprocessors, filters etc) referring to
hbase jars.
Upgrading
---------
See [4] for upgrade instructions and extended discussion on the changes.
>From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
fashion
is supported.
>From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
of
the cluster.
>From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
metadata.
See [5] for details.
Supported Hadoop versions
-------------------------
1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x releases
are the most tested hadoop releases and we recommend running with those
versions
(or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
2.3.x)
are not tested to the full extend. More information can be found here:
https://hbase.apache.org/book/configuration.html#hadoop
Supported Java versions
-------------------------
1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
is experimental. More information can be found here:
https://hbase.apache.org/book/configuration.html#java
Voting
------
Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
We will have a 5 day voting period because this is the sixth RC. Please try
to
spend some time for testing this important release.
[] +1 Release the artifacts as 1.0.0
[] -1 DO NOT release the artifacts as 1.0.0, because...
Gratitute
---------
Last but not least, 1.0.0 release has been in a long time making with
contributions from a very large group of awesome people and hard work from
committers and contributors. We would like to extend our thanks to everybody
who worked on this release or contributed to HBase over the years.
References
----------
[1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
[2] http://www.slideshare.net/xefyr/apache-hbase-10-release
[3] http://s.apache.org/hbase-1.0-api
[4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
[5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
Enis
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Elliott Clark <ec...@apache.org>.
+1
Checked signature
Checked source and binary tars
All unit tests passed on JDK 7
ITBLL worked and passed.
On Fri, Feb 20, 2015 at 4:22 PM, Andrew Purtell <ap...@apache.org> wrote:
> +1
>
> - Checked sums and signature
> - Source and binary tarball layouts look ok
> - Spot checked docs
> - Built from source
> - All unit tests pass (7u75)
> - Most integration tests pass in the verification phase of hbase-it (I
> failed to pass -DskipITs to the build),
> except IntegrationTestIngestWithACL, which needs external configuration
> anyway, and IntegrationTestLazyCfLoading, not enough to sink the RC
> - Ran all-localhost LTT with 1M keys, no unusual messages in the logs
>
>
> On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
>
> > It gives me great pleasure to announce that the sixth release candidate
> for
> > the release
> > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1065
> >
> > Signed with my code signing key E964B5FF. Can be found here:
> > https://people.apache.org/keys/committer/enis.asc
> >
> > Signed tag in the repository can be found here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >
> > HBase 1.0.0 is the next stable release, and the start of "semantic
> > versioned"
> > releases (See [1]).
> >
> > The theme of 1.0.0 release is to become a stable base for future 1.x
> series
> > of releases. We aim to achieve at least the same level of stability of
> 0.98
> > releases.
> >
> > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> > the
> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > limited to)
> > below. Note that all previous 0.99.x releases are developer preview
> > releases, and will
> > NOT be supported in any form.
> >
> > API Cleanup and changes
> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > We advise to update your application to use the new style of APIs,
> since
> > deprecated APIs might be removed in future releases (2.x). See [2] and
> > [3]
> > for an overview of changes. All Client side API's are marked with
> > InterfaceAudience.Public class, indicating that the class/method is an
> > official "client API" for HBase. All 1.x releases are planned to be API
> > compatible for these classes. See [1] for an overview.
> >
> > Master runs a Region Server as well
> > Starting with 1.0.0, the HBase master server and backup master servers
> > will
> > also act as a region server. RPC port and info port for web UI is
> shared
> > for
> > the master and region server roles. Active master can host regions of
> > defined tables if configured (disabled by default). Backup masters will
> > not
> > host regions.
> >
> > Read availability using timeline consistent region replicas
> > This release contains Phase 1 items for experimental "Read availability
> > using
> > timeline consistent region replicas" feature. A region can be hosted in
> > multiple region servers in read-only mode. One of the replicas for the
> > region
> > will be primary, accepting writes, and other replicas will be sharing
> the
> > same
> > data files. Read requests can be done against any replica for the
> region
> > with
> > backup RPCs for high availability with timeline consistency guarantees.
> > More
> > information can be found at HBASE-10070.
> >
> > Online config change and other forward ports from 0.89-fb branch
> > HBASE-12147 forward ported online config change which enables some of
> the
> > configuration from the server to be reloaded without restarting the
> > region
> > servers.
> >
> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > - Automatic tuning of global memstore and block cache sizes
> > - Various security, tags and visibility labels improvements
> > - Bucket cache improvements (usability and compressed data blocks)
> > - A new pluggable replication endpoint to plug in to HBase's
> inter-cluster
> > replication to replicate to a custom data store
> > - A Dockerfile to easily build and run HBase from source
> > - Truncate table command
> > - Region assignment to use hbase:meta table instead of zookeeper for
> > faster
> > region assignment (disabled by default)
> > - Extensive documentation improvements
> > - [HBASE-12511] - namespace permissions - add support from table
> creation
> > privilege in a namespace 'C'
> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> Server
> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> > configuration capability' to branch-1
> > - [HBASE-10560] - Per cell TTLs
> > - [HBASE-11997] - CopyTable with bulkload
> > - [HBASE-11990] - Make setting the start and stop row for a specific
> > prefix easier
> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > - [HBASE-12032] - Script to stop regionservers via RPC
> > - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> > in RegexStringComparator
> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > - [HBASE-11804] - Raise default heap size if unspecified
> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > - [HBASE-12126] - Region server coprocessor endpoint
> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > - [HBASE-12075] - Preemptive Fast Fail
> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> > - [HBASE-12434] - Add a command to compact all the regions in a
> > regionserver
> > - [HBASE-8707] - Add LongComparator for filter
> > - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> > changes
> > - [HBASE-12361] - Show data locality of region in table page
> > - [HBASE-12496] - A blockedRequestsCount metric
> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> to
> > branch-1
> > - [HBASE-12731] - Heap occupancy based client pushback
> > - [HBASE-12728] - buffered writes substantially less useful after
> removal
> > of HTablePool
> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > - Various fixes to REST server
> > - Internal refactoring for abstracting away zookeeper usage
> > - Better support for Cell interface internally in read and write paths
> for
> > better performance and flexibility
> > - Combining internal mvcc and seqId infrastructure
> > - Ring buffer based WAL improvements
> > - Switch to using new style of client APIs internally (in a lot of
> places)
> > - Improvements in visibility labels
> > - Perf improvements
> > - Numerous improvements in other areas and bug fixes.
> >
> > 1.0.0 release has these changes in default behavior (see [4])
> > - Zookeeper 3.4.x is required
> > - Hadoop-2.x is required
> > - JDK-1.7 is required
> > - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> > range.
> > - Hfile version 3 has been enabled by default.
> > - Slab cache has been removed (use bucket cache instead)
> > - Default heap for region servers (and master) is changed from 1GB to
> > the jdk's default. On most platforms, it will default to 1/4 of
> physical
> > memory
> > - Some client facing APIs (HTableInterface, etc) has been deprecated and
> > replaced.
> > - Custom Filter implementations should switch to using the new
> recommended
> > APIs.
> > - Some authorization permissions (especially regarding namespaces) have
> > been
> > changed (HBASE-12511, HBASE-8015)
> > - Mapred package and classes under there has been un-deprecated.
> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > - HTrace dependency is moved to the Apache artifacts (
> > https://htrace.incubator.apache.org/)
> > - Various updates to dependency versions
> >
> > Full list of the issues can be found at:
> > - 1.0.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > - 0.99.2 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > - 0.99.1 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > - 0.99.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >
> > Compatibility
> > -------------
> > Source Compatibility:
> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> > versions. Some minor API changes might be needed from the client side.
> >
> >
> > Wire Compatibility:
> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> > servers running in different versions as long as new features are not
> used
> > should be possible.
> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> 1.0.0
> > introduces a new file format (hfile v3) that is enabled by default that
> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> > is
> > not supported.
> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >
> > Binary Compatibility:
> > Binary compatibility at the Java API layer with earlier versions (0.98.x,
> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> > code and any server side code (coprocessors, filters etc) referring to
> > hbase jars.
> >
> > Upgrading
> > ---------
> > See [4] for upgrade instructions and extended discussion on the changes.
> >
> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > fashion
> > is supported.
> >
> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> > of
> > the cluster.
> >
> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > metadata.
> > See [5] for details.
> >
> >
> > Supported Hadoop versions
> > -------------------------
> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > releases
> > are the most tested hadoop releases and we recommend running with those
> > versions
> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > 2.3.x)
> > are not tested to the full extend. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#hadoop
> >
> >
> > Supported Java versions
> > -------------------------
> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> > is experimental. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#java
> >
> >
> > Voting
> > ------
> > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > We will have a 5 day voting period because this is the sixth RC. Please
> try
> > to
> > spend some time for testing this important release.
> >
> > [] +1 Release the artifacts as 1.0.0
> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >
> > Gratitute
> > ---------
> > Last but not least, 1.0.0 release has been in a long time making with
> > contributions from a very large group of awesome people and hard work
> from
> > committers and contributors. We would like to extend our thanks to
> > everybody
> > who worked on this release or contributed to HBase over the years.
> >
> >
> > References
> > ----------
> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > [3] http://s.apache.org/hbase-1.0-api
> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >
> > Enis
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Andrew Purtell <ap...@apache.org>.
+1
- Checked sums and signature
- Source and binary tarball layouts look ok
- Spot checked docs
- Built from source
- All unit tests pass (7u75)
- Most integration tests pass in the verification phase of hbase-it (I
failed to pass -DskipITs to the build),
except IntegrationTestIngestWithACL, which needs external configuration
anyway, and IntegrationTestLazyCfLoading, not enough to sink the RC
- Ran all-localhost LTT with 1M keys, no unusual messages in the logs
On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
> It gives me great pleasure to announce that the sixth release candidate for
> the release
> 1.0.0 (HBase-1.0.0RC5), is available for download at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1065
>
> Signed with my code signing key E964B5FF. Can be found here:
> https://people.apache.org/keys/committer/enis.asc
>
> Signed tag in the repository can be found here:
>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
>
> HBase 1.0.0 is the next stable release, and the start of "semantic
> versioned"
> releases (See [1]).
>
> The theme of 1.0.0 release is to become a stable base for future 1.x series
> of releases. We aim to achieve at least the same level of stability of 0.98
> releases.
>
> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> the
> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> limited to)
> below. Note that all previous 0.99.x releases are developer preview
> releases, and will
> NOT be supported in any form.
>
> API Cleanup and changes
> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> client side APIs (HTableInterface, HTable and HBaseAdmin).
> We advise to update your application to use the new style of APIs, since
> deprecated APIs might be removed in future releases (2.x). See [2] and
> [3]
> for an overview of changes. All Client side API's are marked with
> InterfaceAudience.Public class, indicating that the class/method is an
> official "client API" for HBase. All 1.x releases are planned to be API
> compatible for these classes. See [1] for an overview.
>
> Master runs a Region Server as well
> Starting with 1.0.0, the HBase master server and backup master servers
> will
> also act as a region server. RPC port and info port for web UI is shared
> for
> the master and region server roles. Active master can host regions of
> defined tables if configured (disabled by default). Backup masters will
> not
> host regions.
>
> Read availability using timeline consistent region replicas
> This release contains Phase 1 items for experimental "Read availability
> using
> timeline consistent region replicas" feature. A region can be hosted in
> multiple region servers in read-only mode. One of the replicas for the
> region
> will be primary, accepting writes, and other replicas will be sharing the
> same
> data files. Read requests can be done against any replica for the region
> with
> backup RPCs for high availability with timeline consistency guarantees.
> More
> information can be found at HBASE-10070.
>
> Online config change and other forward ports from 0.89-fb branch
> HBASE-12147 forward ported online config change which enables some of the
> configuration from the server to be reloaded without restarting the
> region
> servers.
>
> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> - A new web skin in time for 1.0 (http://hbase.apache.org)
> - Automatic tuning of global memstore and block cache sizes
> - Various security, tags and visibility labels improvements
> - Bucket cache improvements (usability and compressed data blocks)
> - A new pluggable replication endpoint to plug in to HBase's inter-cluster
> replication to replicate to a custom data store
> - A Dockerfile to easily build and run HBase from source
> - Truncate table command
> - Region assignment to use hbase:meta table instead of zookeeper for
> faster
> region assignment (disabled by default)
> - Extensive documentation improvements
> - [HBASE-12511] - namespace permissions - add support from table creation
> privilege in a namespace 'C'
> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> configuration capability' to branch-1
> - [HBASE-10560] - Per cell TTLs
> - [HBASE-11997] - CopyTable with bulkload
> - [HBASE-11990] - Make setting the start and stop row for a specific
> prefix easier
> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> - [HBASE-12032] - Script to stop regionservers via RPC
> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> in RegexStringComparator
> - [HBASE-11796] - Add client support for atomic checkAndMutate
> - [HBASE-11804] - Raise default heap size if unspecified
> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> - [HBASE-12126] - Region server coprocessor endpoint
> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> - [HBASE-12075] - Preemptive Fast Fail
> - [HBASE-12354] - Update dependencies in time for 1.0 release
> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> - [HBASE-12434] - Add a command to compact all the regions in a
> regionserver
> - [HBASE-8707] - Add LongComparator for filter
> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
> changes
> - [HBASE-12361] - Show data locality of region in table page
> - [HBASE-12496] - A blockedRequestsCount metric
> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
> branch-1
> - [HBASE-12731] - Heap occupancy based client pushback
> - [HBASE-12728] - buffered writes substantially less useful after removal
> of HTablePool
> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> - Various fixes to REST server
> - Internal refactoring for abstracting away zookeeper usage
> - Better support for Cell interface internally in read and write paths for
> better performance and flexibility
> - Combining internal mvcc and seqId infrastructure
> - Ring buffer based WAL improvements
> - Switch to using new style of client APIs internally (in a lot of places)
> - Improvements in visibility labels
> - Perf improvements
> - Numerous improvements in other areas and bug fixes.
>
> 1.0.0 release has these changes in default behavior (see [4])
> - Zookeeper 3.4.x is required
> - Hadoop-2.x is required
> - JDK-1.7 is required
> - Default ports have changed from 600XX range into out of ephemeral 160XX
> range.
> - Hfile version 3 has been enabled by default.
> - Slab cache has been removed (use bucket cache instead)
> - Default heap for region servers (and master) is changed from 1GB to
> the jdk's default. On most platforms, it will default to 1/4 of physical
> memory
> - Some client facing APIs (HTableInterface, etc) has been deprecated and
> replaced.
> - Custom Filter implementations should switch to using the new recommended
> APIs.
> - Some authorization permissions (especially regarding namespaces) have
> been
> changed (HBASE-12511, HBASE-8015)
> - Mapred package and classes under there has been un-deprecated.
> - Two new modules (jar files): hbase-annotations and hbase-rest.
> - HTrace dependency is moved to the Apache artifacts (
> https://htrace.incubator.apache.org/)
> - Various updates to dependency versions
>
> Full list of the issues can be found at:
> - 1.0.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> - 0.99.2 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> - 0.99.1 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> - 0.99.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>
> Compatibility
> -------------
> Source Compatibility:
> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
> versions. Some minor API changes might be needed from the client side.
>
>
> Wire Compatibility:
> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> servers running in different versions as long as new features are not used
> should be possible.
> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
> introduces a new file format (hfile v3) that is enabled by default that
> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
> is
> not supported.
> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>
> Binary Compatibility:
> Binary compatibility at the Java API layer with earlier versions (0.98.x,
> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
> code and any server side code (coprocessors, filters etc) referring to
> hbase jars.
>
> Upgrading
> ---------
> See [4] for upgrade instructions and extended discussion on the changes.
>
> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> fashion
> is supported.
>
> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
> of
> the cluster.
>
> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> metadata.
> See [5] for details.
>
>
> Supported Hadoop versions
> -------------------------
> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> releases
> are the most tested hadoop releases and we recommend running with those
> versions
> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> 2.3.x)
> are not tested to the full extend. More information can be found here:
> https://hbase.apache.org/book/configuration.html#hadoop
>
>
> Supported Java versions
> -------------------------
> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
> is experimental. More information can be found here:
> https://hbase.apache.org/book/configuration.html#java
>
>
> Voting
> ------
> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> We will have a 5 day voting period because this is the sixth RC. Please try
> to
> spend some time for testing this important release.
>
> [] +1 Release the artifacts as 1.0.0
> [] -1 DO NOT release the artifacts as 1.0.0, because...
>
> Gratitute
> ---------
> Last but not least, 1.0.0 release has been in a long time making with
> contributions from a very large group of awesome people and hard work from
> committers and contributors. We would like to extend our thanks to
> everybody
> who worked on this release or contributed to HBase over the years.
>
>
> References
> ----------
> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> [3] http://s.apache.org/hbase-1.0-api
> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>
> Enis
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
No, 1,0.0 to 1.0.0 ;) Installed 1.0.0, changed a config in a hbase-site.xml
and did a rolling restart to have it taken into consideration.
I still have migration from 0.94 to 1.0.0 to test, and rolling restart from
0.9x to 1.0.0... And of course, the performances...
JM
2015-02-16 10:40 GMT-05:00 Ted Yu <yu...@gmail.com>:
> bq. Did a rolling restart from 1.0.0 to 1.0.0
>
> Did you mean from 0.98 to 1.0.0 ?
>
> Cheers
>
> On Mon, Feb 16, 2015 at 7:37 AM, Jean-Marc Spaggiari <
> jean-marc@spaggiari.org> wrote:
>
> > Download and un-packed passed.
> >
> > Checked Changes.txt => Passed.
> > Checked documentation => Link "Why does HBase care about /etc/hosts?
> > <http://devving.com/?p=414>" in section "Quick Start - Standalone HBase"
> > doesn't work
> > Run test suite => Failed 3 time in a row with JDK 1.7
> > Failed tests:
> > TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
> > expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
> >
> >
> TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
> > expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
> >
> >
> TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
> > expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
> >
> > Tried with JDK8 and got a lot of:
> > Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> > MaxPermSize=256m; support was removed in 8.0
> > And the same errors + some others, ran it twice, twice the same errors.
> > Same as with JDK1.7 + the SSL one.
> > Failed tests:
> > TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
> > expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
> >
> >
> TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
> > expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
> >
> >
> TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
> > expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
> >
> > Tests in error:
> >
> >
> org.apache.hadoop.hbase.http.TestSSLHttpServer.org.apache.hadoop.hbase.http.TestSSLHttpServer
> > Run 1: TestSSLHttpServer.setup:71 » Certificate Subject class type
> > invalid.
> > Run 2: TestSSLHttpServer.cleanup:102 NullPointer
> >
> >
> >
> > Checked RAT => Passed
> >
> > While running in standalone got this exception in the logs when clicking
> on
> > Debug Dump in the master interface:
> > 2015-02-16 10:19:39,172 ERROR [666059465@qtp-2106900153-3] mortbay.log:
> > /dump
> > java.lang.NullPointerException
> > at
> >
> >
> org.apache.hadoop.hbase.regionserver.RSDumpServlet.dumpQueue(RSDumpServlet.java:106)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterDumpServlet.doGet(MasterDumpServlet.java:105)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> > at
> > org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
> > at
> >
> >
> org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:113)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> >
> >
> org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1351)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> >
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> >
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
> > at
> >
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> > at
> > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> > at
> > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
> > at
> > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
> > at
> >
> >
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
> > at
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > at org.mortbay.jetty.Server.handle(Server.java:326)
> > at
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> > at
> >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
> > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
> > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> > at
> >
> >
> org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
> > at
> >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> >
> > Ran some create table, puts, alter, get, scans from command line =>
> Passed.
> >
> > I'm also running PE on another cluster, but I'm not happy with the way it
> > runs. Not related to HBase, more related to PE itself. Might move to
> YCSB
> > or open some JIRAs.
> >
> > Did a rolling restart from 1.0.0 to 1.0.0. => Passed.
> >
> > Overall, all seems to be working fine, but not sure about the tests
> > failures and the dump exception.
> >
> > 0 for me. Because of the SSL issue with JDK 8 I'm not sure of the impact
> on
> > a secured cluster. Also, has not been able to get any successful run of
> the
> > tests and I have not been able to validate the performances.
> >
> > JM
> >
> > 2015-02-16 8:00 GMT-05:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> >
> > > Hi Enis,
> > >
> > > Quick question, how do you validate the signature? Seems to be a
> > > compressed format, not sure if there is a specific command to validate
> > it.
> > >
> > > Thanks,
> > >
> > > JM
> > >
> > > 2015-02-15 0:55 GMT-05:00 Enis Söztutar <en...@apache.org>:
> > >
> > > It gives me great pleasure to announce that the sixth release candidate
> > for
> > >> the release
> > >> 1.0.0 (HBase-1.0.0RC5), is available for download at
> > >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > >>
> > >> Maven artifacts are also available in the temporary repository
> > >>
> https://repository.apache.org/content/repositories/orgapachehbase-1065
> > >>
> > >> Signed with my code signing key E964B5FF. Can be found here:
> > >> https://people.apache.org/keys/committer/enis.asc
> > >>
> > >> Signed tag in the repository can be found here:
> > >>
> > >>
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > >>
> > >> HBase 1.0.0 is the next stable release, and the start of "semantic
> > >> versioned"
> > >> releases (See [1]).
> > >>
> > >> The theme of 1.0.0 release is to become a stable base for future 1.x
> > >> series
> > >> of releases. We aim to achieve at least the same level of stability of
> > >> 0.98
> > >> releases.
> > >>
> > >> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together
> with
> > >> the
> > >> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > >> limited to)
> > >> below. Note that all previous 0.99.x releases are developer preview
> > >> releases, and will
> > >> NOT be supported in any form.
> > >>
> > >> API Cleanup and changes
> > >> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > >> client side APIs (HTableInterface, HTable and HBaseAdmin).
> > >> We advise to update your application to use the new style of APIs,
> > since
> > >> deprecated APIs might be removed in future releases (2.x). See [2]
> and
> > >> [3]
> > >> for an overview of changes. All Client side API's are marked with
> > >> InterfaceAudience.Public class, indicating that the class/method is
> an
> > >> official "client API" for HBase. All 1.x releases are planned to be
> > API
> > >> compatible for these classes. See [1] for an overview.
> > >>
> > >> Master runs a Region Server as well
> > >> Starting with 1.0.0, the HBase master server and backup master
> servers
> > >> will
> > >> also act as a region server. RPC port and info port for web UI is
> > shared
> > >> for
> > >> the master and region server roles. Active master can host regions
> of
> > >> defined tables if configured (disabled by default). Backup masters
> > will
> > >> not
> > >> host regions.
> > >>
> > >> Read availability using timeline consistent region replicas
> > >> This release contains Phase 1 items for experimental "Read
> > availability
> > >> using
> > >> timeline consistent region replicas" feature. A region can be hosted
> > in
> > >> multiple region servers in read-only mode. One of the replicas for
> the
> > >> region
> > >> will be primary, accepting writes, and other replicas will be
> sharing
> > >> the
> > >> same
> > >> data files. Read requests can be done against any replica for the
> > region
> > >> with
> > >> backup RPCs for high availability with timeline consistency
> > guarantees.
> > >> More
> > >> information can be found at HBASE-10070.
> > >>
> > >> Online config change and other forward ports from 0.89-fb branch
> > >> HBASE-12147 forward ported online config change which enables some
> of
> > >> the
> > >> configuration from the server to be reloaded without restarting the
> > >> region
> > >> servers.
> > >>
> > >> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > >> - A new web skin in time for 1.0 (http://hbase.apache.org)
> > >> - Automatic tuning of global memstore and block cache sizes
> > >> - Various security, tags and visibility labels improvements
> > >> - Bucket cache improvements (usability and compressed data blocks)
> > >> - A new pluggable replication endpoint to plug in to HBase's
> > >> inter-cluster
> > >> replication to replicate to a custom data store
> > >> - A Dockerfile to easily build and run HBase from source
> > >> - Truncate table command
> > >> - Region assignment to use hbase:meta table instead of zookeeper for
> > >> faster
> > >> region assignment (disabled by default)
> > >> - Extensive documentation improvements
> > >> - [HBASE-12511] - namespace permissions - add support from table
> > creation
> > >> privilege in a namespace 'C'
> > >> - [HBASE-12568] - Adopt Semantic Versioning and document it in the
> book
> > >> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> > >> Server
> > >> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> > online
> > >> configuration capability' to branch-1
> > >> - [HBASE-10560] - Per cell TTLs
> > >> - [HBASE-11997] - CopyTable with bulkload
> > >> - [HBASE-11990] - Make setting the start and stop row for a specific
> > >> prefix easier
> > >> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > >> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > >> - [HBASE-12032] - Script to stop regionservers via RPC
> > >> - [HBASE-11907] - Use the joni byte[] regex engine in place of
> > j.u.regex
> > >> in RegexStringComparator
> > >> - [HBASE-11796] - Add client support for atomic checkAndMutate
> > >> - [HBASE-11804] - Raise default heap size if unspecified
> > >> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > >> - [HBASE-12126] - Region server coprocessor endpoint
> > >> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > >> - [HBASE-12075] - Preemptive Fast Fail
> > >> - [HBASE-12354] - Update dependencies in time for 1.0 release
> > >> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> > MIN_VERSIONS
> > >> - [HBASE-12434] - Add a command to compact all the regions in a
> > >> regionserver
> > >> - [HBASE-8707] - Add LongComparator for filter
> > >> - [HBASE-12286] - [shell] Add server/cluster online load of
> > configuration
> > >> changes
> > >> - [HBASE-12361] - Show data locality of region in table page
> > >> - [HBASE-12496] - A blockedRequestsCount metric
> > >> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> mechanism)
> > >> to
> > >> branch-1
> > >> - [HBASE-12731] - Heap occupancy based client pushback
> > >> - [HBASE-12728] - buffered writes substantially less useful after
> > removal
> > >> of HTablePool
> > >> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > >> - Various fixes to REST server
> > >> - Internal refactoring for abstracting away zookeeper usage
> > >> - Better support for Cell interface internally in read and write
> paths
> > >> for
> > >> better performance and flexibility
> > >> - Combining internal mvcc and seqId infrastructure
> > >> - Ring buffer based WAL improvements
> > >> - Switch to using new style of client APIs internally (in a lot of
> > >> places)
> > >> - Improvements in visibility labels
> > >> - Perf improvements
> > >> - Numerous improvements in other areas and bug fixes.
> > >>
> > >> 1.0.0 release has these changes in default behavior (see [4])
> > >> - Zookeeper 3.4.x is required
> > >> - Hadoop-2.x is required
> > >> - JDK-1.7 is required
> > >> - Default ports have changed from 600XX range into out of ephemeral
> > 160XX
> > >> range.
> > >> - Hfile version 3 has been enabled by default.
> > >> - Slab cache has been removed (use bucket cache instead)
> > >> - Default heap for region servers (and master) is changed from 1GB to
> > >> the jdk's default. On most platforms, it will default to 1/4 of
> > >> physical
> > >> memory
> > >> - Some client facing APIs (HTableInterface, etc) has been deprecated
> > and
> > >> replaced.
> > >> - Custom Filter implementations should switch to using the new
> > >> recommended
> > >> APIs.
> > >> - Some authorization permissions (especially regarding namespaces)
> have
> > >> been
> > >> changed (HBASE-12511, HBASE-8015)
> > >> - Mapred package and classes under there has been un-deprecated.
> > >> - Two new modules (jar files): hbase-annotations and hbase-rest.
> > >> - HTrace dependency is moved to the Apache artifacts (
> > >> https://htrace.incubator.apache.org/)
> > >> - Various updates to dependency versions
> > >>
> > >> Full list of the issues can be found at:
> > >> - 1.0.0 issues :
> > >>
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > >> - 0.99.2 issues :
> > >>
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > >> - 0.99.1 issues :
> > >>
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > >> - 0.99.0 issues :
> > >>
> > >>
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > >>
> > >> Compatibility
> > >> -------------
> > >> Source Compatibility:
> > >> Client side code in HBase-1.0.0 is (mostly) source compatible with
> > earlier
> > >> versions. Some minor API changes might be needed from the client side.
> > >>
> > >>
> > >> Wire Compatibility:
> > >> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients
> and
> > >> servers running in different versions as long as new features are not
> > used
> > >> should be possible.
> > >> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> > >> 1.0.0
> > >> introduces a new file format (hfile v3) that is enabled by default
> that
> > >> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> > 1.0.0
> > >> is
> > >> not supported.
> > >> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > >>
> > >> Binary Compatibility:
> > >> Binary compatibility at the Java API layer with earlier versions
> > (0.98.x,
> > >> 0.96.x and 0.94.x) is not supported. You may have to recompile your
> > client
> > >> code and any server side code (coprocessors, filters etc) referring to
> > >> hbase jars.
> > >>
> > >> Upgrading
> > >> ---------
> > >> See [4] for upgrade instructions and extended discussion on the
> changes.
> > >>
> > >> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling
> upgrade
> > >> fashion
> > >> is supported.
> > >>
> > >> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> > restart
> > >> of
> > >> the cluster.
> > >>
> > >> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > >> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster
> level
> > >> metadata.
> > >> See [5] for details.
> > >>
> > >>
> > >> Supported Hadoop versions
> > >> -------------------------
> > >> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > >> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > >> releases
> > >> are the most tested hadoop releases and we recommend running with
> those
> > >> versions
> > >> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > >> 2.3.x)
> > >> are not tested to the full extend. More information can be found here:
> > >> https://hbase.apache.org/book/configuration.html#hadoop
> > >>
> > >>
> > >> Supported Java versions
> > >> -------------------------
> > >> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> > support
> > >> is experimental. More information can be found here:
> > >> https://hbase.apache.org/book/configuration.html#java
> > >>
> > >>
> > >> Voting
> > >> ------
> > >> Please try to test and vote on this release by Feb 19 2015 11:59PM
> PDT.
> > >> We will have a 5 day voting period because this is the sixth RC.
> Please
> > >> try
> > >> to
> > >> spend some time for testing this important release.
> > >>
> > >> [] +1 Release the artifacts as 1.0.0
> > >> [] -1 DO NOT release the artifacts as 1.0.0, because...
> > >>
> > >> Gratitute
> > >> ---------
> > >> Last but not least, 1.0.0 release has been in a long time making with
> > >> contributions from a very large group of awesome people and hard work
> > from
> > >> committers and contributors. We would like to extend our thanks to
> > >> everybody
> > >> who worked on this release or contributed to HBase over the years.
> > >>
> > >>
> > >> References
> > >> ----------
> > >> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > >> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > >> [3] http://s.apache.org/hbase-1.0-api
> > >> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > >> [5]
> https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > >>
> > >> Enis
> > >>
> > >
> > >
> >
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Ted Yu <yu...@gmail.com>.
bq. Did a rolling restart from 1.0.0 to 1.0.0
Did you mean from 0.98 to 1.0.0 ?
Cheers
On Mon, Feb 16, 2015 at 7:37 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> Download and un-packed passed.
>
> Checked Changes.txt => Passed.
> Checked documentation => Link "Why does HBase care about /etc/hosts?
> <http://devving.com/?p=414>" in section "Quick Start - Standalone HBase"
> doesn't work
> Run test suite => Failed 3 time in a row with JDK 1.7
> Failed tests:
> TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
> expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
> expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
> expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
>
> Tried with JDK8 and got a lot of:
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> And the same errors + some others, ran it twice, twice the same errors.
> Same as with JDK1.7 + the SSL one.
> Failed tests:
> TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
> expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
> expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
> expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
>
> Tests in error:
>
> org.apache.hadoop.hbase.http.TestSSLHttpServer.org.apache.hadoop.hbase.http.TestSSLHttpServer
> Run 1: TestSSLHttpServer.setup:71 » Certificate Subject class type
> invalid.
> Run 2: TestSSLHttpServer.cleanup:102 NullPointer
>
>
>
> Checked RAT => Passed
>
> While running in standalone got this exception in the logs when clicking on
> Debug Dump in the master interface:
> 2015-02-16 10:19:39,172 ERROR [666059465@qtp-2106900153-3] mortbay.log:
> /dump
> java.lang.NullPointerException
> at
>
> org.apache.hadoop.hbase.regionserver.RSDumpServlet.dumpQueue(RSDumpServlet.java:106)
> at
>
> org.apache.hadoop.hbase.master.MasterDumpServlet.doGet(MasterDumpServlet.java:105)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at
> org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
> at
>
> org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:113)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
>
> org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1351)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
> at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
> at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
> at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
> at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> at org.mortbay.jetty.Server.handle(Server.java:326)
> at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> at
>
> org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
> at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>
> Ran some create table, puts, alter, get, scans from command line => Passed.
>
> I'm also running PE on another cluster, but I'm not happy with the way it
> runs. Not related to HBase, more related to PE itself. Might move to YCSB
> or open some JIRAs.
>
> Did a rolling restart from 1.0.0 to 1.0.0. => Passed.
>
> Overall, all seems to be working fine, but not sure about the tests
> failures and the dump exception.
>
> 0 for me. Because of the SSL issue with JDK 8 I'm not sure of the impact on
> a secured cluster. Also, has not been able to get any successful run of the
> tests and I have not been able to validate the performances.
>
> JM
>
> 2015-02-16 8:00 GMT-05:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
>
> > Hi Enis,
> >
> > Quick question, how do you validate the signature? Seems to be a
> > compressed format, not sure if there is a specific command to validate
> it.
> >
> > Thanks,
> >
> > JM
> >
> > 2015-02-15 0:55 GMT-05:00 Enis Söztutar <en...@apache.org>:
> >
> > It gives me great pleasure to announce that the sixth release candidate
> for
> >> the release
> >> 1.0.0 (HBase-1.0.0RC5), is available for download at
> >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >>
> >> Maven artifacts are also available in the temporary repository
> >> https://repository.apache.org/content/repositories/orgapachehbase-1065
> >>
> >> Signed with my code signing key E964B5FF. Can be found here:
> >> https://people.apache.org/keys/committer/enis.asc
> >>
> >> Signed tag in the repository can be found here:
> >>
> >>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >>
> >> HBase 1.0.0 is the next stable release, and the start of "semantic
> >> versioned"
> >> releases (See [1]).
> >>
> >> The theme of 1.0.0 release is to become a stable base for future 1.x
> >> series
> >> of releases. We aim to achieve at least the same level of stability of
> >> 0.98
> >> releases.
> >>
> >> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> >> the
> >> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> >> limited to)
> >> below. Note that all previous 0.99.x releases are developer preview
> >> releases, and will
> >> NOT be supported in any form.
> >>
> >> API Cleanup and changes
> >> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> >> client side APIs (HTableInterface, HTable and HBaseAdmin).
> >> We advise to update your application to use the new style of APIs,
> since
> >> deprecated APIs might be removed in future releases (2.x). See [2] and
> >> [3]
> >> for an overview of changes. All Client side API's are marked with
> >> InterfaceAudience.Public class, indicating that the class/method is an
> >> official "client API" for HBase. All 1.x releases are planned to be
> API
> >> compatible for these classes. See [1] for an overview.
> >>
> >> Master runs a Region Server as well
> >> Starting with 1.0.0, the HBase master server and backup master servers
> >> will
> >> also act as a region server. RPC port and info port for web UI is
> shared
> >> for
> >> the master and region server roles. Active master can host regions of
> >> defined tables if configured (disabled by default). Backup masters
> will
> >> not
> >> host regions.
> >>
> >> Read availability using timeline consistent region replicas
> >> This release contains Phase 1 items for experimental "Read
> availability
> >> using
> >> timeline consistent region replicas" feature. A region can be hosted
> in
> >> multiple region servers in read-only mode. One of the replicas for the
> >> region
> >> will be primary, accepting writes, and other replicas will be sharing
> >> the
> >> same
> >> data files. Read requests can be done against any replica for the
> region
> >> with
> >> backup RPCs for high availability with timeline consistency
> guarantees.
> >> More
> >> information can be found at HBASE-10070.
> >>
> >> Online config change and other forward ports from 0.89-fb branch
> >> HBASE-12147 forward ported online config change which enables some of
> >> the
> >> configuration from the server to be reloaded without restarting the
> >> region
> >> servers.
> >>
> >> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> >> - A new web skin in time for 1.0 (http://hbase.apache.org)
> >> - Automatic tuning of global memstore and block cache sizes
> >> - Various security, tags and visibility labels improvements
> >> - Bucket cache improvements (usability and compressed data blocks)
> >> - A new pluggable replication endpoint to plug in to HBase's
> >> inter-cluster
> >> replication to replicate to a custom data store
> >> - A Dockerfile to easily build and run HBase from source
> >> - Truncate table command
> >> - Region assignment to use hbase:meta table instead of zookeeper for
> >> faster
> >> region assignment (disabled by default)
> >> - Extensive documentation improvements
> >> - [HBASE-12511] - namespace permissions - add support from table
> creation
> >> privilege in a namespace 'C'
> >> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> >> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> >> Server
> >> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> online
> >> configuration capability' to branch-1
> >> - [HBASE-10560] - Per cell TTLs
> >> - [HBASE-11997] - CopyTable with bulkload
> >> - [HBASE-11990] - Make setting the start and stop row for a specific
> >> prefix easier
> >> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> >> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> >> - [HBASE-12032] - Script to stop regionservers via RPC
> >> - [HBASE-11907] - Use the joni byte[] regex engine in place of
> j.u.regex
> >> in RegexStringComparator
> >> - [HBASE-11796] - Add client support for atomic checkAndMutate
> >> - [HBASE-11804] - Raise default heap size if unspecified
> >> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> >> - [HBASE-12126] - Region server coprocessor endpoint
> >> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> >> - [HBASE-12075] - Preemptive Fast Fail
> >> - [HBASE-12354] - Update dependencies in time for 1.0 release
> >> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> MIN_VERSIONS
> >> - [HBASE-12434] - Add a command to compact all the regions in a
> >> regionserver
> >> - [HBASE-8707] - Add LongComparator for filter
> >> - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> >> changes
> >> - [HBASE-12361] - Show data locality of region in table page
> >> - [HBASE-12496] - A blockedRequestsCount metric
> >> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> >> to
> >> branch-1
> >> - [HBASE-12731] - Heap occupancy based client pushback
> >> - [HBASE-12728] - buffered writes substantially less useful after
> removal
> >> of HTablePool
> >> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> >> - Various fixes to REST server
> >> - Internal refactoring for abstracting away zookeeper usage
> >> - Better support for Cell interface internally in read and write paths
> >> for
> >> better performance and flexibility
> >> - Combining internal mvcc and seqId infrastructure
> >> - Ring buffer based WAL improvements
> >> - Switch to using new style of client APIs internally (in a lot of
> >> places)
> >> - Improvements in visibility labels
> >> - Perf improvements
> >> - Numerous improvements in other areas and bug fixes.
> >>
> >> 1.0.0 release has these changes in default behavior (see [4])
> >> - Zookeeper 3.4.x is required
> >> - Hadoop-2.x is required
> >> - JDK-1.7 is required
> >> - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> >> range.
> >> - Hfile version 3 has been enabled by default.
> >> - Slab cache has been removed (use bucket cache instead)
> >> - Default heap for region servers (and master) is changed from 1GB to
> >> the jdk's default. On most platforms, it will default to 1/4 of
> >> physical
> >> memory
> >> - Some client facing APIs (HTableInterface, etc) has been deprecated
> and
> >> replaced.
> >> - Custom Filter implementations should switch to using the new
> >> recommended
> >> APIs.
> >> - Some authorization permissions (especially regarding namespaces) have
> >> been
> >> changed (HBASE-12511, HBASE-8015)
> >> - Mapred package and classes under there has been un-deprecated.
> >> - Two new modules (jar files): hbase-annotations and hbase-rest.
> >> - HTrace dependency is moved to the Apache artifacts (
> >> https://htrace.incubator.apache.org/)
> >> - Various updates to dependency versions
> >>
> >> Full list of the issues can be found at:
> >> - 1.0.0 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> >> - 0.99.2 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> >> - 0.99.1 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> >> - 0.99.0 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >>
> >> Compatibility
> >> -------------
> >> Source Compatibility:
> >> Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> >> versions. Some minor API changes might be needed from the client side.
> >>
> >>
> >> Wire Compatibility:
> >> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> >> servers running in different versions as long as new features are not
> used
> >> should be possible.
> >> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> >> 1.0.0
> >> introduces a new file format (hfile v3) that is enabled by default that
> >> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> >> is
> >> not supported.
> >> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >>
> >> Binary Compatibility:
> >> Binary compatibility at the Java API layer with earlier versions
> (0.98.x,
> >> 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> >> code and any server side code (coprocessors, filters etc) referring to
> >> hbase jars.
> >>
> >> Upgrading
> >> ---------
> >> See [4] for upgrade instructions and extended discussion on the changes.
> >>
> >> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> >> fashion
> >> is supported.
> >>
> >> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> >> of
> >> the cluster.
> >>
> >> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> >> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> >> metadata.
> >> See [5] for details.
> >>
> >>
> >> Supported Hadoop versions
> >> -------------------------
> >> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> >> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> >> releases
> >> are the most tested hadoop releases and we recommend running with those
> >> versions
> >> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> >> 2.3.x)
> >> are not tested to the full extend. More information can be found here:
> >> https://hbase.apache.org/book/configuration.html#hadoop
> >>
> >>
> >> Supported Java versions
> >> -------------------------
> >> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> >> is experimental. More information can be found here:
> >> https://hbase.apache.org/book/configuration.html#java
> >>
> >>
> >> Voting
> >> ------
> >> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> >> We will have a 5 day voting period because this is the sixth RC. Please
> >> try
> >> to
> >> spend some time for testing this important release.
> >>
> >> [] +1 Release the artifacts as 1.0.0
> >> [] -1 DO NOT release the artifacts as 1.0.0, because...
> >>
> >> Gratitute
> >> ---------
> >> Last but not least, 1.0.0 release has been in a long time making with
> >> contributions from a very large group of awesome people and hard work
> from
> >> committers and contributors. We would like to extend our thanks to
> >> everybody
> >> who worked on this release or contributed to HBase over the years.
> >>
> >>
> >> References
> >> ----------
> >> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> >> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> >> [3] http://s.apache.org/hbase-1.0-api
> >> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> >> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >>
> >> Enis
> >>
> >
> >
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Comments inlined too ;)
> > Download and un-packed passed.
> >
> > Checked Changes.txt => Passed.
> > Checked documentation => Link "Why does HBase care about /etc/hosts?
> > <http://devving.com/?p=414>" in section "Quick Start - Standalone HBase"
> > doesn't work
> >
>
> Seems like a minor issue.
>
Even smaller than that ;)
>
> > Run test suite => Failed 3 time in a row with JDK 1.7
> > Failed tests:
> > TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
> > expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
> >
> >
> TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
> > expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
> >
> >
> TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
> > expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
> >
>
> These tests run a shell script. It maybe something env related.
>
Got it. I wil take another look and see why. Passed with JDK1.8 this
time... Will try multiple times and report if any issue.
>
>
> >
> > Tests in error:
> >
> >
> org.apache.hadoop.hbase.http.TestSSLHttpServer.org.apache.hadoop.hbase.http.TestSSLHttpServer
> > Run 1: TestSSLHttpServer.setup:71 » Certificate Subject class type
> > invalid.
> > Run 2: TestSSLHttpServer.cleanup:102 NullPointer
> >
>
> JDK-8 is supported, but not tested extensively. We can fix this if we can
> find the root cause, but not a reason to block the release.
>
Fine for me. I will try to find the related exceptions from the logs...
java.security.cert.CertificateException: Subject class type invalid.
at sun.security.x509.X509CertInfo.setSubject(X509CertInfo.java:888)
at sun.security.x509.X509CertInfo.set(X509CertInfo.java:415)
at
org.apache.hadoop.hbase.http.ssl.KeyStoreTestUtil.generateCertificate(KeyStoreTestUtil.java:94)
at
org.apache.hadoop.hbase.http.ssl.KeyStoreTestUtil.setupSSLConfig(KeyStoreTestUtil.java:246)
at
org.apache.hadoop.hbase.http.TestSSLHttpServer.setup(TestSSLHttpServer.java:71)
Wich points to info.set(X509CertInfo.SUBJECT, new
CertificateSubjectName(owner));
Where owner = new X500Name(dn);
I think it's related to https://issues.apache.org/jira/browse/HBASE-12006
> >
> > While running in standalone got this exception in the logs when clicking
> on
> > Debug Dump in the master interface:
> > 2015-02-16 10:19:39,172 ERROR [666059465@qtp-2106900153-3] mortbay.log:
> > /dump
> > java.lang.NullPointerException
> > at
> >
> >
> org.apache.hadoop.hbase.regionserver.RSDumpServlet.dumpQueue(RSDumpServlet.java:106)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterDumpServlet.doGet(MasterDumpServlet.java:105)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
> > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> > at
> > org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
> > at
> >
> >
> org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:113)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> >
> >
> org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1351)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> >
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> >
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> > at
> >
> >
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> > at
> > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
> > at
> >
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> > at
> > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> > at
> > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
> > at
> > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
> > at
> >
> >
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
> > at
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > at org.mortbay.jetty.Server.handle(Server.java:326)
> > at
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> > at
> >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
> > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
> > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> > at
> >
> >
> org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
> > at
> >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> >
>
> This maybe because the master was not fully up? Did the exception go away?
>
Master is fully running. I'm able to create tables from the shell, but
still getting this exception.
JM
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Enis Söztutar <en...@gmail.com>.
Thanks J-M for doing these tests.
Some comments inlined.
On Mon, Feb 16, 2015 at 7:37 AM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> Download and un-packed passed.
>
> Checked Changes.txt => Passed.
> Checked documentation => Link "Why does HBase care about /etc/hosts?
> <http://devving.com/?p=414>" in section "Quick Start - Standalone HBase"
> doesn't work
>
Seems like a minor issue.
> Run test suite => Failed 3 time in a row with JDK 1.7
> Failed tests:
> TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
> expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
> expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
> expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
>
These tests run a shell script. It maybe something env related.
>
> Tried with JDK8 and got a lot of:
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
> MaxPermSize=256m; support was removed in 8.0
> And the same errors + some others, ran it twice, twice the same errors.
> Same as with JDK1.7 + the SSL one.
> Failed tests:
> TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
> expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
> expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
>
> TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
> expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
>
Ditto.
>
> Tests in error:
>
> org.apache.hadoop.hbase.http.TestSSLHttpServer.org.apache.hadoop.hbase.http.TestSSLHttpServer
> Run 1: TestSSLHttpServer.setup:71 » Certificate Subject class type
> invalid.
> Run 2: TestSSLHttpServer.cleanup:102 NullPointer
>
JDK-8 is supported, but not tested extensively. We can fix this if we can
find the root cause, but not a reason to block the release.
>
>
>
> Checked RAT => Passed
>
> While running in standalone got this exception in the logs when clicking on
> Debug Dump in the master interface:
> 2015-02-16 10:19:39,172 ERROR [666059465@qtp-2106900153-3] mortbay.log:
> /dump
> java.lang.NullPointerException
> at
>
> org.apache.hadoop.hbase.regionserver.RSDumpServlet.dumpQueue(RSDumpServlet.java:106)
> at
>
> org.apache.hadoop.hbase.master.MasterDumpServlet.doGet(MasterDumpServlet.java:105)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
> at
> org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
> at
>
> org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:113)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
>
> org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1351)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
> org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
> at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
> at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
> at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
> at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
> at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
> at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
> at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
> at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> at org.mortbay.jetty.Server.handle(Server.java:326)
> at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
> at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
> at
>
> org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
> at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>
This maybe because the master was not fully up? Did the exception go away?
>
> Ran some create table, puts, alter, get, scans from command line => Passed.
>
> I'm also running PE on another cluster, but I'm not happy with the way it
> runs. Not related to HBase, more related to PE itself. Might move to YCSB
> or open some JIRAs.
>
> Did a rolling restart from 1.0.0 to 1.0.0. => Passed.
>
> Overall, all seems to be working fine, but not sure about the tests
> failures and the dump exception.
>
> 0 for me. Because of the SSL issue with JDK 8 I'm not sure of the impact on
> a secured cluster. Also, has not been able to get any successful run of the
> tests and I have not been able to validate the performances.
>
> JM
>
> 2015-02-16 8:00 GMT-05:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
>
> > Hi Enis,
> >
> > Quick question, how do you validate the signature? Seems to be a
> > compressed format, not sure if there is a specific command to validate
> it.
> >
> > Thanks,
> >
> > JM
> >
> > 2015-02-15 0:55 GMT-05:00 Enis Söztutar <en...@apache.org>:
> >
> > It gives me great pleasure to announce that the sixth release candidate
> for
> >> the release
> >> 1.0.0 (HBase-1.0.0RC5), is available for download at
> >> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >>
> >> Maven artifacts are also available in the temporary repository
> >> https://repository.apache.org/content/repositories/orgapachehbase-1065
> >>
> >> Signed with my code signing key E964B5FF. Can be found here:
> >> https://people.apache.org/keys/committer/enis.asc
> >>
> >> Signed tag in the repository can be found here:
> >>
> >>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >>
> >> HBase 1.0.0 is the next stable release, and the start of "semantic
> >> versioned"
> >> releases (See [1]).
> >>
> >> The theme of 1.0.0 release is to become a stable base for future 1.x
> >> series
> >> of releases. We aim to achieve at least the same level of stability of
> >> 0.98
> >> releases.
> >>
> >> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> >> the
> >> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> >> limited to)
> >> below. Note that all previous 0.99.x releases are developer preview
> >> releases, and will
> >> NOT be supported in any form.
> >>
> >> API Cleanup and changes
> >> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> >> client side APIs (HTableInterface, HTable and HBaseAdmin).
> >> We advise to update your application to use the new style of APIs,
> since
> >> deprecated APIs might be removed in future releases (2.x). See [2] and
> >> [3]
> >> for an overview of changes. All Client side API's are marked with
> >> InterfaceAudience.Public class, indicating that the class/method is an
> >> official "client API" for HBase. All 1.x releases are planned to be
> API
> >> compatible for these classes. See [1] for an overview.
> >>
> >> Master runs a Region Server as well
> >> Starting with 1.0.0, the HBase master server and backup master servers
> >> will
> >> also act as a region server. RPC port and info port for web UI is
> shared
> >> for
> >> the master and region server roles. Active master can host regions of
> >> defined tables if configured (disabled by default). Backup masters
> will
> >> not
> >> host regions.
> >>
> >> Read availability using timeline consistent region replicas
> >> This release contains Phase 1 items for experimental "Read
> availability
> >> using
> >> timeline consistent region replicas" feature. A region can be hosted
> in
> >> multiple region servers in read-only mode. One of the replicas for the
> >> region
> >> will be primary, accepting writes, and other replicas will be sharing
> >> the
> >> same
> >> data files. Read requests can be done against any replica for the
> region
> >> with
> >> backup RPCs for high availability with timeline consistency
> guarantees.
> >> More
> >> information can be found at HBASE-10070.
> >>
> >> Online config change and other forward ports from 0.89-fb branch
> >> HBASE-12147 forward ported online config change which enables some of
> >> the
> >> configuration from the server to be reloaded without restarting the
> >> region
> >> servers.
> >>
> >> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> >> - A new web skin in time for 1.0 (http://hbase.apache.org)
> >> - Automatic tuning of global memstore and block cache sizes
> >> - Various security, tags and visibility labels improvements
> >> - Bucket cache improvements (usability and compressed data blocks)
> >> - A new pluggable replication endpoint to plug in to HBase's
> >> inter-cluster
> >> replication to replicate to a custom data store
> >> - A Dockerfile to easily build and run HBase from source
> >> - Truncate table command
> >> - Region assignment to use hbase:meta table instead of zookeeper for
> >> faster
> >> region assignment (disabled by default)
> >> - Extensive documentation improvements
> >> - [HBASE-12511] - namespace permissions - add support from table
> creation
> >> privilege in a namespace 'C'
> >> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> >> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> >> Server
> >> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> online
> >> configuration capability' to branch-1
> >> - [HBASE-10560] - Per cell TTLs
> >> - [HBASE-11997] - CopyTable with bulkload
> >> - [HBASE-11990] - Make setting the start and stop row for a specific
> >> prefix easier
> >> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> >> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> >> - [HBASE-12032] - Script to stop regionservers via RPC
> >> - [HBASE-11907] - Use the joni byte[] regex engine in place of
> j.u.regex
> >> in RegexStringComparator
> >> - [HBASE-11796] - Add client support for atomic checkAndMutate
> >> - [HBASE-11804] - Raise default heap size if unspecified
> >> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> >> - [HBASE-12126] - Region server coprocessor endpoint
> >> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> >> - [HBASE-12075] - Preemptive Fast Fail
> >> - [HBASE-12354] - Update dependencies in time for 1.0 release
> >> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> MIN_VERSIONS
> >> - [HBASE-12434] - Add a command to compact all the regions in a
> >> regionserver
> >> - [HBASE-8707] - Add LongComparator for filter
> >> - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> >> changes
> >> - [HBASE-12361] - Show data locality of region in table page
> >> - [HBASE-12496] - A blockedRequestsCount metric
> >> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> >> to
> >> branch-1
> >> - [HBASE-12731] - Heap occupancy based client pushback
> >> - [HBASE-12728] - buffered writes substantially less useful after
> removal
> >> of HTablePool
> >> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> >> - Various fixes to REST server
> >> - Internal refactoring for abstracting away zookeeper usage
> >> - Better support for Cell interface internally in read and write paths
> >> for
> >> better performance and flexibility
> >> - Combining internal mvcc and seqId infrastructure
> >> - Ring buffer based WAL improvements
> >> - Switch to using new style of client APIs internally (in a lot of
> >> places)
> >> - Improvements in visibility labels
> >> - Perf improvements
> >> - Numerous improvements in other areas and bug fixes.
> >>
> >> 1.0.0 release has these changes in default behavior (see [4])
> >> - Zookeeper 3.4.x is required
> >> - Hadoop-2.x is required
> >> - JDK-1.7 is required
> >> - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> >> range.
> >> - Hfile version 3 has been enabled by default.
> >> - Slab cache has been removed (use bucket cache instead)
> >> - Default heap for region servers (and master) is changed from 1GB to
> >> the jdk's default. On most platforms, it will default to 1/4 of
> >> physical
> >> memory
> >> - Some client facing APIs (HTableInterface, etc) has been deprecated
> and
> >> replaced.
> >> - Custom Filter implementations should switch to using the new
> >> recommended
> >> APIs.
> >> - Some authorization permissions (especially regarding namespaces) have
> >> been
> >> changed (HBASE-12511, HBASE-8015)
> >> - Mapred package and classes under there has been un-deprecated.
> >> - Two new modules (jar files): hbase-annotations and hbase-rest.
> >> - HTrace dependency is moved to the Apache artifacts (
> >> https://htrace.incubator.apache.org/)
> >> - Various updates to dependency versions
> >>
> >> Full list of the issues can be found at:
> >> - 1.0.0 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> >> - 0.99.2 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> >> - 0.99.1 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> >> - 0.99.0 issues :
> >>
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >>
> >> Compatibility
> >> -------------
> >> Source Compatibility:
> >> Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> >> versions. Some minor API changes might be needed from the client side.
> >>
> >>
> >> Wire Compatibility:
> >> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> >> servers running in different versions as long as new features are not
> used
> >> should be possible.
> >> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> >> 1.0.0
> >> introduces a new file format (hfile v3) that is enabled by default that
> >> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> >> is
> >> not supported.
> >> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >>
> >> Binary Compatibility:
> >> Binary compatibility at the Java API layer with earlier versions
> (0.98.x,
> >> 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> >> code and any server side code (coprocessors, filters etc) referring to
> >> hbase jars.
> >>
> >> Upgrading
> >> ---------
> >> See [4] for upgrade instructions and extended discussion on the changes.
> >>
> >> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> >> fashion
> >> is supported.
> >>
> >> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> >> of
> >> the cluster.
> >>
> >> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> >> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> >> metadata.
> >> See [5] for details.
> >>
> >>
> >> Supported Hadoop versions
> >> -------------------------
> >> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> >> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> >> releases
> >> are the most tested hadoop releases and we recommend running with those
> >> versions
> >> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> >> 2.3.x)
> >> are not tested to the full extend. More information can be found here:
> >> https://hbase.apache.org/book/configuration.html#hadoop
> >>
> >>
> >> Supported Java versions
> >> -------------------------
> >> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> >> is experimental. More information can be found here:
> >> https://hbase.apache.org/book/configuration.html#java
> >>
> >>
> >> Voting
> >> ------
> >> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> >> We will have a 5 day voting period because this is the sixth RC. Please
> >> try
> >> to
> >> spend some time for testing this important release.
> >>
> >> [] +1 Release the artifacts as 1.0.0
> >> [] -1 DO NOT release the artifacts as 1.0.0, because...
> >>
> >> Gratitute
> >> ---------
> >> Last but not least, 1.0.0 release has been in a long time making with
> >> contributions from a very large group of awesome people and hard work
> from
> >> committers and contributors. We would like to extend our thanks to
> >> everybody
> >> who worked on this release or contributed to HBase over the years.
> >>
> >>
> >> References
> >> ----------
> >> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> >> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> >> [3] http://s.apache.org/hbase-1.0-api
> >> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> >> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >>
> >> Enis
> >>
> >
> >
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Download and un-packed passed.
Checked Changes.txt => Passed.
Checked documentation => Link "Why does HBase care about /etc/hosts?
<http://devving.com/?p=414>" in section "Quick Start - Standalone HBase"
doesn't work
Run test suite => Failed 3 time in a row with JDK 1.7
Failed tests:
TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
Tried with JDK8 and got a lot of:
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option
MaxPermSize=256m; support was removed in 8.0
And the same errors + some others, ran it twice, twice the same errors.
Same as with JDK1.7 + the SSL one.
Failed tests:
TestNodeHealthCheckChore.testHealthCheckerFail:69->healthCheckerTest:90
expected:<FAILED> but was:<FAILED_WITH_EXCEPTION>
TestNodeHealthCheckChore.testHealthCheckerSuccess:63->healthCheckerTest:90
expected:<SUCCESS> but was:<FAILED_WITH_EXCEPTION>
TestNodeHealthCheckChore.testHealthCheckerTimeout:75->healthCheckerTest:90
expected:<TIMED_OUT> but was:<FAILED_WITH_EXCEPTION>
Tests in error:
org.apache.hadoop.hbase.http.TestSSLHttpServer.org.apache.hadoop.hbase.http.TestSSLHttpServer
Run 1: TestSSLHttpServer.setup:71 » Certificate Subject class type
invalid.
Run 2: TestSSLHttpServer.cleanup:102 NullPointer
Checked RAT => Passed
While running in standalone got this exception in the logs when clicking on
Debug Dump in the master interface:
2015-02-16 10:19:39,172 ERROR [666059465@qtp-2106900153-3] mortbay.log:
/dump
java.lang.NullPointerException
at
org.apache.hadoop.hbase.regionserver.RSDumpServlet.dumpQueue(RSDumpServlet.java:106)
at
org.apache.hadoop.hbase.master.MasterDumpServlet.doGet(MasterDumpServlet.java:105)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221)
at
org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:113)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter.doFilter(HttpServer.java:1351)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.apache.hadoop.hbase.http.NoCacheFilter.doFilter(NoCacheFilter.java:49)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
Ran some create table, puts, alter, get, scans from command line => Passed.
I'm also running PE on another cluster, but I'm not happy with the way it
runs. Not related to HBase, more related to PE itself. Might move to YCSB
or open some JIRAs.
Did a rolling restart from 1.0.0 to 1.0.0. => Passed.
Overall, all seems to be working fine, but not sure about the tests
failures and the dump exception.
0 for me. Because of the SSL issue with JDK 8 I'm not sure of the impact on
a secured cluster. Also, has not been able to get any successful run of the
tests and I have not been able to validate the performances.
JM
2015-02-16 8:00 GMT-05:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Hi Enis,
>
> Quick question, how do you validate the signature? Seems to be a
> compressed format, not sure if there is a specific command to validate it.
>
> Thanks,
>
> JM
>
> 2015-02-15 0:55 GMT-05:00 Enis Söztutar <en...@apache.org>:
>
> It gives me great pleasure to announce that the sixth release candidate for
>> the release
>> 1.0.0 (HBase-1.0.0RC5), is available for download at
>> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>>
>> Maven artifacts are also available in the temporary repository
>> https://repository.apache.org/content/repositories/orgapachehbase-1065
>>
>> Signed with my code signing key E964B5FF. Can be found here:
>> https://people.apache.org/keys/committer/enis.asc
>>
>> Signed tag in the repository can be found here:
>>
>> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
>>
>> HBase 1.0.0 is the next stable release, and the start of "semantic
>> versioned"
>> releases (See [1]).
>>
>> The theme of 1.0.0 release is to become a stable base for future 1.x
>> series
>> of releases. We aim to achieve at least the same level of stability of
>> 0.98
>> releases.
>>
>> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
>> the
>> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
>> limited to)
>> below. Note that all previous 0.99.x releases are developer preview
>> releases, and will
>> NOT be supported in any form.
>>
>> API Cleanup and changes
>> 1.0.0 introduces new APIs, and deprecates some of commonly-used
>> client side APIs (HTableInterface, HTable and HBaseAdmin).
>> We advise to update your application to use the new style of APIs, since
>> deprecated APIs might be removed in future releases (2.x). See [2] and
>> [3]
>> for an overview of changes. All Client side API's are marked with
>> InterfaceAudience.Public class, indicating that the class/method is an
>> official "client API" for HBase. All 1.x releases are planned to be API
>> compatible for these classes. See [1] for an overview.
>>
>> Master runs a Region Server as well
>> Starting with 1.0.0, the HBase master server and backup master servers
>> will
>> also act as a region server. RPC port and info port for web UI is shared
>> for
>> the master and region server roles. Active master can host regions of
>> defined tables if configured (disabled by default). Backup masters will
>> not
>> host regions.
>>
>> Read availability using timeline consistent region replicas
>> This release contains Phase 1 items for experimental "Read availability
>> using
>> timeline consistent region replicas" feature. A region can be hosted in
>> multiple region servers in read-only mode. One of the replicas for the
>> region
>> will be primary, accepting writes, and other replicas will be sharing
>> the
>> same
>> data files. Read requests can be done against any replica for the region
>> with
>> backup RPCs for high availability with timeline consistency guarantees.
>> More
>> information can be found at HBASE-10070.
>>
>> Online config change and other forward ports from 0.89-fb branch
>> HBASE-12147 forward ported online config change which enables some of
>> the
>> configuration from the server to be reloaded without restarting the
>> region
>> servers.
>>
>> Other notable improvements in 1.0.0 (including previous 0.99.x) are
>> - A new web skin in time for 1.0 (http://hbase.apache.org)
>> - Automatic tuning of global memstore and block cache sizes
>> - Various security, tags and visibility labels improvements
>> - Bucket cache improvements (usability and compressed data blocks)
>> - A new pluggable replication endpoint to plug in to HBase's
>> inter-cluster
>> replication to replicate to a custom data store
>> - A Dockerfile to easily build and run HBase from source
>> - Truncate table command
>> - Region assignment to use hbase:meta table instead of zookeeper for
>> faster
>> region assignment (disabled by default)
>> - Extensive documentation improvements
>> - [HBASE-12511] - namespace permissions - add support from table creation
>> privilege in a namespace 'C'
>> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
>> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
>> Server
>> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
>> configuration capability' to branch-1
>> - [HBASE-10560] - Per cell TTLs
>> - [HBASE-11997] - CopyTable with bulkload
>> - [HBASE-11990] - Make setting the start and stop row for a specific
>> prefix easier
>> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
>> - [HBASE-12090] - Bytes: more Unsafe, more Faster
>> - [HBASE-12032] - Script to stop regionservers via RPC
>> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
>> in RegexStringComparator
>> - [HBASE-11796] - Add client support for atomic checkAndMutate
>> - [HBASE-11804] - Raise default heap size if unspecified
>> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
>> - [HBASE-12126] - Region server coprocessor endpoint
>> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
>> - [HBASE-12075] - Preemptive Fast Fail
>> - [HBASE-12354] - Update dependencies in time for 1.0 release
>> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
>> - [HBASE-12434] - Add a command to compact all the regions in a
>> regionserver
>> - [HBASE-8707] - Add LongComparator for filter
>> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
>> changes
>> - [HBASE-12361] - Show data locality of region in table page
>> - [HBASE-12496] - A blockedRequestsCount metric
>> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
>> to
>> branch-1
>> - [HBASE-12731] - Heap occupancy based client pushback
>> - [HBASE-12728] - buffered writes substantially less useful after removal
>> of HTablePool
>> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
>> - Various fixes to REST server
>> - Internal refactoring for abstracting away zookeeper usage
>> - Better support for Cell interface internally in read and write paths
>> for
>> better performance and flexibility
>> - Combining internal mvcc and seqId infrastructure
>> - Ring buffer based WAL improvements
>> - Switch to using new style of client APIs internally (in a lot of
>> places)
>> - Improvements in visibility labels
>> - Perf improvements
>> - Numerous improvements in other areas and bug fixes.
>>
>> 1.0.0 release has these changes in default behavior (see [4])
>> - Zookeeper 3.4.x is required
>> - Hadoop-2.x is required
>> - JDK-1.7 is required
>> - Default ports have changed from 600XX range into out of ephemeral 160XX
>> range.
>> - Hfile version 3 has been enabled by default.
>> - Slab cache has been removed (use bucket cache instead)
>> - Default heap for region servers (and master) is changed from 1GB to
>> the jdk's default. On most platforms, it will default to 1/4 of
>> physical
>> memory
>> - Some client facing APIs (HTableInterface, etc) has been deprecated and
>> replaced.
>> - Custom Filter implementations should switch to using the new
>> recommended
>> APIs.
>> - Some authorization permissions (especially regarding namespaces) have
>> been
>> changed (HBASE-12511, HBASE-8015)
>> - Mapred package and classes under there has been un-deprecated.
>> - Two new modules (jar files): hbase-annotations and hbase-rest.
>> - HTrace dependency is moved to the Apache artifacts (
>> https://htrace.incubator.apache.org/)
>> - Various updates to dependency versions
>>
>> Full list of the issues can be found at:
>> - 1.0.0 issues :
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
>> - 0.99.2 issues :
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
>> - 0.99.1 issues :
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
>> - 0.99.0 issues :
>>
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>>
>> Compatibility
>> -------------
>> Source Compatibility:
>> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
>> versions. Some minor API changes might be needed from the client side.
>>
>>
>> Wire Compatibility:
>> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
>> servers running in different versions as long as new features are not used
>> should be possible.
>> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
>> 1.0.0
>> introduces a new file format (hfile v3) that is enabled by default that
>> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
>> is
>> not supported.
>> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>>
>> Binary Compatibility:
>> Binary compatibility at the Java API layer with earlier versions (0.98.x,
>> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
>> code and any server side code (coprocessors, filters etc) referring to
>> hbase jars.
>>
>> Upgrading
>> ---------
>> See [4] for upgrade instructions and extended discussion on the changes.
>>
>> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
>> fashion
>> is supported.
>>
>> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
>> of
>> the cluster.
>>
>> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
>> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
>> metadata.
>> See [5] for details.
>>
>>
>> Supported Hadoop versions
>> -------------------------
>> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
>> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
>> releases
>> are the most tested hadoop releases and we recommend running with those
>> versions
>> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
>> 2.3.x)
>> are not tested to the full extend. More information can be found here:
>> https://hbase.apache.org/book/configuration.html#hadoop
>>
>>
>> Supported Java versions
>> -------------------------
>> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
>> is experimental. More information can be found here:
>> https://hbase.apache.org/book/configuration.html#java
>>
>>
>> Voting
>> ------
>> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
>> We will have a 5 day voting period because this is the sixth RC. Please
>> try
>> to
>> spend some time for testing this important release.
>>
>> [] +1 Release the artifacts as 1.0.0
>> [] -1 DO NOT release the artifacts as 1.0.0, because...
>>
>> Gratitute
>> ---------
>> Last but not least, 1.0.0 release has been in a long time making with
>> contributions from a very large group of awesome people and hard work from
>> committers and contributors. We would like to extend our thanks to
>> everybody
>> who worked on this release or contributed to HBase over the years.
>>
>>
>> References
>> ----------
>> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
>> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
>> [3] http://s.apache.org/hbase-1.0-api
>> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
>> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>>
>> Enis
>>
>
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hum. When I do that I get a warning saying that the key might not belong to
its owner... But expect this waning, I'm able to validate the
hbase-1.0.0-bin.tar.gz file.
Thanks,
JM
2015-02-17 14:25 GMT-05:00 Enis Söztutar <en...@gmail.com>:
> >
> > Quick question, how do you validate the signature? Seems to be a
> compressed
> > format, not sure if there is a specific command to validate it.
> >
>
> You can use:
>
> gpg --recv-key <RM_KEY>
>
> gpg <artifact>.asc
>
> to verify the sig. https://www.apache.org/dev/release-signing.html
> contains
> all the details.
>
>
> > Thanks,
> >
> > JM
> >
> > 2015-02-15 0:55 GMT-05:00 Enis Söztutar <en...@apache.org>:
> >
> > > It gives me great pleasure to announce that the sixth release candidate
> > for
> > > the release
> > > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > >
> > > Maven artifacts are also available in the temporary repository
> > > https://repository.apache.org/content/repositories/orgapachehbase-1065
> > >
> > > Signed with my code signing key E964B5FF. Can be found here:
> > > https://people.apache.org/keys/committer/enis.asc
> > >
> > > Signed tag in the repository can be found here:
> > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > >
> > > HBase 1.0.0 is the next stable release, and the start of "semantic
> > > versioned"
> > > releases (See [1]).
> > >
> > > The theme of 1.0.0 release is to become a stable base for future 1.x
> > series
> > > of releases. We aim to achieve at least the same level of stability of
> > 0.98
> > > releases.
> > >
> > > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together
> with
> > > the
> > > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > > limited to)
> > > below. Note that all previous 0.99.x releases are developer preview
> > > releases, and will
> > > NOT be supported in any form.
> > >
> > > API Cleanup and changes
> > > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > > We advise to update your application to use the new style of APIs,
> > since
> > > deprecated APIs might be removed in future releases (2.x). See [2]
> and
> > > [3]
> > > for an overview of changes. All Client side API's are marked with
> > > InterfaceAudience.Public class, indicating that the class/method is
> an
> > > official "client API" for HBase. All 1.x releases are planned to be
> API
> > > compatible for these classes. See [1] for an overview.
> > >
> > > Master runs a Region Server as well
> > > Starting with 1.0.0, the HBase master server and backup master
> servers
> > > will
> > > also act as a region server. RPC port and info port for web UI is
> > shared
> > > for
> > > the master and region server roles. Active master can host regions of
> > > defined tables if configured (disabled by default). Backup masters
> will
> > > not
> > > host regions.
> > >
> > > Read availability using timeline consistent region replicas
> > > This release contains Phase 1 items for experimental "Read
> availability
> > > using
> > > timeline consistent region replicas" feature. A region can be hosted
> in
> > > multiple region servers in read-only mode. One of the replicas for
> the
> > > region
> > > will be primary, accepting writes, and other replicas will be sharing
> > the
> > > same
> > > data files. Read requests can be done against any replica for the
> > region
> > > with
> > > backup RPCs for high availability with timeline consistency
> guarantees.
> > > More
> > > information can be found at HBASE-10070.
> > >
> > > Online config change and other forward ports from 0.89-fb branch
> > > HBASE-12147 forward ported online config change which enables some of
> > the
> > > configuration from the server to be reloaded without restarting the
> > > region
> > > servers.
> > >
> > > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > > - Automatic tuning of global memstore and block cache sizes
> > > - Various security, tags and visibility labels improvements
> > > - Bucket cache improvements (usability and compressed data blocks)
> > > - A new pluggable replication endpoint to plug in to HBase's
> > inter-cluster
> > > replication to replicate to a custom data store
> > > - A Dockerfile to easily build and run HBase from source
> > > - Truncate table command
> > > - Region assignment to use hbase:meta table instead of zookeeper for
> > > faster
> > > region assignment (disabled by default)
> > > - Extensive documentation improvements
> > > - [HBASE-12511] - namespace permissions - add support from table
> > creation
> > > privilege in a namespace 'C'
> > > - [HBASE-12568] - Adopt Semantic Versioning and document it in the
> book
> > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> > Server
> > > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> online
> > > configuration capability' to branch-1
> > > - [HBASE-10560] - Per cell TTLs
> > > - [HBASE-11997] - CopyTable with bulkload
> > > - [HBASE-11990] - Make setting the start and stop row for a specific
> > > prefix easier
> > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > > - [HBASE-12032] - Script to stop regionservers via RPC
> > > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> j.u.regex
> > > in RegexStringComparator
> > > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > > - [HBASE-11804] - Raise default heap size if unspecified
> > > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > > - [HBASE-12126] - Region server coprocessor endpoint
> > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > > - [HBASE-12075] - Preemptive Fast Fail
> > > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> MIN_VERSIONS
> > > - [HBASE-12434] - Add a command to compact all the regions in a
> > > regionserver
> > > - [HBASE-8707] - Add LongComparator for filter
> > > - [HBASE-12286] - [shell] Add server/cluster online load of
> > configuration
> > > changes
> > > - [HBASE-12361] - Show data locality of region in table page
> > > - [HBASE-12496] - A blockedRequestsCount metric
> > > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> mechanism)
> > to
> > > branch-1
> > > - [HBASE-12731] - Heap occupancy based client pushback
> > > - [HBASE-12728] - buffered writes substantially less useful after
> > removal
> > > of HTablePool
> > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > > - Various fixes to REST server
> > > - Internal refactoring for abstracting away zookeeper usage
> > > - Better support for Cell interface internally in read and write paths
> > for
> > > better performance and flexibility
> > > - Combining internal mvcc and seqId infrastructure
> > > - Ring buffer based WAL improvements
> > > - Switch to using new style of client APIs internally (in a lot of
> > places)
> > > - Improvements in visibility labels
> > > - Perf improvements
> > > - Numerous improvements in other areas and bug fixes.
> > >
> > > 1.0.0 release has these changes in default behavior (see [4])
> > > - Zookeeper 3.4.x is required
> > > - Hadoop-2.x is required
> > > - JDK-1.7 is required
> > > - Default ports have changed from 600XX range into out of ephemeral
> > 160XX
> > > range.
> > > - Hfile version 3 has been enabled by default.
> > > - Slab cache has been removed (use bucket cache instead)
> > > - Default heap for region servers (and master) is changed from 1GB to
> > > the jdk's default. On most platforms, it will default to 1/4 of
> > physical
> > > memory
> > > - Some client facing APIs (HTableInterface, etc) has been deprecated
> and
> > > replaced.
> > > - Custom Filter implementations should switch to using the new
> > recommended
> > > APIs.
> > > - Some authorization permissions (especially regarding namespaces)
> have
> > > been
> > > changed (HBASE-12511, HBASE-8015)
> > > - Mapred package and classes under there has been un-deprecated.
> > > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > > - HTrace dependency is moved to the Apache artifacts (
> > > https://htrace.incubator.apache.org/)
> > > - Various updates to dependency versions
> > >
> > > Full list of the issues can be found at:
> > > - 1.0.0 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > > - 0.99.2 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > > - 0.99.1 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > > - 0.99.0 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > >
> > > Compatibility
> > > -------------
> > > Source Compatibility:
> > > Client side code in HBase-1.0.0 is (mostly) source compatible with
> > earlier
> > > versions. Some minor API changes might be needed from the client side.
> > >
> > >
> > > Wire Compatibility:
> > > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients
> and
> > > servers running in different versions as long as new features are not
> > used
> > > should be possible.
> > > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> > 1.0.0
> > > introduces a new file format (hfile v3) that is enabled by default that
> > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> > 1.0.0
> > > is
> > > not supported.
> > > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > >
> > > Binary Compatibility:
> > > Binary compatibility at the Java API layer with earlier versions
> (0.98.x,
> > > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> > client
> > > code and any server side code (coprocessors, filters etc) referring to
> > > hbase jars.
> > >
> > > Upgrading
> > > ---------
> > > See [4] for upgrade instructions and extended discussion on the
> changes.
> > >
> > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > > fashion
> > > is supported.
> > >
> > > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> > restart
> > > of
> > > the cluster.
> > >
> > > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > > metadata.
> > > See [5] for details.
> > >
> > >
> > > Supported Hadoop versions
> > > -------------------------
> > > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > > releases
> > > are the most tested hadoop releases and we recommend running with those
> > > versions
> > > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > > 2.3.x)
> > > are not tested to the full extend. More information can be found here:
> > > https://hbase.apache.org/book/configuration.html#hadoop
> > >
> > >
> > > Supported Java versions
> > > -------------------------
> > > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> > support
> > > is experimental. More information can be found here:
> > > https://hbase.apache.org/book/configuration.html#java
> > >
> > >
> > > Voting
> > > ------
> > > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > > We will have a 5 day voting period because this is the sixth RC. Please
> > try
> > > to
> > > spend some time for testing this important release.
> > >
> > > [] +1 Release the artifacts as 1.0.0
> > > [] -1 DO NOT release the artifacts as 1.0.0, because...
> > >
> > > Gratitute
> > > ---------
> > > Last but not least, 1.0.0 release has been in a long time making with
> > > contributions from a very large group of awesome people and hard work
> > from
> > > committers and contributors. We would like to extend our thanks to
> > > everybody
> > > who worked on this release or contributed to HBase over the years.
> > >
> > >
> > > References
> > > ----------
> > > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > > [3] http://s.apache.org/hbase-1.0-api
> > > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > >
> > > Enis
> > >
> >
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Enis Söztutar <en...@gmail.com>.
>
> Quick question, how do you validate the signature? Seems to be a compressed
> format, not sure if there is a specific command to validate it.
>
You can use:
gpg --recv-key <RM_KEY>
gpg <artifact>.asc
to verify the sig. https://www.apache.org/dev/release-signing.html contains
all the details.
> Thanks,
>
> JM
>
> 2015-02-15 0:55 GMT-05:00 Enis Söztutar <en...@apache.org>:
>
> > It gives me great pleasure to announce that the sixth release candidate
> for
> > the release
> > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1065
> >
> > Signed with my code signing key E964B5FF. Can be found here:
> > https://people.apache.org/keys/committer/enis.asc
> >
> > Signed tag in the repository can be found here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >
> > HBase 1.0.0 is the next stable release, and the start of "semantic
> > versioned"
> > releases (See [1]).
> >
> > The theme of 1.0.0 release is to become a stable base for future 1.x
> series
> > of releases. We aim to achieve at least the same level of stability of
> 0.98
> > releases.
> >
> > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> > the
> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > limited to)
> > below. Note that all previous 0.99.x releases are developer preview
> > releases, and will
> > NOT be supported in any form.
> >
> > API Cleanup and changes
> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > We advise to update your application to use the new style of APIs,
> since
> > deprecated APIs might be removed in future releases (2.x). See [2] and
> > [3]
> > for an overview of changes. All Client side API's are marked with
> > InterfaceAudience.Public class, indicating that the class/method is an
> > official "client API" for HBase. All 1.x releases are planned to be API
> > compatible for these classes. See [1] for an overview.
> >
> > Master runs a Region Server as well
> > Starting with 1.0.0, the HBase master server and backup master servers
> > will
> > also act as a region server. RPC port and info port for web UI is
> shared
> > for
> > the master and region server roles. Active master can host regions of
> > defined tables if configured (disabled by default). Backup masters will
> > not
> > host regions.
> >
> > Read availability using timeline consistent region replicas
> > This release contains Phase 1 items for experimental "Read availability
> > using
> > timeline consistent region replicas" feature. A region can be hosted in
> > multiple region servers in read-only mode. One of the replicas for the
> > region
> > will be primary, accepting writes, and other replicas will be sharing
> the
> > same
> > data files. Read requests can be done against any replica for the
> region
> > with
> > backup RPCs for high availability with timeline consistency guarantees.
> > More
> > information can be found at HBASE-10070.
> >
> > Online config change and other forward ports from 0.89-fb branch
> > HBASE-12147 forward ported online config change which enables some of
> the
> > configuration from the server to be reloaded without restarting the
> > region
> > servers.
> >
> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > - Automatic tuning of global memstore and block cache sizes
> > - Various security, tags and visibility labels improvements
> > - Bucket cache improvements (usability and compressed data blocks)
> > - A new pluggable replication endpoint to plug in to HBase's
> inter-cluster
> > replication to replicate to a custom data store
> > - A Dockerfile to easily build and run HBase from source
> > - Truncate table command
> > - Region assignment to use hbase:meta table instead of zookeeper for
> > faster
> > region assignment (disabled by default)
> > - Extensive documentation improvements
> > - [HBASE-12511] - namespace permissions - add support from table
> creation
> > privilege in a namespace 'C'
> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> Server
> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> > configuration capability' to branch-1
> > - [HBASE-10560] - Per cell TTLs
> > - [HBASE-11997] - CopyTable with bulkload
> > - [HBASE-11990] - Make setting the start and stop row for a specific
> > prefix easier
> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > - [HBASE-12032] - Script to stop regionservers via RPC
> > - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> > in RegexStringComparator
> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > - [HBASE-11804] - Raise default heap size if unspecified
> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > - [HBASE-12126] - Region server coprocessor endpoint
> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > - [HBASE-12075] - Preemptive Fast Fail
> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> > - [HBASE-12434] - Add a command to compact all the regions in a
> > regionserver
> > - [HBASE-8707] - Add LongComparator for filter
> > - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> > changes
> > - [HBASE-12361] - Show data locality of region in table page
> > - [HBASE-12496] - A blockedRequestsCount metric
> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> to
> > branch-1
> > - [HBASE-12731] - Heap occupancy based client pushback
> > - [HBASE-12728] - buffered writes substantially less useful after
> removal
> > of HTablePool
> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > - Various fixes to REST server
> > - Internal refactoring for abstracting away zookeeper usage
> > - Better support for Cell interface internally in read and write paths
> for
> > better performance and flexibility
> > - Combining internal mvcc and seqId infrastructure
> > - Ring buffer based WAL improvements
> > - Switch to using new style of client APIs internally (in a lot of
> places)
> > - Improvements in visibility labels
> > - Perf improvements
> > - Numerous improvements in other areas and bug fixes.
> >
> > 1.0.0 release has these changes in default behavior (see [4])
> > - Zookeeper 3.4.x is required
> > - Hadoop-2.x is required
> > - JDK-1.7 is required
> > - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> > range.
> > - Hfile version 3 has been enabled by default.
> > - Slab cache has been removed (use bucket cache instead)
> > - Default heap for region servers (and master) is changed from 1GB to
> > the jdk's default. On most platforms, it will default to 1/4 of
> physical
> > memory
> > - Some client facing APIs (HTableInterface, etc) has been deprecated and
> > replaced.
> > - Custom Filter implementations should switch to using the new
> recommended
> > APIs.
> > - Some authorization permissions (especially regarding namespaces) have
> > been
> > changed (HBASE-12511, HBASE-8015)
> > - Mapred package and classes under there has been un-deprecated.
> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > - HTrace dependency is moved to the Apache artifacts (
> > https://htrace.incubator.apache.org/)
> > - Various updates to dependency versions
> >
> > Full list of the issues can be found at:
> > - 1.0.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > - 0.99.2 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > - 0.99.1 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > - 0.99.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >
> > Compatibility
> > -------------
> > Source Compatibility:
> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> > versions. Some minor API changes might be needed from the client side.
> >
> >
> > Wire Compatibility:
> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> > servers running in different versions as long as new features are not
> used
> > should be possible.
> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> 1.0.0
> > introduces a new file format (hfile v3) that is enabled by default that
> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> > is
> > not supported.
> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >
> > Binary Compatibility:
> > Binary compatibility at the Java API layer with earlier versions (0.98.x,
> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> > code and any server side code (coprocessors, filters etc) referring to
> > hbase jars.
> >
> > Upgrading
> > ---------
> > See [4] for upgrade instructions and extended discussion on the changes.
> >
> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > fashion
> > is supported.
> >
> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> > of
> > the cluster.
> >
> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > metadata.
> > See [5] for details.
> >
> >
> > Supported Hadoop versions
> > -------------------------
> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > releases
> > are the most tested hadoop releases and we recommend running with those
> > versions
> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > 2.3.x)
> > are not tested to the full extend. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#hadoop
> >
> >
> > Supported Java versions
> > -------------------------
> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> > is experimental. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#java
> >
> >
> > Voting
> > ------
> > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > We will have a 5 day voting period because this is the sixth RC. Please
> try
> > to
> > spend some time for testing this important release.
> >
> > [] +1 Release the artifacts as 1.0.0
> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >
> > Gratitute
> > ---------
> > Last but not least, 1.0.0 release has been in a long time making with
> > contributions from a very large group of awesome people and hard work
> from
> > committers and contributors. We would like to extend our thanks to
> > everybody
> > who worked on this release or contributed to HBase over the years.
> >
> >
> > References
> > ----------
> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > [3] http://s.apache.org/hbase-1.0-api
> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >
> > Enis
> >
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Enis,
Quick question, how do you validate the signature? Seems to be a compressed
format, not sure if there is a specific command to validate it.
Thanks,
JM
2015-02-15 0:55 GMT-05:00 Enis Söztutar <en...@apache.org>:
> It gives me great pleasure to announce that the sixth release candidate for
> the release
> 1.0.0 (HBase-1.0.0RC5), is available for download at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1065
>
> Signed with my code signing key E964B5FF. Can be found here:
> https://people.apache.org/keys/committer/enis.asc
>
> Signed tag in the repository can be found here:
>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
>
> HBase 1.0.0 is the next stable release, and the start of "semantic
> versioned"
> releases (See [1]).
>
> The theme of 1.0.0 release is to become a stable base for future 1.x series
> of releases. We aim to achieve at least the same level of stability of 0.98
> releases.
>
> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> the
> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> limited to)
> below. Note that all previous 0.99.x releases are developer preview
> releases, and will
> NOT be supported in any form.
>
> API Cleanup and changes
> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> client side APIs (HTableInterface, HTable and HBaseAdmin).
> We advise to update your application to use the new style of APIs, since
> deprecated APIs might be removed in future releases (2.x). See [2] and
> [3]
> for an overview of changes. All Client side API's are marked with
> InterfaceAudience.Public class, indicating that the class/method is an
> official "client API" for HBase. All 1.x releases are planned to be API
> compatible for these classes. See [1] for an overview.
>
> Master runs a Region Server as well
> Starting with 1.0.0, the HBase master server and backup master servers
> will
> also act as a region server. RPC port and info port for web UI is shared
> for
> the master and region server roles. Active master can host regions of
> defined tables if configured (disabled by default). Backup masters will
> not
> host regions.
>
> Read availability using timeline consistent region replicas
> This release contains Phase 1 items for experimental "Read availability
> using
> timeline consistent region replicas" feature. A region can be hosted in
> multiple region servers in read-only mode. One of the replicas for the
> region
> will be primary, accepting writes, and other replicas will be sharing the
> same
> data files. Read requests can be done against any replica for the region
> with
> backup RPCs for high availability with timeline consistency guarantees.
> More
> information can be found at HBASE-10070.
>
> Online config change and other forward ports from 0.89-fb branch
> HBASE-12147 forward ported online config change which enables some of the
> configuration from the server to be reloaded without restarting the
> region
> servers.
>
> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> - A new web skin in time for 1.0 (http://hbase.apache.org)
> - Automatic tuning of global memstore and block cache sizes
> - Various security, tags and visibility labels improvements
> - Bucket cache improvements (usability and compressed data blocks)
> - A new pluggable replication endpoint to plug in to HBase's inter-cluster
> replication to replicate to a custom data store
> - A Dockerfile to easily build and run HBase from source
> - Truncate table command
> - Region assignment to use hbase:meta table instead of zookeeper for
> faster
> region assignment (disabled by default)
> - Extensive documentation improvements
> - [HBASE-12511] - namespace permissions - add support from table creation
> privilege in a namespace 'C'
> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> configuration capability' to branch-1
> - [HBASE-10560] - Per cell TTLs
> - [HBASE-11997] - CopyTable with bulkload
> - [HBASE-11990] - Make setting the start and stop row for a specific
> prefix easier
> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> - [HBASE-12032] - Script to stop regionservers via RPC
> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> in RegexStringComparator
> - [HBASE-11796] - Add client support for atomic checkAndMutate
> - [HBASE-11804] - Raise default heap size if unspecified
> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> - [HBASE-12126] - Region server coprocessor endpoint
> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> - [HBASE-12075] - Preemptive Fast Fail
> - [HBASE-12354] - Update dependencies in time for 1.0 release
> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> - [HBASE-12434] - Add a command to compact all the regions in a
> regionserver
> - [HBASE-8707] - Add LongComparator for filter
> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
> changes
> - [HBASE-12361] - Show data locality of region in table page
> - [HBASE-12496] - A blockedRequestsCount metric
> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
> branch-1
> - [HBASE-12731] - Heap occupancy based client pushback
> - [HBASE-12728] - buffered writes substantially less useful after removal
> of HTablePool
> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> - Various fixes to REST server
> - Internal refactoring for abstracting away zookeeper usage
> - Better support for Cell interface internally in read and write paths for
> better performance and flexibility
> - Combining internal mvcc and seqId infrastructure
> - Ring buffer based WAL improvements
> - Switch to using new style of client APIs internally (in a lot of places)
> - Improvements in visibility labels
> - Perf improvements
> - Numerous improvements in other areas and bug fixes.
>
> 1.0.0 release has these changes in default behavior (see [4])
> - Zookeeper 3.4.x is required
> - Hadoop-2.x is required
> - JDK-1.7 is required
> - Default ports have changed from 600XX range into out of ephemeral 160XX
> range.
> - Hfile version 3 has been enabled by default.
> - Slab cache has been removed (use bucket cache instead)
> - Default heap for region servers (and master) is changed from 1GB to
> the jdk's default. On most platforms, it will default to 1/4 of physical
> memory
> - Some client facing APIs (HTableInterface, etc) has been deprecated and
> replaced.
> - Custom Filter implementations should switch to using the new recommended
> APIs.
> - Some authorization permissions (especially regarding namespaces) have
> been
> changed (HBASE-12511, HBASE-8015)
> - Mapred package and classes under there has been un-deprecated.
> - Two new modules (jar files): hbase-annotations and hbase-rest.
> - HTrace dependency is moved to the Apache artifacts (
> https://htrace.incubator.apache.org/)
> - Various updates to dependency versions
>
> Full list of the issues can be found at:
> - 1.0.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> - 0.99.2 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> - 0.99.1 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> - 0.99.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>
> Compatibility
> -------------
> Source Compatibility:
> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
> versions. Some minor API changes might be needed from the client side.
>
>
> Wire Compatibility:
> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> servers running in different versions as long as new features are not used
> should be possible.
> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
> introduces a new file format (hfile v3) that is enabled by default that
> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
> is
> not supported.
> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>
> Binary Compatibility:
> Binary compatibility at the Java API layer with earlier versions (0.98.x,
> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
> code and any server side code (coprocessors, filters etc) referring to
> hbase jars.
>
> Upgrading
> ---------
> See [4] for upgrade instructions and extended discussion on the changes.
>
> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> fashion
> is supported.
>
> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
> of
> the cluster.
>
> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> metadata.
> See [5] for details.
>
>
> Supported Hadoop versions
> -------------------------
> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> releases
> are the most tested hadoop releases and we recommend running with those
> versions
> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> 2.3.x)
> are not tested to the full extend. More information can be found here:
> https://hbase.apache.org/book/configuration.html#hadoop
>
>
> Supported Java versions
> -------------------------
> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
> is experimental. More information can be found here:
> https://hbase.apache.org/book/configuration.html#java
>
>
> Voting
> ------
> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> We will have a 5 day voting period because this is the sixth RC. Please try
> to
> spend some time for testing this important release.
>
> [] +1 Release the artifacts as 1.0.0
> [] -1 DO NOT release the artifacts as 1.0.0, because...
>
> Gratitute
> ---------
> Last but not least, 1.0.0 release has been in a long time making with
> contributions from a very large group of awesome people and hard work from
> committers and contributors. We would like to extend our thanks to
> everybody
> who worked on this release or contributed to HBase over the years.
>
>
> References
> ----------
> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> [3] http://s.apache.org/hbase-1.0-api
> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>
> Enis
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Ted Yu <yu...@gmail.com>.
+1
Checked signatures
Ran test suite - passed
Ran basic shell commands - passed
Compiled Hive against maven artifacts.
Cheers
On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
> It gives me great pleasure to announce that the sixth release candidate for
> the release
> 1.0.0 (HBase-1.0.0RC5), is available for download at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1065
>
> Signed with my code signing key E964B5FF. Can be found here:
> https://people.apache.org/keys/committer/enis.asc
>
> Signed tag in the repository can be found here:
>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
>
> HBase 1.0.0 is the next stable release, and the start of "semantic
> versioned"
> releases (See [1]).
>
> The theme of 1.0.0 release is to become a stable base for future 1.x series
> of releases. We aim to achieve at least the same level of stability of 0.98
> releases.
>
> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> the
> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> limited to)
> below. Note that all previous 0.99.x releases are developer preview
> releases, and will
> NOT be supported in any form.
>
> API Cleanup and changes
> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> client side APIs (HTableInterface, HTable and HBaseAdmin).
> We advise to update your application to use the new style of APIs, since
> deprecated APIs might be removed in future releases (2.x). See [2] and
> [3]
> for an overview of changes. All Client side API's are marked with
> InterfaceAudience.Public class, indicating that the class/method is an
> official "client API" for HBase. All 1.x releases are planned to be API
> compatible for these classes. See [1] for an overview.
>
> Master runs a Region Server as well
> Starting with 1.0.0, the HBase master server and backup master servers
> will
> also act as a region server. RPC port and info port for web UI is shared
> for
> the master and region server roles. Active master can host regions of
> defined tables if configured (disabled by default). Backup masters will
> not
> host regions.
>
> Read availability using timeline consistent region replicas
> This release contains Phase 1 items for experimental "Read availability
> using
> timeline consistent region replicas" feature. A region can be hosted in
> multiple region servers in read-only mode. One of the replicas for the
> region
> will be primary, accepting writes, and other replicas will be sharing the
> same
> data files. Read requests can be done against any replica for the region
> with
> backup RPCs for high availability with timeline consistency guarantees.
> More
> information can be found at HBASE-10070.
>
> Online config change and other forward ports from 0.89-fb branch
> HBASE-12147 forward ported online config change which enables some of the
> configuration from the server to be reloaded without restarting the
> region
> servers.
>
> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> - A new web skin in time for 1.0 (http://hbase.apache.org)
> - Automatic tuning of global memstore and block cache sizes
> - Various security, tags and visibility labels improvements
> - Bucket cache improvements (usability and compressed data blocks)
> - A new pluggable replication endpoint to plug in to HBase's inter-cluster
> replication to replicate to a custom data store
> - A Dockerfile to easily build and run HBase from source
> - Truncate table command
> - Region assignment to use hbase:meta table instead of zookeeper for
> faster
> region assignment (disabled by default)
> - Extensive documentation improvements
> - [HBASE-12511] - namespace permissions - add support from table creation
> privilege in a namespace 'C'
> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> configuration capability' to branch-1
> - [HBASE-10560] - Per cell TTLs
> - [HBASE-11997] - CopyTable with bulkload
> - [HBASE-11990] - Make setting the start and stop row for a specific
> prefix easier
> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> - [HBASE-12032] - Script to stop regionservers via RPC
> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> in RegexStringComparator
> - [HBASE-11796] - Add client support for atomic checkAndMutate
> - [HBASE-11804] - Raise default heap size if unspecified
> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> - [HBASE-12126] - Region server coprocessor endpoint
> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> - [HBASE-12075] - Preemptive Fast Fail
> - [HBASE-12354] - Update dependencies in time for 1.0 release
> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> - [HBASE-12434] - Add a command to compact all the regions in a
> regionserver
> - [HBASE-8707] - Add LongComparator for filter
> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
> changes
> - [HBASE-12361] - Show data locality of region in table page
> - [HBASE-12496] - A blockedRequestsCount metric
> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
> branch-1
> - [HBASE-12731] - Heap occupancy based client pushback
> - [HBASE-12728] - buffered writes substantially less useful after removal
> of HTablePool
> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> - Various fixes to REST server
> - Internal refactoring for abstracting away zookeeper usage
> - Better support for Cell interface internally in read and write paths for
> better performance and flexibility
> - Combining internal mvcc and seqId infrastructure
> - Ring buffer based WAL improvements
> - Switch to using new style of client APIs internally (in a lot of places)
> - Improvements in visibility labels
> - Perf improvements
> - Numerous improvements in other areas and bug fixes.
>
> 1.0.0 release has these changes in default behavior (see [4])
> - Zookeeper 3.4.x is required
> - Hadoop-2.x is required
> - JDK-1.7 is required
> - Default ports have changed from 600XX range into out of ephemeral 160XX
> range.
> - Hfile version 3 has been enabled by default.
> - Slab cache has been removed (use bucket cache instead)
> - Default heap for region servers (and master) is changed from 1GB to
> the jdk's default. On most platforms, it will default to 1/4 of physical
> memory
> - Some client facing APIs (HTableInterface, etc) has been deprecated and
> replaced.
> - Custom Filter implementations should switch to using the new recommended
> APIs.
> - Some authorization permissions (especially regarding namespaces) have
> been
> changed (HBASE-12511, HBASE-8015)
> - Mapred package and classes under there has been un-deprecated.
> - Two new modules (jar files): hbase-annotations and hbase-rest.
> - HTrace dependency is moved to the Apache artifacts (
> https://htrace.incubator.apache.org/)
> - Various updates to dependency versions
>
> Full list of the issues can be found at:
> - 1.0.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> - 0.99.2 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> - 0.99.1 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> - 0.99.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>
> Compatibility
> -------------
> Source Compatibility:
> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
> versions. Some minor API changes might be needed from the client side.
>
>
> Wire Compatibility:
> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> servers running in different versions as long as new features are not used
> should be possible.
> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
> introduces a new file format (hfile v3) that is enabled by default that
> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
> is
> not supported.
> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>
> Binary Compatibility:
> Binary compatibility at the Java API layer with earlier versions (0.98.x,
> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
> code and any server side code (coprocessors, filters etc) referring to
> hbase jars.
>
> Upgrading
> ---------
> See [4] for upgrade instructions and extended discussion on the changes.
>
> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> fashion
> is supported.
>
> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
> of
> the cluster.
>
> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> metadata.
> See [5] for details.
>
>
> Supported Hadoop versions
> -------------------------
> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> releases
> are the most tested hadoop releases and we recommend running with those
> versions
> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> 2.3.x)
> are not tested to the full extend. More information can be found here:
> https://hbase.apache.org/book/configuration.html#hadoop
>
>
> Supported Java versions
> -------------------------
> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
> is experimental. More information can be found here:
> https://hbase.apache.org/book/configuration.html#java
>
>
> Voting
> ------
> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> We will have a 5 day voting period because this is the sixth RC. Please try
> to
> spend some time for testing this important release.
>
> [] +1 Release the artifacts as 1.0.0
> [] -1 DO NOT release the artifacts as 1.0.0, because...
>
> Gratitute
> ---------
> Last but not least, 1.0.0 release has been in a long time making with
> contributions from a very large group of awesome people and hard work from
> committers and contributors. We would like to extend our thanks to
> everybody
> who worked on this release or contributed to HBase over the years.
>
>
> References
> ----------
> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> [3] http://s.apache.org/hbase-1.0-api
> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>
> Enis
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Sean Busbey <bu...@cloudera.com>.
On Sat, Feb 21, 2015 at 2:45 AM, Enis Söztutar <en...@gmail.com> wrote:
> >
>
> > git tag has this directory that is not in source tarball:
> > Only in .: hbase-native-client
> >
>
> This is interesting. We've never added this to the release tarball it
> seems. Given that there is no usage (not sure why we even have this), I'll
> let this not sink the RC.
>
>
Yeah, I figure the vote is on the dist tarball and not the tag in any case.
>
> >
> > * Can't validate *.mds files
> >
> > How did you generate the *.mds files? I tried reproducing based on what's
> > in the ref guide (http://hbase.apache.org/book.html#maven.release), but
> > that gets me a text file and the given ones appear to be binary.
> >
> > mds files are indeed text files. They are computed with:
>
> gpg --print-mds <file_name>
>
> I usually generate the mds file my own, and do a diff against the files.
>
>
>
Figured it out!
When I downloaded the mds files via chrome, it ended up gziped. Either
gunzip or using curl to download it gave me a text file that matches my own
run of gpg --print-mds.
--
Sean
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Enis Söztutar <en...@gmail.com>.
>
>
>
> * the source tarball does not match the git tag (ignoring dot files).
>
> source tarball has these files that are not in the git tag:
> Only in /Users/busbey/Downloads/hbase-1.0.0/dev-support:
> test-patch.properties.orig
> Only in /Users/busbey/Downloads/hbase-1.0.0/dev-support: test-patch.sh.orig
> Only in
>
> /Users/busbey/Downloads/hbase-1.0.0/hbase-common/src/main/java/org/apache/hadoop/hbase:
> KeyValue.java.orig
>
>
These seem to be from patch process. Should not be a big deal though.
> git tag has this directory that is not in source tarball:
> Only in .: hbase-native-client
>
This is interesting. We've never added this to the release tarball it
seems. Given that there is no usage (not sure why we even have this), I'll
let this not sink the RC.
>
> * Can't validate *.mds files
>
> How did you generate the *.mds files? I tried reproducing based on what's
> in the ref guide (http://hbase.apache.org/book.html#maven.release), but
> that gets me a text file and the given ones appear to be binary.
>
> mds files are indeed text files. They are computed with:
gpg --print-mds <file_name>
I usually generate the mds file my own, and do a diff against the files.
> -Sean
>
> On Sat, Feb 14, 2015 at 11:55 PM, Enis Söztutar <en...@apache.org> wrote:
>
> > It gives me great pleasure to announce that the sixth release candidate
> for
> > the release
> > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1065
> >
> > Signed with my code signing key E964B5FF. Can be found here:
> > https://people.apache.org/keys/committer/enis.asc
> >
> > Signed tag in the repository can be found here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >
> > HBase 1.0.0 is the next stable release, and the start of "semantic
> > versioned"
> > releases (See [1]).
> >
> > The theme of 1.0.0 release is to become a stable base for future 1.x
> series
> > of releases. We aim to achieve at least the same level of stability of
> 0.98
> > releases.
> >
> > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> > the
> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > limited to)
> > below. Note that all previous 0.99.x releases are developer preview
> > releases, and will
> > NOT be supported in any form.
> >
> > API Cleanup and changes
> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > We advise to update your application to use the new style of APIs,
> since
> > deprecated APIs might be removed in future releases (2.x). See [2] and
> > [3]
> > for an overview of changes. All Client side API's are marked with
> > InterfaceAudience.Public class, indicating that the class/method is an
> > official "client API" for HBase. All 1.x releases are planned to be API
> > compatible for these classes. See [1] for an overview.
> >
> > Master runs a Region Server as well
> > Starting with 1.0.0, the HBase master server and backup master servers
> > will
> > also act as a region server. RPC port and info port for web UI is
> shared
> > for
> > the master and region server roles. Active master can host regions of
> > defined tables if configured (disabled by default). Backup masters will
> > not
> > host regions.
> >
> > Read availability using timeline consistent region replicas
> > This release contains Phase 1 items for experimental "Read availability
> > using
> > timeline consistent region replicas" feature. A region can be hosted in
> > multiple region servers in read-only mode. One of the replicas for the
> > region
> > will be primary, accepting writes, and other replicas will be sharing
> the
> > same
> > data files. Read requests can be done against any replica for the
> region
> > with
> > backup RPCs for high availability with timeline consistency guarantees.
> > More
> > information can be found at HBASE-10070.
> >
> > Online config change and other forward ports from 0.89-fb branch
> > HBASE-12147 forward ported online config change which enables some of
> the
> > configuration from the server to be reloaded without restarting the
> > region
> > servers.
> >
> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > - Automatic tuning of global memstore and block cache sizes
> > - Various security, tags and visibility labels improvements
> > - Bucket cache improvements (usability and compressed data blocks)
> > - A new pluggable replication endpoint to plug in to HBase's
> inter-cluster
> > replication to replicate to a custom data store
> > - A Dockerfile to easily build and run HBase from source
> > - Truncate table command
> > - Region assignment to use hbase:meta table instead of zookeeper for
> > faster
> > region assignment (disabled by default)
> > - Extensive documentation improvements
> > - [HBASE-12511] - namespace permissions - add support from table
> creation
> > privilege in a namespace 'C'
> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> Server
> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> > configuration capability' to branch-1
> > - [HBASE-10560] - Per cell TTLs
> > - [HBASE-11997] - CopyTable with bulkload
> > - [HBASE-11990] - Make setting the start and stop row for a specific
> > prefix easier
> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > - [HBASE-12032] - Script to stop regionservers via RPC
> > - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> > in RegexStringComparator
> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > - [HBASE-11804] - Raise default heap size if unspecified
> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > - [HBASE-12126] - Region server coprocessor endpoint
> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > - [HBASE-12075] - Preemptive Fast Fail
> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> > - [HBASE-12434] - Add a command to compact all the regions in a
> > regionserver
> > - [HBASE-8707] - Add LongComparator for filter
> > - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> > changes
> > - [HBASE-12361] - Show data locality of region in table page
> > - [HBASE-12496] - A blockedRequestsCount metric
> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> to
> > branch-1
> > - [HBASE-12731] - Heap occupancy based client pushback
> > - [HBASE-12728] - buffered writes substantially less useful after
> removal
> > of HTablePool
> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > - Various fixes to REST server
> > - Internal refactoring for abstracting away zookeeper usage
> > - Better support for Cell interface internally in read and write paths
> for
> > better performance and flexibility
> > - Combining internal mvcc and seqId infrastructure
> > - Ring buffer based WAL improvements
> > - Switch to using new style of client APIs internally (in a lot of
> places)
> > - Improvements in visibility labels
> > - Perf improvements
> > - Numerous improvements in other areas and bug fixes.
> >
> > 1.0.0 release has these changes in default behavior (see [4])
> > - Zookeeper 3.4.x is required
> > - Hadoop-2.x is required
> > - JDK-1.7 is required
> > - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> > range.
> > - Hfile version 3 has been enabled by default.
> > - Slab cache has been removed (use bucket cache instead)
> > - Default heap for region servers (and master) is changed from 1GB to
> > the jdk's default. On most platforms, it will default to 1/4 of
> physical
> > memory
> > - Some client facing APIs (HTableInterface, etc) has been deprecated and
> > replaced.
> > - Custom Filter implementations should switch to using the new
> recommended
> > APIs.
> > - Some authorization permissions (especially regarding namespaces) have
> > been
> > changed (HBASE-12511, HBASE-8015)
> > - Mapred package and classes under there has been un-deprecated.
> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > - HTrace dependency is moved to the Apache artifacts (
> > https://htrace.incubator.apache.org/)
> > - Various updates to dependency versions
> >
> > Full list of the issues can be found at:
> > - 1.0.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > - 0.99.2 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > - 0.99.1 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > - 0.99.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >
> > Compatibility
> > -------------
> > Source Compatibility:
> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> > versions. Some minor API changes might be needed from the client side.
> >
> >
> > Wire Compatibility:
> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> > servers running in different versions as long as new features are not
> used
> > should be possible.
> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> 1.0.0
> > introduces a new file format (hfile v3) that is enabled by default that
> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> > is
> > not supported.
> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >
> > Binary Compatibility:
> > Binary compatibility at the Java API layer with earlier versions (0.98.x,
> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> > code and any server side code (coprocessors, filters etc) referring to
> > hbase jars.
> >
> > Upgrading
> > ---------
> > See [4] for upgrade instructions and extended discussion on the changes.
> >
> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > fashion
> > is supported.
> >
> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> > of
> > the cluster.
> >
> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > metadata.
> > See [5] for details.
> >
> >
> > Supported Hadoop versions
> > -------------------------
> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > releases
> > are the most tested hadoop releases and we recommend running with those
> > versions
> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > 2.3.x)
> > are not tested to the full extend. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#hadoop
> >
> >
> > Supported Java versions
> > -------------------------
> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> > is experimental. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#java
> >
> >
> > Voting
> > ------
> > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > We will have a 5 day voting period because this is the sixth RC. Please
> try
> > to
> > spend some time for testing this important release.
> >
> > [] +1 Release the artifacts as 1.0.0
> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >
> > Gratitute
> > ---------
> > Last but not least, 1.0.0 release has been in a long time making with
> > contributions from a very large group of awesome people and hard work
> from
> > committers and contributors. We would like to extend our thanks to
> > everybody
> > who worked on this release or contributed to HBase over the years.
> >
> >
> > References
> > ----------
> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > [3] http://s.apache.org/hbase-1.0-api
> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >
> > Enis
> >
>
>
>
> --
> Sean
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Sean Busbey <bu...@cloudera.com>.
+1 (non-binding)
* verified src signature (using http://www.apache.org/dist/hbase/KEYS)
* verified licenses (with apache-rat:check and by inspecting LICENSE.txt
and NOTICE.txt)
* built Apache Hive against RC artifacts and ran through the HBase Handler
qtests (works post HIVE-9706, currently slated for Hive 1.2.0)
Problems, but nothing I think should be blocking:
* ran through -PrunAllTests tests with oracle jvm 1.7.0_67 10 times
** 2 full pass
** 2 runs failed with "timed out or other failure" in hbase-server
** 6 runs had some test failures.
I'm assuming the failures are race conditions. The list is here:
https://paste.apache.org/nDxd
I'll see if I can get some common cause and file a ticket.
* the source tarball does not match the git tag (ignoring dot files).
source tarball has these files that are not in the git tag:
Only in /Users/busbey/Downloads/hbase-1.0.0/dev-support:
test-patch.properties.orig
Only in /Users/busbey/Downloads/hbase-1.0.0/dev-support: test-patch.sh.orig
Only in
/Users/busbey/Downloads/hbase-1.0.0/hbase-common/src/main/java/org/apache/hadoop/hbase:
KeyValue.java.orig
git tag has this directory that is not in source tarball:
Only in .: hbase-native-client
* Can't validate *.mds files
How did you generate the *.mds files? I tried reproducing based on what's
in the ref guide (http://hbase.apache.org/book.html#maven.release), but
that gets me a text file and the given ones appear to be binary.
-Sean
On Sat, Feb 14, 2015 at 11:55 PM, Enis Söztutar <en...@apache.org> wrote:
> It gives me great pleasure to announce that the sixth release candidate for
> the release
> 1.0.0 (HBase-1.0.0RC5), is available for download at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1065
>
> Signed with my code signing key E964B5FF. Can be found here:
> https://people.apache.org/keys/committer/enis.asc
>
> Signed tag in the repository can be found here:
>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
>
> HBase 1.0.0 is the next stable release, and the start of "semantic
> versioned"
> releases (See [1]).
>
> The theme of 1.0.0 release is to become a stable base for future 1.x series
> of releases. We aim to achieve at least the same level of stability of 0.98
> releases.
>
> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> the
> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> limited to)
> below. Note that all previous 0.99.x releases are developer preview
> releases, and will
> NOT be supported in any form.
>
> API Cleanup and changes
> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> client side APIs (HTableInterface, HTable and HBaseAdmin).
> We advise to update your application to use the new style of APIs, since
> deprecated APIs might be removed in future releases (2.x). See [2] and
> [3]
> for an overview of changes. All Client side API's are marked with
> InterfaceAudience.Public class, indicating that the class/method is an
> official "client API" for HBase. All 1.x releases are planned to be API
> compatible for these classes. See [1] for an overview.
>
> Master runs a Region Server as well
> Starting with 1.0.0, the HBase master server and backup master servers
> will
> also act as a region server. RPC port and info port for web UI is shared
> for
> the master and region server roles. Active master can host regions of
> defined tables if configured (disabled by default). Backup masters will
> not
> host regions.
>
> Read availability using timeline consistent region replicas
> This release contains Phase 1 items for experimental "Read availability
> using
> timeline consistent region replicas" feature. A region can be hosted in
> multiple region servers in read-only mode. One of the replicas for the
> region
> will be primary, accepting writes, and other replicas will be sharing the
> same
> data files. Read requests can be done against any replica for the region
> with
> backup RPCs for high availability with timeline consistency guarantees.
> More
> information can be found at HBASE-10070.
>
> Online config change and other forward ports from 0.89-fb branch
> HBASE-12147 forward ported online config change which enables some of the
> configuration from the server to be reloaded without restarting the
> region
> servers.
>
> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> - A new web skin in time for 1.0 (http://hbase.apache.org)
> - Automatic tuning of global memstore and block cache sizes
> - Various security, tags and visibility labels improvements
> - Bucket cache improvements (usability and compressed data blocks)
> - A new pluggable replication endpoint to plug in to HBase's inter-cluster
> replication to replicate to a custom data store
> - A Dockerfile to easily build and run HBase from source
> - Truncate table command
> - Region assignment to use hbase:meta table instead of zookeeper for
> faster
> region assignment (disabled by default)
> - Extensive documentation improvements
> - [HBASE-12511] - namespace permissions - add support from table creation
> privilege in a namespace 'C'
> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> configuration capability' to branch-1
> - [HBASE-10560] - Per cell TTLs
> - [HBASE-11997] - CopyTable with bulkload
> - [HBASE-11990] - Make setting the start and stop row for a specific
> prefix easier
> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> - [HBASE-12032] - Script to stop regionservers via RPC
> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> in RegexStringComparator
> - [HBASE-11796] - Add client support for atomic checkAndMutate
> - [HBASE-11804] - Raise default heap size if unspecified
> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> - [HBASE-12126] - Region server coprocessor endpoint
> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> - [HBASE-12075] - Preemptive Fast Fail
> - [HBASE-12354] - Update dependencies in time for 1.0 release
> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> - [HBASE-12434] - Add a command to compact all the regions in a
> regionserver
> - [HBASE-8707] - Add LongComparator for filter
> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
> changes
> - [HBASE-12361] - Show data locality of region in table page
> - [HBASE-12496] - A blockedRequestsCount metric
> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
> branch-1
> - [HBASE-12731] - Heap occupancy based client pushback
> - [HBASE-12728] - buffered writes substantially less useful after removal
> of HTablePool
> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> - Various fixes to REST server
> - Internal refactoring for abstracting away zookeeper usage
> - Better support for Cell interface internally in read and write paths for
> better performance and flexibility
> - Combining internal mvcc and seqId infrastructure
> - Ring buffer based WAL improvements
> - Switch to using new style of client APIs internally (in a lot of places)
> - Improvements in visibility labels
> - Perf improvements
> - Numerous improvements in other areas and bug fixes.
>
> 1.0.0 release has these changes in default behavior (see [4])
> - Zookeeper 3.4.x is required
> - Hadoop-2.x is required
> - JDK-1.7 is required
> - Default ports have changed from 600XX range into out of ephemeral 160XX
> range.
> - Hfile version 3 has been enabled by default.
> - Slab cache has been removed (use bucket cache instead)
> - Default heap for region servers (and master) is changed from 1GB to
> the jdk's default. On most platforms, it will default to 1/4 of physical
> memory
> - Some client facing APIs (HTableInterface, etc) has been deprecated and
> replaced.
> - Custom Filter implementations should switch to using the new recommended
> APIs.
> - Some authorization permissions (especially regarding namespaces) have
> been
> changed (HBASE-12511, HBASE-8015)
> - Mapred package and classes under there has been un-deprecated.
> - Two new modules (jar files): hbase-annotations and hbase-rest.
> - HTrace dependency is moved to the Apache artifacts (
> https://htrace.incubator.apache.org/)
> - Various updates to dependency versions
>
> Full list of the issues can be found at:
> - 1.0.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> - 0.99.2 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> - 0.99.1 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> - 0.99.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>
> Compatibility
> -------------
> Source Compatibility:
> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
> versions. Some minor API changes might be needed from the client side.
>
>
> Wire Compatibility:
> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> servers running in different versions as long as new features are not used
> should be possible.
> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
> introduces a new file format (hfile v3) that is enabled by default that
> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
> is
> not supported.
> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>
> Binary Compatibility:
> Binary compatibility at the Java API layer with earlier versions (0.98.x,
> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
> code and any server side code (coprocessors, filters etc) referring to
> hbase jars.
>
> Upgrading
> ---------
> See [4] for upgrade instructions and extended discussion on the changes.
>
> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> fashion
> is supported.
>
> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
> of
> the cluster.
>
> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> metadata.
> See [5] for details.
>
>
> Supported Hadoop versions
> -------------------------
> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> releases
> are the most tested hadoop releases and we recommend running with those
> versions
> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> 2.3.x)
> are not tested to the full extend. More information can be found here:
> https://hbase.apache.org/book/configuration.html#hadoop
>
>
> Supported Java versions
> -------------------------
> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
> is experimental. More information can be found here:
> https://hbase.apache.org/book/configuration.html#java
>
>
> Voting
> ------
> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> We will have a 5 day voting period because this is the sixth RC. Please try
> to
> spend some time for testing this important release.
>
> [] +1 Release the artifacts as 1.0.0
> [] -1 DO NOT release the artifacts as 1.0.0, because...
>
> Gratitute
> ---------
> Last but not least, 1.0.0 release has been in a long time making with
> contributions from a very large group of awesome people and hard work from
> committers and contributors. We would like to extend our thanks to
> everybody
> who worked on this release or contributed to HBase over the years.
>
>
> References
> ----------
> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> [3] http://s.apache.org/hbase-1.0-api
> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>
> Enis
>
--
Sean
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Stack <st...@duboce.net>.
+1
+ Sig and MD5 verified.
+ Built from src tgz successfully.
+ Started in standalone mode. Did some clickey-clickey. All worked.
+ Loaded a bit of data and verified it loaded. Nothing untoward in logs.
+ Layout looks good.
+ Built bin tarball. Looks good.
+ Built site. Javadoc, doc., and site look good (I like seeing version
1.0.0 up on the breadcrumbs bar).
+ Did a bunch of 1B row ITBLL tests on small cluster (5nodes) with
aggressive chaos monkey running continuously killing RS, rolling restart
and killing master (With jitter but each monkey running at about 5 minutes
or so). Passed. Loading took about 2 hours each time -- verification a bit
longer.
+ Tried to go to 10B. This took near a day to load (with violent monkeys
doing their best to disrupt). Job completed which means MTTR isn't awful
but verification gets stuck at 90% never progressing. Need to dig in on why.
Push it out I'd say.
St.Ack
On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
> It gives me great pleasure to announce that the sixth release candidate for
> the release
> 1.0.0 (HBase-1.0.0RC5), is available for download at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1065
>
> Signed with my code signing key E964B5FF. Can be found here:
> https://people.apache.org/keys/committer/enis.asc
>
> Signed tag in the repository can be found here:
>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
>
> HBase 1.0.0 is the next stable release, and the start of "semantic
> versioned"
> releases (See [1]).
>
> The theme of 1.0.0 release is to become a stable base for future 1.x series
> of releases. We aim to achieve at least the same level of stability of 0.98
> releases.
>
> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> the
> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> limited to)
> below. Note that all previous 0.99.x releases are developer preview
> releases, and will
> NOT be supported in any form.
>
> API Cleanup and changes
> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> client side APIs (HTableInterface, HTable and HBaseAdmin).
> We advise to update your application to use the new style of APIs, since
> deprecated APIs might be removed in future releases (2.x). See [2] and
> [3]
> for an overview of changes. All Client side API's are marked with
> InterfaceAudience.Public class, indicating that the class/method is an
> official "client API" for HBase. All 1.x releases are planned to be API
> compatible for these classes. See [1] for an overview.
>
> Master runs a Region Server as well
> Starting with 1.0.0, the HBase master server and backup master servers
> will
> also act as a region server. RPC port and info port for web UI is shared
> for
> the master and region server roles. Active master can host regions of
> defined tables if configured (disabled by default). Backup masters will
> not
> host regions.
>
> Read availability using timeline consistent region replicas
> This release contains Phase 1 items for experimental "Read availability
> using
> timeline consistent region replicas" feature. A region can be hosted in
> multiple region servers in read-only mode. One of the replicas for the
> region
> will be primary, accepting writes, and other replicas will be sharing the
> same
> data files. Read requests can be done against any replica for the region
> with
> backup RPCs for high availability with timeline consistency guarantees.
> More
> information can be found at HBASE-10070.
>
> Online config change and other forward ports from 0.89-fb branch
> HBASE-12147 forward ported online config change which enables some of the
> configuration from the server to be reloaded without restarting the
> region
> servers.
>
> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> - A new web skin in time for 1.0 (http://hbase.apache.org)
> - Automatic tuning of global memstore and block cache sizes
> - Various security, tags and visibility labels improvements
> - Bucket cache improvements (usability and compressed data blocks)
> - A new pluggable replication endpoint to plug in to HBase's inter-cluster
> replication to replicate to a custom data store
> - A Dockerfile to easily build and run HBase from source
> - Truncate table command
> - Region assignment to use hbase:meta table instead of zookeeper for
> faster
> region assignment (disabled by default)
> - Extensive documentation improvements
> - [HBASE-12511] - namespace permissions - add support from table creation
> privilege in a namespace 'C'
> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> configuration capability' to branch-1
> - [HBASE-10560] - Per cell TTLs
> - [HBASE-11997] - CopyTable with bulkload
> - [HBASE-11990] - Make setting the start and stop row for a specific
> prefix easier
> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> - [HBASE-12032] - Script to stop regionservers via RPC
> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> in RegexStringComparator
> - [HBASE-11796] - Add client support for atomic checkAndMutate
> - [HBASE-11804] - Raise default heap size if unspecified
> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> - [HBASE-12126] - Region server coprocessor endpoint
> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> - [HBASE-12075] - Preemptive Fast Fail
> - [HBASE-12354] - Update dependencies in time for 1.0 release
> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> - [HBASE-12434] - Add a command to compact all the regions in a
> regionserver
> - [HBASE-8707] - Add LongComparator for filter
> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
> changes
> - [HBASE-12361] - Show data locality of region in table page
> - [HBASE-12496] - A blockedRequestsCount metric
> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
> branch-1
> - [HBASE-12731] - Heap occupancy based client pushback
> - [HBASE-12728] - buffered writes substantially less useful after removal
> of HTablePool
> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> - Various fixes to REST server
> - Internal refactoring for abstracting away zookeeper usage
> - Better support for Cell interface internally in read and write paths for
> better performance and flexibility
> - Combining internal mvcc and seqId infrastructure
> - Ring buffer based WAL improvements
> - Switch to using new style of client APIs internally (in a lot of places)
> - Improvements in visibility labels
> - Perf improvements
> - Numerous improvements in other areas and bug fixes.
>
> 1.0.0 release has these changes in default behavior (see [4])
> - Zookeeper 3.4.x is required
> - Hadoop-2.x is required
> - JDK-1.7 is required
> - Default ports have changed from 600XX range into out of ephemeral 160XX
> range.
> - Hfile version 3 has been enabled by default.
> - Slab cache has been removed (use bucket cache instead)
> - Default heap for region servers (and master) is changed from 1GB to
> the jdk's default. On most platforms, it will default to 1/4 of physical
> memory
> - Some client facing APIs (HTableInterface, etc) has been deprecated and
> replaced.
> - Custom Filter implementations should switch to using the new recommended
> APIs.
> - Some authorization permissions (especially regarding namespaces) have
> been
> changed (HBASE-12511, HBASE-8015)
> - Mapred package and classes under there has been un-deprecated.
> - Two new modules (jar files): hbase-annotations and hbase-rest.
> - HTrace dependency is moved to the Apache artifacts (
> https://htrace.incubator.apache.org/)
> - Various updates to dependency versions
>
> Full list of the issues can be found at:
> - 1.0.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> - 0.99.2 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> - 0.99.1 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> - 0.99.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>
> Compatibility
> -------------
> Source Compatibility:
> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
> versions. Some minor API changes might be needed from the client side.
>
>
> Wire Compatibility:
> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> servers running in different versions as long as new features are not used
> should be possible.
> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
> introduces a new file format (hfile v3) that is enabled by default that
> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
> is
> not supported.
> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>
> Binary Compatibility:
> Binary compatibility at the Java API layer with earlier versions (0.98.x,
> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
> code and any server side code (coprocessors, filters etc) referring to
> hbase jars.
>
> Upgrading
> ---------
> See [4] for upgrade instructions and extended discussion on the changes.
>
> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> fashion
> is supported.
>
> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
> of
> the cluster.
>
> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> metadata.
> See [5] for details.
>
>
> Supported Hadoop versions
> -------------------------
> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> releases
> are the most tested hadoop releases and we recommend running with those
> versions
> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> 2.3.x)
> are not tested to the full extend. More information can be found here:
> https://hbase.apache.org/book/configuration.html#hadoop
>
>
> Supported Java versions
> -------------------------
> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
> is experimental. More information can be found here:
> https://hbase.apache.org/book/configuration.html#java
>
>
> Voting
> ------
> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> We will have a 5 day voting period because this is the sixth RC. Please try
> to
> spend some time for testing this important release.
>
> [] +1 Release the artifacts as 1.0.0
> [] -1 DO NOT release the artifacts as 1.0.0, because...
>
> Gratitute
> ---------
> Last but not least, 1.0.0 release has been in a long time making with
> contributions from a very large group of awesome people and hard work from
> committers and contributors. We would like to extend our thanks to
> everybody
> who worked on this release or contributed to HBase over the years.
>
>
> References
> ----------
> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> [3] http://s.apache.org/hbase-1.0-api
> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>
> Enis
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Enis Söztutar <en...@gmail.com>.
I remember both of these as flaky tests from the past, but I am not sure
about their current status.
https://builds.apache.org/view/All/job/HBase-1.0/ does not have any of
these two failures for the recent builds.
Enis
On Wed, Feb 18, 2015 at 3:11 PM, Andrew Purtell <ap...@apache.org> wrote:
> I'm not able to get a clean unit test run when building from source using
> 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe more but
> the build doesn't get past hbase-server. Maybe these are known issues? If
> not I'll dig in when I get some time.
>
>
> On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
>
> > It gives me great pleasure to announce that the sixth release candidate
> for
> > the release
> > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1065
> >
> > Signed with my code signing key E964B5FF. Can be found here:
> > https://people.apache.org/keys/committer/enis.asc
> >
> > Signed tag in the repository can be found here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >
> > HBase 1.0.0 is the next stable release, and the start of "semantic
> > versioned"
> > releases (See [1]).
> >
> > The theme of 1.0.0 release is to become a stable base for future 1.x
> series
> > of releases. We aim to achieve at least the same level of stability of
> 0.98
> > releases.
> >
> > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> > the
> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > limited to)
> > below. Note that all previous 0.99.x releases are developer preview
> > releases, and will
> > NOT be supported in any form.
> >
> > API Cleanup and changes
> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > We advise to update your application to use the new style of APIs,
> since
> > deprecated APIs might be removed in future releases (2.x). See [2] and
> > [3]
> > for an overview of changes. All Client side API's are marked with
> > InterfaceAudience.Public class, indicating that the class/method is an
> > official "client API" for HBase. All 1.x releases are planned to be API
> > compatible for these classes. See [1] for an overview.
> >
> > Master runs a Region Server as well
> > Starting with 1.0.0, the HBase master server and backup master servers
> > will
> > also act as a region server. RPC port and info port for web UI is
> shared
> > for
> > the master and region server roles. Active master can host regions of
> > defined tables if configured (disabled by default). Backup masters will
> > not
> > host regions.
> >
> > Read availability using timeline consistent region replicas
> > This release contains Phase 1 items for experimental "Read availability
> > using
> > timeline consistent region replicas" feature. A region can be hosted in
> > multiple region servers in read-only mode. One of the replicas for the
> > region
> > will be primary, accepting writes, and other replicas will be sharing
> the
> > same
> > data files. Read requests can be done against any replica for the
> region
> > with
> > backup RPCs for high availability with timeline consistency guarantees.
> > More
> > information can be found at HBASE-10070.
> >
> > Online config change and other forward ports from 0.89-fb branch
> > HBASE-12147 forward ported online config change which enables some of
> the
> > configuration from the server to be reloaded without restarting the
> > region
> > servers.
> >
> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > - Automatic tuning of global memstore and block cache sizes
> > - Various security, tags and visibility labels improvements
> > - Bucket cache improvements (usability and compressed data blocks)
> > - A new pluggable replication endpoint to plug in to HBase's
> inter-cluster
> > replication to replicate to a custom data store
> > - A Dockerfile to easily build and run HBase from source
> > - Truncate table command
> > - Region assignment to use hbase:meta table instead of zookeeper for
> > faster
> > region assignment (disabled by default)
> > - Extensive documentation improvements
> > - [HBASE-12511] - namespace permissions - add support from table
> creation
> > privilege in a namespace 'C'
> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> Server
> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> > configuration capability' to branch-1
> > - [HBASE-10560] - Per cell TTLs
> > - [HBASE-11997] - CopyTable with bulkload
> > - [HBASE-11990] - Make setting the start and stop row for a specific
> > prefix easier
> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > - [HBASE-12032] - Script to stop regionservers via RPC
> > - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> > in RegexStringComparator
> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > - [HBASE-11804] - Raise default heap size if unspecified
> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > - [HBASE-12126] - Region server coprocessor endpoint
> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > - [HBASE-12075] - Preemptive Fast Fail
> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> > - [HBASE-12434] - Add a command to compact all the regions in a
> > regionserver
> > - [HBASE-8707] - Add LongComparator for filter
> > - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> > changes
> > - [HBASE-12361] - Show data locality of region in table page
> > - [HBASE-12496] - A blockedRequestsCount metric
> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> to
> > branch-1
> > - [HBASE-12731] - Heap occupancy based client pushback
> > - [HBASE-12728] - buffered writes substantially less useful after
> removal
> > of HTablePool
> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > - Various fixes to REST server
> > - Internal refactoring for abstracting away zookeeper usage
> > - Better support for Cell interface internally in read and write paths
> for
> > better performance and flexibility
> > - Combining internal mvcc and seqId infrastructure
> > - Ring buffer based WAL improvements
> > - Switch to using new style of client APIs internally (in a lot of
> places)
> > - Improvements in visibility labels
> > - Perf improvements
> > - Numerous improvements in other areas and bug fixes.
> >
> > 1.0.0 release has these changes in default behavior (see [4])
> > - Zookeeper 3.4.x is required
> > - Hadoop-2.x is required
> > - JDK-1.7 is required
> > - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> > range.
> > - Hfile version 3 has been enabled by default.
> > - Slab cache has been removed (use bucket cache instead)
> > - Default heap for region servers (and master) is changed from 1GB to
> > the jdk's default. On most platforms, it will default to 1/4 of
> physical
> > memory
> > - Some client facing APIs (HTableInterface, etc) has been deprecated and
> > replaced.
> > - Custom Filter implementations should switch to using the new
> recommended
> > APIs.
> > - Some authorization permissions (especially regarding namespaces) have
> > been
> > changed (HBASE-12511, HBASE-8015)
> > - Mapred package and classes under there has been un-deprecated.
> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > - HTrace dependency is moved to the Apache artifacts (
> > https://htrace.incubator.apache.org/)
> > - Various updates to dependency versions
> >
> > Full list of the issues can be found at:
> > - 1.0.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > - 0.99.2 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > - 0.99.1 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > - 0.99.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >
> > Compatibility
> > -------------
> > Source Compatibility:
> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> > versions. Some minor API changes might be needed from the client side.
> >
> >
> > Wire Compatibility:
> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> > servers running in different versions as long as new features are not
> used
> > should be possible.
> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> 1.0.0
> > introduces a new file format (hfile v3) that is enabled by default that
> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> > is
> > not supported.
> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >
> > Binary Compatibility:
> > Binary compatibility at the Java API layer with earlier versions (0.98.x,
> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> > code and any server side code (coprocessors, filters etc) referring to
> > hbase jars.
> >
> > Upgrading
> > ---------
> > See [4] for upgrade instructions and extended discussion on the changes.
> >
> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > fashion
> > is supported.
> >
> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> > of
> > the cluster.
> >
> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > metadata.
> > See [5] for details.
> >
> >
> > Supported Hadoop versions
> > -------------------------
> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > releases
> > are the most tested hadoop releases and we recommend running with those
> > versions
> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > 2.3.x)
> > are not tested to the full extend. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#hadoop
> >
> >
> > Supported Java versions
> > -------------------------
> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> > is experimental. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#java
> >
> >
> > Voting
> > ------
> > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > We will have a 5 day voting period because this is the sixth RC. Please
> try
> > to
> > spend some time for testing this important release.
> >
> > [] +1 Release the artifacts as 1.0.0
> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >
> > Gratitute
> > ---------
> > Last but not least, 1.0.0 release has been in a long time making with
> > contributions from a very large group of awesome people and hard work
> from
> > committers and contributors. We would like to extend our thanks to
> > everybody
> > who worked on this release or contributed to HBase over the years.
> >
> >
> > References
> > ----------
> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > [3] http://s.apache.org/hbase-1.0-api
> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >
> > Enis
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Jeffrey Zhong <jz...@hortonworks.com>.
+1. I have compiled & run Phoenix master branch code(with some code
changes) on top of Hbase 1.0.0. All Phoenix tests are passed and one issue
is found(https://issues.apache.org/jira/browse/HBASE-13077)
Thanks,
-Jeffrey
On 2/20/15, 12:38 AM, "Enis Söztutar" <en...@apache.org> wrote:
>Thanks for tests and votes so far.
>
>Here is my official +1 (see above for my tests).
>
>I was inspecting a similar issue today in the cluster with
>IntegrationTestLoadAndVerify with destructive CM, and the log splitting
>did
>not finish in 3 attempts. I think the issue is a not that critical though,
>I think it is due to a race between timeout monitor and some slowness in
>task heartbeat due to a loaded master (will open a jira if I nail down the
>exact reason).
>
>We need at least one more vote. I'll extend the voting for this RC (RC5)
>until 20th midnight PST. Please let me know if you intend to spend some
>more time on testing. We can extend the deadline.
>
>Cheers,
>Enis
>
>On Thu, Feb 19, 2015 at 6:12 PM, Andrew Purtell <ap...@apache.org>
>wrote:
>
>> Maybe its just me
>>
>>
>> On Thu, Feb 19, 2015 at 11:10 AM, Enis Söztutar <en...@gmail.com>
>> wrote:
>>
>> > I did not run the unit tests locally. I was relying on the following
>> build
>> > which is 100% pass:
>> >
>> > https://builds.apache.org/view/All/job/HBase-1.0/746/
>> >
>> > It has the exact RC5 bits (6c98bff7b719efdb16f71606f3b7d8229445eb81).
>>Let
>> > me kick a local UT run just in case.
>> >
>> > Enis
>> >
>> > On Thu, Feb 19, 2015 at 9:05 AM, Andrew Purtell <ap...@apache.org>
>> > wrote:
>> >
>> > > That list is missing unit testing. Did you happen to do that when
>> > building
>> > > but not mention it Enis? If so did they all pass for you?
>> > >
>> > > On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <en...@gmail.com>
>> > wrote:
>> > >
>> > > > Here is my RC5 testing so far:
>> > > >
>> > > > - checked checksums, sigs
>> > > > - checked the bin and src artifacts
>> > > > - checked layouts
>> > > > - checked java files in src tarball, and jar files in bin tarball
>> > > > - checked the book and the site (they are new style)
>> > > > - checked javadocs for both devapi and userapi
>> > > > - checked reported version, build time, revision
>> > > > - run some smoke tests using shell
>> > > > - started local mode
>> > > > - run LTT local mode
>> > > > - checked the webUIs of master and region servers
>> > > > - checked JMX dump and debug dump
>> > > > - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0
>> 2.5.1
>> > > > 2.5.2 2.6.0
>> > > > - Deployed at a 6 node cluster with Hadoop-2.6.0
>> > > > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX
>>encoding
>> > > > - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY
>>compression
>> > > > - Tested with Bucket cache with 500M off heap
>> > > >
>> > > > I am still running larger scale tests, and some CM tests on the
>> > cluster.
>> > > > Will report back tomorrow and cast my vote.
>> > > >
>> > > > Enis
>> > > >
>> > > >
>> > > > On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <pa...@gmail.com> wrote:
>> > > >
>> > > > > TestCacheOnWrite itself has some problems. It
>> > > > > uses TestHFileWriterV2.randomOrderedKey to generate a random
>>byte
>> > > array,
>> > > > > then use first 32 bytes as row and other parts as family and
>> > qualifier,
>> > > > but
>> > > > > TestHFileWriterV2.randomOrderedKey may return a byte array only
>> > > contains
>> > > > 32
>> > > > > bytes, so there will be family and qualifier with zero length.
>> > > > >
>> > > > > I do not know if this is the reason why this test is flaky
>>since it
>> > > use a
>> > > > > Random with pre-defined seed so the random sequence should be
>> > stable. I
>> > > > can
>> > > > > modify the KeyValue generation part to see if it helps.
>> > > > >
>> > > > > BTW, the name 'randomOrderedKey' is ambiguous, may change to '
>> > > > > randomOrderedRow'?
>> > > > >
>> > > > > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
>> > > > >
>> > > > > > I'm not able to get a clean unit test run when building from
>> source
>> > > > using
>> > > > > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me,
>>maybe
>> > > more
>> > > > > but
>> > > > > > the build doesn't get past hbase-server. Maybe these are known
>> > > issues?
>> > > > If
>> > > > > > not I'll dig in when I get some time.
>> > > > > >
>> > > > > >
>> > > > > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar
>><en...@apache.org>
>> > > > wrote:
>> > > > > >
>> > > > > > > It gives me great pleasure to announce that the sixth
>>release
>> > > > candidate
>> > > > > > for
>> > > > > > > the release
>> > > > > > > 1.0.0 (HBase-1.0.0RC5), is available for download at
>> > > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>> > > > > > >
>> > > > > > > Maven artifacts are also available in the temporary
>>repository
>> > > > > > >
>> > > >
>> https://repository.apache.org/content/repositories/orgapachehbase-1065
>> > > > > > >
>> > > > > > > Signed with my code signing key E964B5FF. Can be found here:
>> > > > > > > https://people.apache.org/keys/committer/enis.asc
>> > > > > > >
>> > > > > > > Signed tag in the repository can be found here:
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>>https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46
>>c917a9aba2106be4bf74182a764
>> > > > > > >
>> > > > > > > HBase 1.0.0 is the next stable release, and the start of
>> > "semantic
>> > > > > > > versioned"
>> > > > > > > releases (See [1]).
>> > > > > > >
>> > > > > > > The theme of 1.0.0 release is to become a stable base for
>> future
>> > > 1.x
>> > > > > > series
>> > > > > > > of releases. We aim to achieve at least the same level of
>> > stability
>> > > > of
>> > > > > > 0.98
>> > > > > > > releases.
>> > > > > > >
>> > > > > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release.
>> > Together
>> > > > > with
>> > > > > > > the
>> > > > > > > previous 0.99.x releases, major changes in 1.0.0 are listed
>> (but
>> > > not
>> > > > > > > limited to)
>> > > > > > > below. Note that all previous 0.99.x releases are developer
>> > preview
>> > > > > > > releases, and will
>> > > > > > > NOT be supported in any form.
>> > > > > > >
>> > > > > > > API Cleanup and changes
>> > > > > > > 1.0.0 introduces new APIs, and deprecates some of
>> commonly-used
>> > > > > > > client side APIs (HTableInterface, HTable and HBaseAdmin).
>> > > > > > > We advise to update your application to use the new style
>>of
>> > > APIs,
>> > > > > > since
>> > > > > > > deprecated APIs might be removed in future releases (2.x).
>> See
>> > > [2]
>> > > > > and
>> > > > > > > [3]
>> > > > > > > for an overview of changes. All Client side API's are
>>marked
>> > with
>> > > > > > > InterfaceAudience.Public class, indicating that the
>> > class/method
>> > > is
>> > > > > an
>> > > > > > > official "client API" for HBase. All 1.x releases are
>>planned
>> > to
>> > > be
>> > > > > API
>> > > > > > > compatible for these classes. See [1] for an overview.
>> > > > > > >
>> > > > > > > Master runs a Region Server as well
>> > > > > > > Starting with 1.0.0, the HBase master server and backup
>> master
>> > > > > servers
>> > > > > > > will
>> > > > > > > also act as a region server. RPC port and info port for
>>web
>> UI
>> > is
>> > > > > > shared
>> > > > > > > for
>> > > > > > > the master and region server roles. Active master can host
>> > > regions
>> > > > of
>> > > > > > > defined tables if configured (disabled by default). Backup
>> > > masters
>> > > > > will
>> > > > > > > not
>> > > > > > > host regions.
>> > > > > > >
>> > > > > > > Read availability using timeline consistent region replicas
>> > > > > > > This release contains Phase 1 items for experimental "Read
>> > > > > availability
>> > > > > > > using
>> > > > > > > timeline consistent region replicas" feature. A region
>>can be
>> > > > hosted
>> > > > > in
>> > > > > > > multiple region servers in read-only mode. One of the
>> replicas
>> > > for
>> > > > > the
>> > > > > > > region
>> > > > > > > will be primary, accepting writes, and other replicas
>>will be
>> > > > sharing
>> > > > > > the
>> > > > > > > same
>> > > > > > > data files. Read requests can be done against any replica
>>for
>> > the
>> > > > > > region
>> > > > > > > with
>> > > > > > > backup RPCs for high availability with timeline
>>consistency
>> > > > > guarantees.
>> > > > > > > More
>> > > > > > > information can be found at HBASE-10070.
>> > > > > > >
>> > > > > > > Online config change and other forward ports from 0.89-fb
>> branch
>> > > > > > > HBASE-12147 forward ported online config change which
>>enables
>> > > some
>> > > > of
>> > > > > > the
>> > > > > > > configuration from the server to be reloaded without
>> restarting
>> > > the
>> > > > > > > region
>> > > > > > > servers.
>> > > > > > >
>> > > > > > > Other notable improvements in 1.0.0 (including previous
>>0.99.x)
>> > are
>> > > > > > > - A new web skin in time for 1.0 (http://hbase.apache.org)
>> > > > > > > - Automatic tuning of global memstore and block cache sizes
>> > > > > > > - Various security, tags and visibility labels improvements
>> > > > > > > - Bucket cache improvements (usability and compressed data
>> > blocks)
>> > > > > > > - A new pluggable replication endpoint to plug in to
>>HBase's
>> > > > > > inter-cluster
>> > > > > > > replication to replicate to a custom data store
>> > > > > > > - A Dockerfile to easily build and run HBase from source
>> > > > > > > - Truncate table command
>> > > > > > > - Region assignment to use hbase:meta table instead of
>> zookeeper
>> > > for
>> > > > > > > faster
>> > > > > > > region assignment (disabled by default)
>> > > > > > > - Extensive documentation improvements
>> > > > > > > - [HBASE-12511] - namespace permissions - add support from
>> table
>> > > > > > creation
>> > > > > > > privilege in a namespace 'C'
>> > > > > > > - [HBASE-12568] - Adopt Semantic Versioning and document
>>it in
>> > the
>> > > > > book
>> > > > > > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support
>>for
>> > > Thrift
>> > > > > > Server
>> > > > > > > - [HBASE-12651] - Backport HBASE-12559 'Provide
>>LoadBalancer
>> > with
>> > > > > online
>> > > > > > > configuration capability' to branch-1
>> > > > > > > - [HBASE-10560] - Per cell TTLs
>> > > > > > > - [HBASE-11997] - CopyTable with bulkload
>> > > > > > > - [HBASE-11990] - Make setting the start and stop row for a
>> > > specific
>> > > > > > > prefix easier
>> > > > > > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins
>>metrics
>> > > > > > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
>> > > > > > > - [HBASE-12032] - Script to stop regionservers via RPC
>> > > > > > > - [HBASE-11907] - Use the joni byte[] regex engine in
>>place of
>> > > > > j.u.regex
>> > > > > > > in RegexStringComparator
>> > > > > > > - [HBASE-11796] - Add client support for atomic
>>checkAndMutate
>> > > > > > > - [HBASE-11804] - Raise default heap size if unspecified
>> > > > > > > - [HBASE-11890] - HBase REST Client is hard coded to http
>> > protocol
>> > > > > > > - [HBASE-12126] - Region server coprocessor endpoint
>> > > > > > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse
>>scans
>> > > > > > > - [HBASE-12075] - Preemptive Fast Fail
>> > > > > > > - [HBASE-12354] - Update dependencies in time for 1.0
>>release
>> > > > > > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
>> > > > > MIN_VERSIONS
>> > > > > > > - [HBASE-12434] - Add a command to compact all the regions
>>in
>> a
>> > > > > > > regionserver
>> > > > > > > - [HBASE-8707] - Add LongComparator for filter
>> > > > > > > - [HBASE-12286] - [shell] Add server/cluster online load of
>> > > > > > configuration
>> > > > > > > changes
>> > > > > > > - [HBASE-12361] - Show data locality of region in table
>>page
>> > > > > > > - [HBASE-12496] - A blockedRequestsCount metric
>> > > > > > > - [HBASE-12730] - Backport HBASE-5162 (Basic client
>>pushback
>> > > > > mechanism)
>> > > > > > to
>> > > > > > > branch-1
>> > > > > > > - [HBASE-12731] - Heap occupancy based client pushback
>> > > > > > > - [HBASE-12728] - buffered writes substantially less useful
>> > after
>> > > > > > removal
>> > > > > > > of HTablePool
>> > > > > > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
>> > > > > > > - Various fixes to REST server
>> > > > > > > - Internal refactoring for abstracting away zookeeper usage
>> > > > > > > - Better support for Cell interface internally in read and
>> write
>> > > > paths
>> > > > > > for
>> > > > > > > better performance and flexibility
>> > > > > > > - Combining internal mvcc and seqId infrastructure
>> > > > > > > - Ring buffer based WAL improvements
>> > > > > > > - Switch to using new style of client APIs internally (in a
>> lot
>> > of
>> > > > > > places)
>> > > > > > > - Improvements in visibility labels
>> > > > > > > - Perf improvements
>> > > > > > > - Numerous improvements in other areas and bug fixes.
>> > > > > > >
>> > > > > > > 1.0.0 release has these changes in default behavior (see
>>[4])
>> > > > > > > - Zookeeper 3.4.x is required
>> > > > > > > - Hadoop-2.x is required
>> > > > > > > - JDK-1.7 is required
>> > > > > > > - Default ports have changed from 600XX range into out of
>> > > ephemeral
>> > > > > > 160XX
>> > > > > > > range.
>> > > > > > > - Hfile version 3 has been enabled by default.
>> > > > > > > - Slab cache has been removed (use bucket cache instead)
>> > > > > > > - Default heap for region servers (and master) is changed
>>from
>> > 1GB
>> > > > to
>> > > > > > > the jdk's default. On most platforms, it will default to
>>1/4
>> > of
>> > > > > > physical
>> > > > > > > memory
>> > > > > > > - Some client facing APIs (HTableInterface, etc) has been
>> > > deprecated
>> > > > > and
>> > > > > > > replaced.
>> > > > > > > - Custom Filter implementations should switch to using the
>>new
>> > > > > > recommended
>> > > > > > > APIs.
>> > > > > > > - Some authorization permissions (especially regarding
>> > namespaces)
>> > > > > have
>> > > > > > > been
>> > > > > > > changed (HBASE-12511, HBASE-8015)
>> > > > > > > - Mapred package and classes under there has been
>> un-deprecated.
>> > > > > > > - Two new modules (jar files): hbase-annotations and
>> > hbase-rest.
>> > > > > > > - HTrace dependency is moved to the Apache artifacts (
>> > > > > > > https://htrace.incubator.apache.org/)
>> > > > > > > - Various updates to dependency versions
>> > > > > > >
>> > > > > > > Full list of the issues can be found at:
>> > > > > > > - 1.0.0 issues :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12325852
>> > > > > > > - 0.99.2 issues :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12325675
>> > > > > > > - 0.99.1 issues :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12328551
>> > > > > > > - 0.99.0 issues :
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>>https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753
>>&version=12328822
>> > > > > > >
>> > > > > > > Compatibility
>> > > > > > > -------------
>> > > > > > > Source Compatibility:
>> > > > > > > Client side code in HBase-1.0.0 is (mostly) source
>>compatible
>> > with
>> > > > > > earlier
>> > > > > > > versions. Some minor API changes might be needed from the
>> client
>> > > > side.
>> > > > > > >
>> > > > > > >
>> > > > > > > Wire Compatibility:
>> > > > > > > HBase-1.0.0 release is wire compatible with 0.98.x releases.
>> > > Clients
>> > > > > and
>> > > > > > > servers running in different versions as long as new
>>features
>> are
>> > > not
>> > > > > > used
>> > > > > > > should be possible.
>> > > > > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is
>>supported as
>> > > well.
>> > > > > > 1.0.0
>> > > > > > > introduces a new file format (hfile v3) that is enabled by
>> > default
>> > > > that
>> > > > > > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96
>> directly
>> > > to
>> > > > > > 1.0.0
>> > > > > > > is
>> > > > > > > not supported.
>> > > > > > > 1.0.0 is NOT wire compatible with earlier releases (0.94,
>>etc).
>> > > > > > >
>> > > > > > > Binary Compatibility:
>> > > > > > > Binary compatibility at the Java API layer with earlier
>> versions
>> > > > > (0.98.x,
>> > > > > > > 0.96.x and 0.94.x) is not supported. You may have to
>>recompile
>> > your
>> > > > > > client
>> > > > > > > code and any server side code (coprocessors, filters etc)
>> > referring
>> > > > to
>> > > > > > > hbase jars.
>> > > > > > >
>> > > > > > > Upgrading
>> > > > > > > ---------
>> > > > > > > See [4] for upgrade instructions and extended discussion on
>>the
>> > > > > changes.
>> > > > > > >
>> > > > > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or
>>rolling
>> > > > upgrade
>> > > > > > > fashion
>> > > > > > > is supported.
>> > > > > > >
>> > > > > > > From 0.96.x : Upgrade from 0.96.x is supported with a
>>shutdown
>> > and
>> > > > > > restart
>> > > > > > > of
>> > > > > > > the cluster.
>> > > > > > >
>> > > > > > > From 0.94.x : Upgrade from 0.94.x is supported similar to
>> upgrade
>> > > > from
>> > > > > > > 0.94 -> 0.96. The upgrade script should be run to rewrite
>> cluster
>> > > > level
>> > > > > > > metadata.
>> > > > > > > See [5] for details.
>> > > > > > >
>> > > > > > >
>> > > > > > > Supported Hadoop versions
>> > > > > > > -------------------------
>> > > > > > > 1.0.0 release drops support for Hadoop-1.x releases. Only
>> > > Hadoop-2.x
>> > > > > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and
>> > Hadoop-2.6.x
>> > > > > > > releases
>> > > > > > > are the most tested hadoop releases and we recommend running
>> with
>> > > > those
>> > > > > > > versions
>> > > > > > > (or later versions). Earlier Hadoop-2 based releases
>> > (hadoop-2.2.x
>> > > > and
>> > > > > > > 2.3.x)
>> > > > > > > are not tested to the full extend. More information can be
>> found
>> > > > here:
>> > > > > > > https://hbase.apache.org/book/configuration.html#hadoop
>> > > > > > >
>> > > > > > >
>> > > > > > > Supported Java versions
>> > > > > > > -------------------------
>> > > > > > > 1.0.0 release drops support for JDK6. Only JDK7 is
>>supported.
>> > JDK8
>> > > > > > support
>> > > > > > > is experimental. More information can be found here:
>> > > > > > > https://hbase.apache.org/book/configuration.html#java
>> > > > > > >
>> > > > > > >
>> > > > > > > Voting
>> > > > > > > ------
>> > > > > > > Please try to test and vote on this release by Feb 19 2015
>> > 11:59PM
>> > > > PDT.
>> > > > > > > We will have a 5 day voting period because this is the sixth
>> RC.
>> > > > Please
>> > > > > > try
>> > > > > > > to
>> > > > > > > spend some time for testing this important release.
>> > > > > > >
>> > > > > > > [] +1 Release the artifacts as 1.0.0
>> > > > > > > [] -1 DO NOT release the artifacts as 1.0.0, because...
>> > > > > > >
>> > > > > > > Gratitute
>> > > > > > > ---------
>> > > > > > > Last but not least, 1.0.0 release has been in a long time
>> making
>> > > with
>> > > > > > > contributions from a very large group of awesome people and
>> hard
>> > > work
>> > > > > > from
>> > > > > > > committers and contributors. We would like to extend our
>>thanks
>> > to
>> > > > > > > everybody
>> > > > > > > who worked on this release or contributed to HBase over the
>> > years.
>> > > > > > >
>> > > > > > >
>> > > > > > > References
>> > > > > > > ----------
>> > > > > > > [1]
>> > https://hbase.apache.org/book/upgrading.html#hbase.versioning
>> > > > > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
>> > > > > > > [3] http://s.apache.org/hbase-1.0-api
>> > > > > > > [4]
>> > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
>> > > > > > > [5]
>> > > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>> > > > > > >
>> > > > > > > Enis
>> > > > > > >
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > --
>> > > > > > Best regards,
>> > > > > >
>> > > > > > - Andy
>> > > > > >
>> > > > > > Problems worthy of attack prove their worth by hitting back. -
>> Piet
>> > > > Hein
>> > > > > > (via Tom White)
>> > > > > >
>> > > > >
>> > > >
>> > >
>> > >
>> > >
>> > > --
>> > > Best regards,
>> > >
>> > > - Andy
>> > >
>> > > Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein
>> > > (via Tom White)
>> > >
>> >
>>
>>
>>
>> --
>> Best regards,
>>
>> - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet Hein
>> (via Tom White)
>>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Enis Söztutar <en...@apache.org>.
Thanks for tests and votes so far.
Here is my official +1 (see above for my tests).
I was inspecting a similar issue today in the cluster with
IntegrationTestLoadAndVerify with destructive CM, and the log splitting did
not finish in 3 attempts. I think the issue is a not that critical though,
I think it is due to a race between timeout monitor and some slowness in
task heartbeat due to a loaded master (will open a jira if I nail down the
exact reason).
We need at least one more vote. I'll extend the voting for this RC (RC5)
until 20th midnight PST. Please let me know if you intend to spend some
more time on testing. We can extend the deadline.
Cheers,
Enis
On Thu, Feb 19, 2015 at 6:12 PM, Andrew Purtell <ap...@apache.org> wrote:
> Maybe its just me
>
>
> On Thu, Feb 19, 2015 at 11:10 AM, Enis Söztutar <en...@gmail.com>
> wrote:
>
> > I did not run the unit tests locally. I was relying on the following
> build
> > which is 100% pass:
> >
> > https://builds.apache.org/view/All/job/HBase-1.0/746/
> >
> > It has the exact RC5 bits (6c98bff7b719efdb16f71606f3b7d8229445eb81). Let
> > me kick a local UT run just in case.
> >
> > Enis
> >
> > On Thu, Feb 19, 2015 at 9:05 AM, Andrew Purtell <ap...@apache.org>
> > wrote:
> >
> > > That list is missing unit testing. Did you happen to do that when
> > building
> > > but not mention it Enis? If so did they all pass for you?
> > >
> > > On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <en...@gmail.com>
> > wrote:
> > >
> > > > Here is my RC5 testing so far:
> > > >
> > > > - checked checksums, sigs
> > > > - checked the bin and src artifacts
> > > > - checked layouts
> > > > - checked java files in src tarball, and jar files in bin tarball
> > > > - checked the book and the site (they are new style)
> > > > - checked javadocs for both devapi and userapi
> > > > - checked reported version, build time, revision
> > > > - run some smoke tests using shell
> > > > - started local mode
> > > > - run LTT local mode
> > > > - checked the webUIs of master and region servers
> > > > - checked JMX dump and debug dump
> > > > - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0
> 2.5.1
> > > > 2.5.2 2.6.0
> > > > - Deployed at a 6 node cluster with Hadoop-2.6.0
> > > > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX encoding
> > > > - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY compression
> > > > - Tested with Bucket cache with 500M off heap
> > > >
> > > > I am still running larger scale tests, and some CM tests on the
> > cluster.
> > > > Will report back tomorrow and cast my vote.
> > > >
> > > > Enis
> > > >
> > > >
> > > > On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <pa...@gmail.com> wrote:
> > > >
> > > > > TestCacheOnWrite itself has some problems. It
> > > > > uses TestHFileWriterV2.randomOrderedKey to generate a random byte
> > > array,
> > > > > then use first 32 bytes as row and other parts as family and
> > qualifier,
> > > > but
> > > > > TestHFileWriterV2.randomOrderedKey may return a byte array only
> > > contains
> > > > 32
> > > > > bytes, so there will be family and qualifier with zero length.
> > > > >
> > > > > I do not know if this is the reason why this test is flaky since it
> > > use a
> > > > > Random with pre-defined seed so the random sequence should be
> > stable. I
> > > > can
> > > > > modify the KeyValue generation part to see if it helps.
> > > > >
> > > > > BTW, the name 'randomOrderedKey' is ambiguous, may change to '
> > > > > randomOrderedRow'?
> > > > >
> > > > > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> > > > >
> > > > > > I'm not able to get a clean unit test run when building from
> source
> > > > using
> > > > > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe
> > > more
> > > > > but
> > > > > > the build doesn't get past hbase-server. Maybe these are known
> > > issues?
> > > > If
> > > > > > not I'll dig in when I get some time.
> > > > > >
> > > > > >
> > > > > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > > It gives me great pleasure to announce that the sixth release
> > > > candidate
> > > > > > for
> > > > > > > the release
> > > > > > > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > > > > > >
> > > > > > > Maven artifacts are also available in the temporary repository
> > > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachehbase-1065
> > > > > > >
> > > > > > > Signed with my code signing key E964B5FF. Can be found here:
> > > > > > > https://people.apache.org/keys/committer/enis.asc
> > > > > > >
> > > > > > > Signed tag in the repository can be found here:
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > > > > > >
> > > > > > > HBase 1.0.0 is the next stable release, and the start of
> > "semantic
> > > > > > > versioned"
> > > > > > > releases (See [1]).
> > > > > > >
> > > > > > > The theme of 1.0.0 release is to become a stable base for
> future
> > > 1.x
> > > > > > series
> > > > > > > of releases. We aim to achieve at least the same level of
> > stability
> > > > of
> > > > > > 0.98
> > > > > > > releases.
> > > > > > >
> > > > > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release.
> > Together
> > > > > with
> > > > > > > the
> > > > > > > previous 0.99.x releases, major changes in 1.0.0 are listed
> (but
> > > not
> > > > > > > limited to)
> > > > > > > below. Note that all previous 0.99.x releases are developer
> > preview
> > > > > > > releases, and will
> > > > > > > NOT be supported in any form.
> > > > > > >
> > > > > > > API Cleanup and changes
> > > > > > > 1.0.0 introduces new APIs, and deprecates some of
> commonly-used
> > > > > > > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > > > > > > We advise to update your application to use the new style of
> > > APIs,
> > > > > > since
> > > > > > > deprecated APIs might be removed in future releases (2.x).
> See
> > > [2]
> > > > > and
> > > > > > > [3]
> > > > > > > for an overview of changes. All Client side API's are marked
> > with
> > > > > > > InterfaceAudience.Public class, indicating that the
> > class/method
> > > is
> > > > > an
> > > > > > > official "client API" for HBase. All 1.x releases are planned
> > to
> > > be
> > > > > API
> > > > > > > compatible for these classes. See [1] for an overview.
> > > > > > >
> > > > > > > Master runs a Region Server as well
> > > > > > > Starting with 1.0.0, the HBase master server and backup
> master
> > > > > servers
> > > > > > > will
> > > > > > > also act as a region server. RPC port and info port for web
> UI
> > is
> > > > > > shared
> > > > > > > for
> > > > > > > the master and region server roles. Active master can host
> > > regions
> > > > of
> > > > > > > defined tables if configured (disabled by default). Backup
> > > masters
> > > > > will
> > > > > > > not
> > > > > > > host regions.
> > > > > > >
> > > > > > > Read availability using timeline consistent region replicas
> > > > > > > This release contains Phase 1 items for experimental "Read
> > > > > availability
> > > > > > > using
> > > > > > > timeline consistent region replicas" feature. A region can be
> > > > hosted
> > > > > in
> > > > > > > multiple region servers in read-only mode. One of the
> replicas
> > > for
> > > > > the
> > > > > > > region
> > > > > > > will be primary, accepting writes, and other replicas will be
> > > > sharing
> > > > > > the
> > > > > > > same
> > > > > > > data files. Read requests can be done against any replica for
> > the
> > > > > > region
> > > > > > > with
> > > > > > > backup RPCs for high availability with timeline consistency
> > > > > guarantees.
> > > > > > > More
> > > > > > > information can be found at HBASE-10070.
> > > > > > >
> > > > > > > Online config change and other forward ports from 0.89-fb
> branch
> > > > > > > HBASE-12147 forward ported online config change which enables
> > > some
> > > > of
> > > > > > the
> > > > > > > configuration from the server to be reloaded without
> restarting
> > > the
> > > > > > > region
> > > > > > > servers.
> > > > > > >
> > > > > > > Other notable improvements in 1.0.0 (including previous 0.99.x)
> > are
> > > > > > > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > > > > > > - Automatic tuning of global memstore and block cache sizes
> > > > > > > - Various security, tags and visibility labels improvements
> > > > > > > - Bucket cache improvements (usability and compressed data
> > blocks)
> > > > > > > - A new pluggable replication endpoint to plug in to HBase's
> > > > > > inter-cluster
> > > > > > > replication to replicate to a custom data store
> > > > > > > - A Dockerfile to easily build and run HBase from source
> > > > > > > - Truncate table command
> > > > > > > - Region assignment to use hbase:meta table instead of
> zookeeper
> > > for
> > > > > > > faster
> > > > > > > region assignment (disabled by default)
> > > > > > > - Extensive documentation improvements
> > > > > > > - [HBASE-12511] - namespace permissions - add support from
> table
> > > > > > creation
> > > > > > > privilege in a namespace 'C'
> > > > > > > - [HBASE-12568] - Adopt Semantic Versioning and document it in
> > the
> > > > > book
> > > > > > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for
> > > Thrift
> > > > > > Server
> > > > > > > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer
> > with
> > > > > online
> > > > > > > configuration capability' to branch-1
> > > > > > > - [HBASE-10560] - Per cell TTLs
> > > > > > > - [HBASE-11997] - CopyTable with bulkload
> > > > > > > - [HBASE-11990] - Make setting the start and stop row for a
> > > specific
> > > > > > > prefix easier
> > > > > > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > > > > > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > > > > > > - [HBASE-12032] - Script to stop regionservers via RPC
> > > > > > > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> > > > > j.u.regex
> > > > > > > in RegexStringComparator
> > > > > > > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > > > > > > - [HBASE-11804] - Raise default heap size if unspecified
> > > > > > > - [HBASE-11890] - HBase REST Client is hard coded to http
> > protocol
> > > > > > > - [HBASE-12126] - Region server coprocessor endpoint
> > > > > > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > > > > > > - [HBASE-12075] - Preemptive Fast Fail
> > > > > > > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > > > > > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> > > > > MIN_VERSIONS
> > > > > > > - [HBASE-12434] - Add a command to compact all the regions in
> a
> > > > > > > regionserver
> > > > > > > - [HBASE-8707] - Add LongComparator for filter
> > > > > > > - [HBASE-12286] - [shell] Add server/cluster online load of
> > > > > > configuration
> > > > > > > changes
> > > > > > > - [HBASE-12361] - Show data locality of region in table page
> > > > > > > - [HBASE-12496] - A blockedRequestsCount metric
> > > > > > > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> > > > > mechanism)
> > > > > > to
> > > > > > > branch-1
> > > > > > > - [HBASE-12731] - Heap occupancy based client pushback
> > > > > > > - [HBASE-12728] - buffered writes substantially less useful
> > after
> > > > > > removal
> > > > > > > of HTablePool
> > > > > > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > > > > > > - Various fixes to REST server
> > > > > > > - Internal refactoring for abstracting away zookeeper usage
> > > > > > > - Better support for Cell interface internally in read and
> write
> > > > paths
> > > > > > for
> > > > > > > better performance and flexibility
> > > > > > > - Combining internal mvcc and seqId infrastructure
> > > > > > > - Ring buffer based WAL improvements
> > > > > > > - Switch to using new style of client APIs internally (in a
> lot
> > of
> > > > > > places)
> > > > > > > - Improvements in visibility labels
> > > > > > > - Perf improvements
> > > > > > > - Numerous improvements in other areas and bug fixes.
> > > > > > >
> > > > > > > 1.0.0 release has these changes in default behavior (see [4])
> > > > > > > - Zookeeper 3.4.x is required
> > > > > > > - Hadoop-2.x is required
> > > > > > > - JDK-1.7 is required
> > > > > > > - Default ports have changed from 600XX range into out of
> > > ephemeral
> > > > > > 160XX
> > > > > > > range.
> > > > > > > - Hfile version 3 has been enabled by default.
> > > > > > > - Slab cache has been removed (use bucket cache instead)
> > > > > > > - Default heap for region servers (and master) is changed from
> > 1GB
> > > > to
> > > > > > > the jdk's default. On most platforms, it will default to 1/4
> > of
> > > > > > physical
> > > > > > > memory
> > > > > > > - Some client facing APIs (HTableInterface, etc) has been
> > > deprecated
> > > > > and
> > > > > > > replaced.
> > > > > > > - Custom Filter implementations should switch to using the new
> > > > > > recommended
> > > > > > > APIs.
> > > > > > > - Some authorization permissions (especially regarding
> > namespaces)
> > > > > have
> > > > > > > been
> > > > > > > changed (HBASE-12511, HBASE-8015)
> > > > > > > - Mapred package and classes under there has been
> un-deprecated.
> > > > > > > - Two new modules (jar files): hbase-annotations and
> > hbase-rest.
> > > > > > > - HTrace dependency is moved to the Apache artifacts (
> > > > > > > https://htrace.incubator.apache.org/)
> > > > > > > - Various updates to dependency versions
> > > > > > >
> > > > > > > Full list of the issues can be found at:
> > > > > > > - 1.0.0 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > > > > > > - 0.99.2 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > > > > > > - 0.99.1 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > > > > > > - 0.99.0 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > > > > > >
> > > > > > > Compatibility
> > > > > > > -------------
> > > > > > > Source Compatibility:
> > > > > > > Client side code in HBase-1.0.0 is (mostly) source compatible
> > with
> > > > > > earlier
> > > > > > > versions. Some minor API changes might be needed from the
> client
> > > > side.
> > > > > > >
> > > > > > >
> > > > > > > Wire Compatibility:
> > > > > > > HBase-1.0.0 release is wire compatible with 0.98.x releases.
> > > Clients
> > > > > and
> > > > > > > servers running in different versions as long as new features
> are
> > > not
> > > > > > used
> > > > > > > should be possible.
> > > > > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as
> > > well.
> > > > > > 1.0.0
> > > > > > > introduces a new file format (hfile v3) that is enabled by
> > default
> > > > that
> > > > > > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96
> directly
> > > to
> > > > > > 1.0.0
> > > > > > > is
> > > > > > > not supported.
> > > > > > > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > > > > > >
> > > > > > > Binary Compatibility:
> > > > > > > Binary compatibility at the Java API layer with earlier
> versions
> > > > > (0.98.x,
> > > > > > > 0.96.x and 0.94.x) is not supported. You may have to recompile
> > your
> > > > > > client
> > > > > > > code and any server side code (coprocessors, filters etc)
> > referring
> > > > to
> > > > > > > hbase jars.
> > > > > > >
> > > > > > > Upgrading
> > > > > > > ---------
> > > > > > > See [4] for upgrade instructions and extended discussion on the
> > > > > changes.
> > > > > > >
> > > > > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling
> > > > upgrade
> > > > > > > fashion
> > > > > > > is supported.
> > > > > > >
> > > > > > > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown
> > and
> > > > > > restart
> > > > > > > of
> > > > > > > the cluster.
> > > > > > >
> > > > > > > From 0.94.x : Upgrade from 0.94.x is supported similar to
> upgrade
> > > > from
> > > > > > > 0.94 -> 0.96. The upgrade script should be run to rewrite
> cluster
> > > > level
> > > > > > > metadata.
> > > > > > > See [5] for details.
> > > > > > >
> > > > > > >
> > > > > > > Supported Hadoop versions
> > > > > > > -------------------------
> > > > > > > 1.0.0 release drops support for Hadoop-1.x releases. Only
> > > Hadoop-2.x
> > > > > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and
> > Hadoop-2.6.x
> > > > > > > releases
> > > > > > > are the most tested hadoop releases and we recommend running
> with
> > > > those
> > > > > > > versions
> > > > > > > (or later versions). Earlier Hadoop-2 based releases
> > (hadoop-2.2.x
> > > > and
> > > > > > > 2.3.x)
> > > > > > > are not tested to the full extend. More information can be
> found
> > > > here:
> > > > > > > https://hbase.apache.org/book/configuration.html#hadoop
> > > > > > >
> > > > > > >
> > > > > > > Supported Java versions
> > > > > > > -------------------------
> > > > > > > 1.0.0 release drops support for JDK6. Only JDK7 is supported.
> > JDK8
> > > > > > support
> > > > > > > is experimental. More information can be found here:
> > > > > > > https://hbase.apache.org/book/configuration.html#java
> > > > > > >
> > > > > > >
> > > > > > > Voting
> > > > > > > ------
> > > > > > > Please try to test and vote on this release by Feb 19 2015
> > 11:59PM
> > > > PDT.
> > > > > > > We will have a 5 day voting period because this is the sixth
> RC.
> > > > Please
> > > > > > try
> > > > > > > to
> > > > > > > spend some time for testing this important release.
> > > > > > >
> > > > > > > [] +1 Release the artifacts as 1.0.0
> > > > > > > [] -1 DO NOT release the artifacts as 1.0.0, because...
> > > > > > >
> > > > > > > Gratitute
> > > > > > > ---------
> > > > > > > Last but not least, 1.0.0 release has been in a long time
> making
> > > with
> > > > > > > contributions from a very large group of awesome people and
> hard
> > > work
> > > > > > from
> > > > > > > committers and contributors. We would like to extend our thanks
> > to
> > > > > > > everybody
> > > > > > > who worked on this release or contributed to HBase over the
> > years.
> > > > > > >
> > > > > > >
> > > > > > > References
> > > > > > > ----------
> > > > > > > [1]
> > https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > > > > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > > > > > > [3] http://s.apache.org/hbase-1.0-api
> > > > > > > [4]
> > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > > > > > > [5]
> > > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > > > > > >
> > > > > > > Enis
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > >
> > > > > > - Andy
> > > > > >
> > > > > > Problems worthy of attack prove their worth by hitting back. -
> Piet
> > > > Hein
> > > > > > (via Tom White)
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by 张铎 <pa...@gmail.com>.
See HBASE-13070, I found the problem finally. It is a testcase issue so I
do not think it should block a release.
2015-02-20 10:12 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> Maybe its just me
>
>
> On Thu, Feb 19, 2015 at 11:10 AM, Enis Söztutar <en...@gmail.com>
> wrote:
>
> > I did not run the unit tests locally. I was relying on the following
> build
> > which is 100% pass:
> >
> > https://builds.apache.org/view/All/job/HBase-1.0/746/
> >
> > It has the exact RC5 bits (6c98bff7b719efdb16f71606f3b7d8229445eb81). Let
> > me kick a local UT run just in case.
> >
> > Enis
> >
> > On Thu, Feb 19, 2015 at 9:05 AM, Andrew Purtell <ap...@apache.org>
> > wrote:
> >
> > > That list is missing unit testing. Did you happen to do that when
> > building
> > > but not mention it Enis? If so did they all pass for you?
> > >
> > > On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <en...@gmail.com>
> > wrote:
> > >
> > > > Here is my RC5 testing so far:
> > > >
> > > > - checked checksums, sigs
> > > > - checked the bin and src artifacts
> > > > - checked layouts
> > > > - checked java files in src tarball, and jar files in bin tarball
> > > > - checked the book and the site (they are new style)
> > > > - checked javadocs for both devapi and userapi
> > > > - checked reported version, build time, revision
> > > > - run some smoke tests using shell
> > > > - started local mode
> > > > - run LTT local mode
> > > > - checked the webUIs of master and region servers
> > > > - checked JMX dump and debug dump
> > > > - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0
> 2.5.1
> > > > 2.5.2 2.6.0
> > > > - Deployed at a 6 node cluster with Hadoop-2.6.0
> > > > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX encoding
> > > > - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY compression
> > > > - Tested with Bucket cache with 500M off heap
> > > >
> > > > I am still running larger scale tests, and some CM tests on the
> > cluster.
> > > > Will report back tomorrow and cast my vote.
> > > >
> > > > Enis
> > > >
> > > >
> > > > On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <pa...@gmail.com> wrote:
> > > >
> > > > > TestCacheOnWrite itself has some problems. It
> > > > > uses TestHFileWriterV2.randomOrderedKey to generate a random byte
> > > array,
> > > > > then use first 32 bytes as row and other parts as family and
> > qualifier,
> > > > but
> > > > > TestHFileWriterV2.randomOrderedKey may return a byte array only
> > > contains
> > > > 32
> > > > > bytes, so there will be family and qualifier with zero length.
> > > > >
> > > > > I do not know if this is the reason why this test is flaky since it
> > > use a
> > > > > Random with pre-defined seed so the random sequence should be
> > stable. I
> > > > can
> > > > > modify the KeyValue generation part to see if it helps.
> > > > >
> > > > > BTW, the name 'randomOrderedKey' is ambiguous, may change to '
> > > > > randomOrderedRow'?
> > > > >
> > > > > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> > > > >
> > > > > > I'm not able to get a clean unit test run when building from
> source
> > > > using
> > > > > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe
> > > more
> > > > > but
> > > > > > the build doesn't get past hbase-server. Maybe these are known
> > > issues?
> > > > If
> > > > > > not I'll dig in when I get some time.
> > > > > >
> > > > > >
> > > > > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org>
> > > > wrote:
> > > > > >
> > > > > > > It gives me great pleasure to announce that the sixth release
> > > > candidate
> > > > > > for
> > > > > > > the release
> > > > > > > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > > > > > >
> > > > > > > Maven artifacts are also available in the temporary repository
> > > > > > >
> > > >
> https://repository.apache.org/content/repositories/orgapachehbase-1065
> > > > > > >
> > > > > > > Signed with my code signing key E964B5FF. Can be found here:
> > > > > > > https://people.apache.org/keys/committer/enis.asc
> > > > > > >
> > > > > > > Signed tag in the repository can be found here:
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > > > > > >
> > > > > > > HBase 1.0.0 is the next stable release, and the start of
> > "semantic
> > > > > > > versioned"
> > > > > > > releases (See [1]).
> > > > > > >
> > > > > > > The theme of 1.0.0 release is to become a stable base for
> future
> > > 1.x
> > > > > > series
> > > > > > > of releases. We aim to achieve at least the same level of
> > stability
> > > > of
> > > > > > 0.98
> > > > > > > releases.
> > > > > > >
> > > > > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release.
> > Together
> > > > > with
> > > > > > > the
> > > > > > > previous 0.99.x releases, major changes in 1.0.0 are listed
> (but
> > > not
> > > > > > > limited to)
> > > > > > > below. Note that all previous 0.99.x releases are developer
> > preview
> > > > > > > releases, and will
> > > > > > > NOT be supported in any form.
> > > > > > >
> > > > > > > API Cleanup and changes
> > > > > > > 1.0.0 introduces new APIs, and deprecates some of
> commonly-used
> > > > > > > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > > > > > > We advise to update your application to use the new style of
> > > APIs,
> > > > > > since
> > > > > > > deprecated APIs might be removed in future releases (2.x).
> See
> > > [2]
> > > > > and
> > > > > > > [3]
> > > > > > > for an overview of changes. All Client side API's are marked
> > with
> > > > > > > InterfaceAudience.Public class, indicating that the
> > class/method
> > > is
> > > > > an
> > > > > > > official "client API" for HBase. All 1.x releases are planned
> > to
> > > be
> > > > > API
> > > > > > > compatible for these classes. See [1] for an overview.
> > > > > > >
> > > > > > > Master runs a Region Server as well
> > > > > > > Starting with 1.0.0, the HBase master server and backup
> master
> > > > > servers
> > > > > > > will
> > > > > > > also act as a region server. RPC port and info port for web
> UI
> > is
> > > > > > shared
> > > > > > > for
> > > > > > > the master and region server roles. Active master can host
> > > regions
> > > > of
> > > > > > > defined tables if configured (disabled by default). Backup
> > > masters
> > > > > will
> > > > > > > not
> > > > > > > host regions.
> > > > > > >
> > > > > > > Read availability using timeline consistent region replicas
> > > > > > > This release contains Phase 1 items for experimental "Read
> > > > > availability
> > > > > > > using
> > > > > > > timeline consistent region replicas" feature. A region can be
> > > > hosted
> > > > > in
> > > > > > > multiple region servers in read-only mode. One of the
> replicas
> > > for
> > > > > the
> > > > > > > region
> > > > > > > will be primary, accepting writes, and other replicas will be
> > > > sharing
> > > > > > the
> > > > > > > same
> > > > > > > data files. Read requests can be done against any replica for
> > the
> > > > > > region
> > > > > > > with
> > > > > > > backup RPCs for high availability with timeline consistency
> > > > > guarantees.
> > > > > > > More
> > > > > > > information can be found at HBASE-10070.
> > > > > > >
> > > > > > > Online config change and other forward ports from 0.89-fb
> branch
> > > > > > > HBASE-12147 forward ported online config change which enables
> > > some
> > > > of
> > > > > > the
> > > > > > > configuration from the server to be reloaded without
> restarting
> > > the
> > > > > > > region
> > > > > > > servers.
> > > > > > >
> > > > > > > Other notable improvements in 1.0.0 (including previous 0.99.x)
> > are
> > > > > > > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > > > > > > - Automatic tuning of global memstore and block cache sizes
> > > > > > > - Various security, tags and visibility labels improvements
> > > > > > > - Bucket cache improvements (usability and compressed data
> > blocks)
> > > > > > > - A new pluggable replication endpoint to plug in to HBase's
> > > > > > inter-cluster
> > > > > > > replication to replicate to a custom data store
> > > > > > > - A Dockerfile to easily build and run HBase from source
> > > > > > > - Truncate table command
> > > > > > > - Region assignment to use hbase:meta table instead of
> zookeeper
> > > for
> > > > > > > faster
> > > > > > > region assignment (disabled by default)
> > > > > > > - Extensive documentation improvements
> > > > > > > - [HBASE-12511] - namespace permissions - add support from
> table
> > > > > > creation
> > > > > > > privilege in a namespace 'C'
> > > > > > > - [HBASE-12568] - Adopt Semantic Versioning and document it in
> > the
> > > > > book
> > > > > > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for
> > > Thrift
> > > > > > Server
> > > > > > > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer
> > with
> > > > > online
> > > > > > > configuration capability' to branch-1
> > > > > > > - [HBASE-10560] - Per cell TTLs
> > > > > > > - [HBASE-11997] - CopyTable with bulkload
> > > > > > > - [HBASE-11990] - Make setting the start and stop row for a
> > > specific
> > > > > > > prefix easier
> > > > > > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > > > > > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > > > > > > - [HBASE-12032] - Script to stop regionservers via RPC
> > > > > > > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> > > > > j.u.regex
> > > > > > > in RegexStringComparator
> > > > > > > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > > > > > > - [HBASE-11804] - Raise default heap size if unspecified
> > > > > > > - [HBASE-11890] - HBase REST Client is hard coded to http
> > protocol
> > > > > > > - [HBASE-12126] - Region server coprocessor endpoint
> > > > > > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > > > > > > - [HBASE-12075] - Preemptive Fast Fail
> > > > > > > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > > > > > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> > > > > MIN_VERSIONS
> > > > > > > - [HBASE-12434] - Add a command to compact all the regions in
> a
> > > > > > > regionserver
> > > > > > > - [HBASE-8707] - Add LongComparator for filter
> > > > > > > - [HBASE-12286] - [shell] Add server/cluster online load of
> > > > > > configuration
> > > > > > > changes
> > > > > > > - [HBASE-12361] - Show data locality of region in table page
> > > > > > > - [HBASE-12496] - A blockedRequestsCount metric
> > > > > > > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> > > > > mechanism)
> > > > > > to
> > > > > > > branch-1
> > > > > > > - [HBASE-12731] - Heap occupancy based client pushback
> > > > > > > - [HBASE-12728] - buffered writes substantially less useful
> > after
> > > > > > removal
> > > > > > > of HTablePool
> > > > > > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > > > > > > - Various fixes to REST server
> > > > > > > - Internal refactoring for abstracting away zookeeper usage
> > > > > > > - Better support for Cell interface internally in read and
> write
> > > > paths
> > > > > > for
> > > > > > > better performance and flexibility
> > > > > > > - Combining internal mvcc and seqId infrastructure
> > > > > > > - Ring buffer based WAL improvements
> > > > > > > - Switch to using new style of client APIs internally (in a
> lot
> > of
> > > > > > places)
> > > > > > > - Improvements in visibility labels
> > > > > > > - Perf improvements
> > > > > > > - Numerous improvements in other areas and bug fixes.
> > > > > > >
> > > > > > > 1.0.0 release has these changes in default behavior (see [4])
> > > > > > > - Zookeeper 3.4.x is required
> > > > > > > - Hadoop-2.x is required
> > > > > > > - JDK-1.7 is required
> > > > > > > - Default ports have changed from 600XX range into out of
> > > ephemeral
> > > > > > 160XX
> > > > > > > range.
> > > > > > > - Hfile version 3 has been enabled by default.
> > > > > > > - Slab cache has been removed (use bucket cache instead)
> > > > > > > - Default heap for region servers (and master) is changed from
> > 1GB
> > > > to
> > > > > > > the jdk's default. On most platforms, it will default to 1/4
> > of
> > > > > > physical
> > > > > > > memory
> > > > > > > - Some client facing APIs (HTableInterface, etc) has been
> > > deprecated
> > > > > and
> > > > > > > replaced.
> > > > > > > - Custom Filter implementations should switch to using the new
> > > > > > recommended
> > > > > > > APIs.
> > > > > > > - Some authorization permissions (especially regarding
> > namespaces)
> > > > > have
> > > > > > > been
> > > > > > > changed (HBASE-12511, HBASE-8015)
> > > > > > > - Mapred package and classes under there has been
> un-deprecated.
> > > > > > > - Two new modules (jar files): hbase-annotations and
> > hbase-rest.
> > > > > > > - HTrace dependency is moved to the Apache artifacts (
> > > > > > > https://htrace.incubator.apache.org/)
> > > > > > > - Various updates to dependency versions
> > > > > > >
> > > > > > > Full list of the issues can be found at:
> > > > > > > - 1.0.0 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > > > > > > - 0.99.2 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > > > > > > - 0.99.1 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > > > > > > - 0.99.0 issues :
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > > > > > >
> > > > > > > Compatibility
> > > > > > > -------------
> > > > > > > Source Compatibility:
> > > > > > > Client side code in HBase-1.0.0 is (mostly) source compatible
> > with
> > > > > > earlier
> > > > > > > versions. Some minor API changes might be needed from the
> client
> > > > side.
> > > > > > >
> > > > > > >
> > > > > > > Wire Compatibility:
> > > > > > > HBase-1.0.0 release is wire compatible with 0.98.x releases.
> > > Clients
> > > > > and
> > > > > > > servers running in different versions as long as new features
> are
> > > not
> > > > > > used
> > > > > > > should be possible.
> > > > > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as
> > > well.
> > > > > > 1.0.0
> > > > > > > introduces a new file format (hfile v3) that is enabled by
> > default
> > > > that
> > > > > > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96
> directly
> > > to
> > > > > > 1.0.0
> > > > > > > is
> > > > > > > not supported.
> > > > > > > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > > > > > >
> > > > > > > Binary Compatibility:
> > > > > > > Binary compatibility at the Java API layer with earlier
> versions
> > > > > (0.98.x,
> > > > > > > 0.96.x and 0.94.x) is not supported. You may have to recompile
> > your
> > > > > > client
> > > > > > > code and any server side code (coprocessors, filters etc)
> > referring
> > > > to
> > > > > > > hbase jars.
> > > > > > >
> > > > > > > Upgrading
> > > > > > > ---------
> > > > > > > See [4] for upgrade instructions and extended discussion on the
> > > > > changes.
> > > > > > >
> > > > > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling
> > > > upgrade
> > > > > > > fashion
> > > > > > > is supported.
> > > > > > >
> > > > > > > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown
> > and
> > > > > > restart
> > > > > > > of
> > > > > > > the cluster.
> > > > > > >
> > > > > > > From 0.94.x : Upgrade from 0.94.x is supported similar to
> upgrade
> > > > from
> > > > > > > 0.94 -> 0.96. The upgrade script should be run to rewrite
> cluster
> > > > level
> > > > > > > metadata.
> > > > > > > See [5] for details.
> > > > > > >
> > > > > > >
> > > > > > > Supported Hadoop versions
> > > > > > > -------------------------
> > > > > > > 1.0.0 release drops support for Hadoop-1.x releases. Only
> > > Hadoop-2.x
> > > > > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and
> > Hadoop-2.6.x
> > > > > > > releases
> > > > > > > are the most tested hadoop releases and we recommend running
> with
> > > > those
> > > > > > > versions
> > > > > > > (or later versions). Earlier Hadoop-2 based releases
> > (hadoop-2.2.x
> > > > and
> > > > > > > 2.3.x)
> > > > > > > are not tested to the full extend. More information can be
> found
> > > > here:
> > > > > > > https://hbase.apache.org/book/configuration.html#hadoop
> > > > > > >
> > > > > > >
> > > > > > > Supported Java versions
> > > > > > > -------------------------
> > > > > > > 1.0.0 release drops support for JDK6. Only JDK7 is supported.
> > JDK8
> > > > > > support
> > > > > > > is experimental. More information can be found here:
> > > > > > > https://hbase.apache.org/book/configuration.html#java
> > > > > > >
> > > > > > >
> > > > > > > Voting
> > > > > > > ------
> > > > > > > Please try to test and vote on this release by Feb 19 2015
> > 11:59PM
> > > > PDT.
> > > > > > > We will have a 5 day voting period because this is the sixth
> RC.
> > > > Please
> > > > > > try
> > > > > > > to
> > > > > > > spend some time for testing this important release.
> > > > > > >
> > > > > > > [] +1 Release the artifacts as 1.0.0
> > > > > > > [] -1 DO NOT release the artifacts as 1.0.0, because...
> > > > > > >
> > > > > > > Gratitute
> > > > > > > ---------
> > > > > > > Last but not least, 1.0.0 release has been in a long time
> making
> > > with
> > > > > > > contributions from a very large group of awesome people and
> hard
> > > work
> > > > > > from
> > > > > > > committers and contributors. We would like to extend our thanks
> > to
> > > > > > > everybody
> > > > > > > who worked on this release or contributed to HBase over the
> > years.
> > > > > > >
> > > > > > >
> > > > > > > References
> > > > > > > ----------
> > > > > > > [1]
> > https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > > > > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > > > > > > [3] http://s.apache.org/hbase-1.0-api
> > > > > > > [4]
> > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > > > > > > [5]
> > > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > > > > > >
> > > > > > > Enis
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Best regards,
> > > > > >
> > > > > > - Andy
> > > > > >
> > > > > > Problems worthy of attack prove their worth by hitting back. -
> Piet
> > > > Hein
> > > > > > (via Tom White)
> > > > > >
> > > > >
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Andrew Purtell <ap...@apache.org>.
Maybe its just me
On Thu, Feb 19, 2015 at 11:10 AM, Enis Söztutar <en...@gmail.com> wrote:
> I did not run the unit tests locally. I was relying on the following build
> which is 100% pass:
>
> https://builds.apache.org/view/All/job/HBase-1.0/746/
>
> It has the exact RC5 bits (6c98bff7b719efdb16f71606f3b7d8229445eb81). Let
> me kick a local UT run just in case.
>
> Enis
>
> On Thu, Feb 19, 2015 at 9:05 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > That list is missing unit testing. Did you happen to do that when
> building
> > but not mention it Enis? If so did they all pass for you?
> >
> > On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <en...@gmail.com>
> wrote:
> >
> > > Here is my RC5 testing so far:
> > >
> > > - checked checksums, sigs
> > > - checked the bin and src artifacts
> > > - checked layouts
> > > - checked java files in src tarball, and jar files in bin tarball
> > > - checked the book and the site (they are new style)
> > > - checked javadocs for both devapi and userapi
> > > - checked reported version, build time, revision
> > > - run some smoke tests using shell
> > > - started local mode
> > > - run LTT local mode
> > > - checked the webUIs of master and region servers
> > > - checked JMX dump and debug dump
> > > - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0 2.5.1
> > > 2.5.2 2.6.0
> > > - Deployed at a 6 node cluster with Hadoop-2.6.0
> > > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX encoding
> > > - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY compression
> > > - Tested with Bucket cache with 500M off heap
> > >
> > > I am still running larger scale tests, and some CM tests on the
> cluster.
> > > Will report back tomorrow and cast my vote.
> > >
> > > Enis
> > >
> > >
> > > On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <pa...@gmail.com> wrote:
> > >
> > > > TestCacheOnWrite itself has some problems. It
> > > > uses TestHFileWriterV2.randomOrderedKey to generate a random byte
> > array,
> > > > then use first 32 bytes as row and other parts as family and
> qualifier,
> > > but
> > > > TestHFileWriterV2.randomOrderedKey may return a byte array only
> > contains
> > > 32
> > > > bytes, so there will be family and qualifier with zero length.
> > > >
> > > > I do not know if this is the reason why this test is flaky since it
> > use a
> > > > Random with pre-defined seed so the random sequence should be
> stable. I
> > > can
> > > > modify the KeyValue generation part to see if it helps.
> > > >
> > > > BTW, the name 'randomOrderedKey' is ambiguous, may change to '
> > > > randomOrderedRow'?
> > > >
> > > > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> > > >
> > > > > I'm not able to get a clean unit test run when building from source
> > > using
> > > > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe
> > more
> > > > but
> > > > > the build doesn't get past hbase-server. Maybe these are known
> > issues?
> > > If
> > > > > not I'll dig in when I get some time.
> > > > >
> > > > >
> > > > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org>
> > > wrote:
> > > > >
> > > > > > It gives me great pleasure to announce that the sixth release
> > > candidate
> > > > > for
> > > > > > the release
> > > > > > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > > > > >
> > > > > > Maven artifacts are also available in the temporary repository
> > > > > >
> > > https://repository.apache.org/content/repositories/orgapachehbase-1065
> > > > > >
> > > > > > Signed with my code signing key E964B5FF. Can be found here:
> > > > > > https://people.apache.org/keys/committer/enis.asc
> > > > > >
> > > > > > Signed tag in the repository can be found here:
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > > > > >
> > > > > > HBase 1.0.0 is the next stable release, and the start of
> "semantic
> > > > > > versioned"
> > > > > > releases (See [1]).
> > > > > >
> > > > > > The theme of 1.0.0 release is to become a stable base for future
> > 1.x
> > > > > series
> > > > > > of releases. We aim to achieve at least the same level of
> stability
> > > of
> > > > > 0.98
> > > > > > releases.
> > > > > >
> > > > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release.
> Together
> > > > with
> > > > > > the
> > > > > > previous 0.99.x releases, major changes in 1.0.0 are listed (but
> > not
> > > > > > limited to)
> > > > > > below. Note that all previous 0.99.x releases are developer
> preview
> > > > > > releases, and will
> > > > > > NOT be supported in any form.
> > > > > >
> > > > > > API Cleanup and changes
> > > > > > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > > > > > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > > > > > We advise to update your application to use the new style of
> > APIs,
> > > > > since
> > > > > > deprecated APIs might be removed in future releases (2.x). See
> > [2]
> > > > and
> > > > > > [3]
> > > > > > for an overview of changes. All Client side API's are marked
> with
> > > > > > InterfaceAudience.Public class, indicating that the
> class/method
> > is
> > > > an
> > > > > > official "client API" for HBase. All 1.x releases are planned
> to
> > be
> > > > API
> > > > > > compatible for these classes. See [1] for an overview.
> > > > > >
> > > > > > Master runs a Region Server as well
> > > > > > Starting with 1.0.0, the HBase master server and backup master
> > > > servers
> > > > > > will
> > > > > > also act as a region server. RPC port and info port for web UI
> is
> > > > > shared
> > > > > > for
> > > > > > the master and region server roles. Active master can host
> > regions
> > > of
> > > > > > defined tables if configured (disabled by default). Backup
> > masters
> > > > will
> > > > > > not
> > > > > > host regions.
> > > > > >
> > > > > > Read availability using timeline consistent region replicas
> > > > > > This release contains Phase 1 items for experimental "Read
> > > > availability
> > > > > > using
> > > > > > timeline consistent region replicas" feature. A region can be
> > > hosted
> > > > in
> > > > > > multiple region servers in read-only mode. One of the replicas
> > for
> > > > the
> > > > > > region
> > > > > > will be primary, accepting writes, and other replicas will be
> > > sharing
> > > > > the
> > > > > > same
> > > > > > data files. Read requests can be done against any replica for
> the
> > > > > region
> > > > > > with
> > > > > > backup RPCs for high availability with timeline consistency
> > > > guarantees.
> > > > > > More
> > > > > > information can be found at HBASE-10070.
> > > > > >
> > > > > > Online config change and other forward ports from 0.89-fb branch
> > > > > > HBASE-12147 forward ported online config change which enables
> > some
> > > of
> > > > > the
> > > > > > configuration from the server to be reloaded without restarting
> > the
> > > > > > region
> > > > > > servers.
> > > > > >
> > > > > > Other notable improvements in 1.0.0 (including previous 0.99.x)
> are
> > > > > > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > > > > > - Automatic tuning of global memstore and block cache sizes
> > > > > > - Various security, tags and visibility labels improvements
> > > > > > - Bucket cache improvements (usability and compressed data
> blocks)
> > > > > > - A new pluggable replication endpoint to plug in to HBase's
> > > > > inter-cluster
> > > > > > replication to replicate to a custom data store
> > > > > > - A Dockerfile to easily build and run HBase from source
> > > > > > - Truncate table command
> > > > > > - Region assignment to use hbase:meta table instead of zookeeper
> > for
> > > > > > faster
> > > > > > region assignment (disabled by default)
> > > > > > - Extensive documentation improvements
> > > > > > - [HBASE-12511] - namespace permissions - add support from table
> > > > > creation
> > > > > > privilege in a namespace 'C'
> > > > > > - [HBASE-12568] - Adopt Semantic Versioning and document it in
> the
> > > > book
> > > > > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for
> > Thrift
> > > > > Server
> > > > > > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer
> with
> > > > online
> > > > > > configuration capability' to branch-1
> > > > > > - [HBASE-10560] - Per cell TTLs
> > > > > > - [HBASE-11997] - CopyTable with bulkload
> > > > > > - [HBASE-11990] - Make setting the start and stop row for a
> > specific
> > > > > > prefix easier
> > > > > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > > > > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > > > > > - [HBASE-12032] - Script to stop regionservers via RPC
> > > > > > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> > > > j.u.regex
> > > > > > in RegexStringComparator
> > > > > > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > > > > > - [HBASE-11804] - Raise default heap size if unspecified
> > > > > > - [HBASE-11890] - HBase REST Client is hard coded to http
> protocol
> > > > > > - [HBASE-12126] - Region server coprocessor endpoint
> > > > > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > > > > > - [HBASE-12075] - Preemptive Fast Fail
> > > > > > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > > > > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> > > > MIN_VERSIONS
> > > > > > - [HBASE-12434] - Add a command to compact all the regions in a
> > > > > > regionserver
> > > > > > - [HBASE-8707] - Add LongComparator for filter
> > > > > > - [HBASE-12286] - [shell] Add server/cluster online load of
> > > > > configuration
> > > > > > changes
> > > > > > - [HBASE-12361] - Show data locality of region in table page
> > > > > > - [HBASE-12496] - A blockedRequestsCount metric
> > > > > > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> > > > mechanism)
> > > > > to
> > > > > > branch-1
> > > > > > - [HBASE-12731] - Heap occupancy based client pushback
> > > > > > - [HBASE-12728] - buffered writes substantially less useful
> after
> > > > > removal
> > > > > > of HTablePool
> > > > > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > > > > > - Various fixes to REST server
> > > > > > - Internal refactoring for abstracting away zookeeper usage
> > > > > > - Better support for Cell interface internally in read and write
> > > paths
> > > > > for
> > > > > > better performance and flexibility
> > > > > > - Combining internal mvcc and seqId infrastructure
> > > > > > - Ring buffer based WAL improvements
> > > > > > - Switch to using new style of client APIs internally (in a lot
> of
> > > > > places)
> > > > > > - Improvements in visibility labels
> > > > > > - Perf improvements
> > > > > > - Numerous improvements in other areas and bug fixes.
> > > > > >
> > > > > > 1.0.0 release has these changes in default behavior (see [4])
> > > > > > - Zookeeper 3.4.x is required
> > > > > > - Hadoop-2.x is required
> > > > > > - JDK-1.7 is required
> > > > > > - Default ports have changed from 600XX range into out of
> > ephemeral
> > > > > 160XX
> > > > > > range.
> > > > > > - Hfile version 3 has been enabled by default.
> > > > > > - Slab cache has been removed (use bucket cache instead)
> > > > > > - Default heap for region servers (and master) is changed from
> 1GB
> > > to
> > > > > > the jdk's default. On most platforms, it will default to 1/4
> of
> > > > > physical
> > > > > > memory
> > > > > > - Some client facing APIs (HTableInterface, etc) has been
> > deprecated
> > > > and
> > > > > > replaced.
> > > > > > - Custom Filter implementations should switch to using the new
> > > > > recommended
> > > > > > APIs.
> > > > > > - Some authorization permissions (especially regarding
> namespaces)
> > > > have
> > > > > > been
> > > > > > changed (HBASE-12511, HBASE-8015)
> > > > > > - Mapred package and classes under there has been un-deprecated.
> > > > > > - Two new modules (jar files): hbase-annotations and
> hbase-rest.
> > > > > > - HTrace dependency is moved to the Apache artifacts (
> > > > > > https://htrace.incubator.apache.org/)
> > > > > > - Various updates to dependency versions
> > > > > >
> > > > > > Full list of the issues can be found at:
> > > > > > - 1.0.0 issues :
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > > > > > - 0.99.2 issues :
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > > > > > - 0.99.1 issues :
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > > > > > - 0.99.0 issues :
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > > > > >
> > > > > > Compatibility
> > > > > > -------------
> > > > > > Source Compatibility:
> > > > > > Client side code in HBase-1.0.0 is (mostly) source compatible
> with
> > > > > earlier
> > > > > > versions. Some minor API changes might be needed from the client
> > > side.
> > > > > >
> > > > > >
> > > > > > Wire Compatibility:
> > > > > > HBase-1.0.0 release is wire compatible with 0.98.x releases.
> > Clients
> > > > and
> > > > > > servers running in different versions as long as new features are
> > not
> > > > > used
> > > > > > should be possible.
> > > > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as
> > well.
> > > > > 1.0.0
> > > > > > introduces a new file format (hfile v3) that is enabled by
> default
> > > that
> > > > > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly
> > to
> > > > > 1.0.0
> > > > > > is
> > > > > > not supported.
> > > > > > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > > > > >
> > > > > > Binary Compatibility:
> > > > > > Binary compatibility at the Java API layer with earlier versions
> > > > (0.98.x,
> > > > > > 0.96.x and 0.94.x) is not supported. You may have to recompile
> your
> > > > > client
> > > > > > code and any server side code (coprocessors, filters etc)
> referring
> > > to
> > > > > > hbase jars.
> > > > > >
> > > > > > Upgrading
> > > > > > ---------
> > > > > > See [4] for upgrade instructions and extended discussion on the
> > > > changes.
> > > > > >
> > > > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling
> > > upgrade
> > > > > > fashion
> > > > > > is supported.
> > > > > >
> > > > > > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown
> and
> > > > > restart
> > > > > > of
> > > > > > the cluster.
> > > > > >
> > > > > > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade
> > > from
> > > > > > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster
> > > level
> > > > > > metadata.
> > > > > > See [5] for details.
> > > > > >
> > > > > >
> > > > > > Supported Hadoop versions
> > > > > > -------------------------
> > > > > > 1.0.0 release drops support for Hadoop-1.x releases. Only
> > Hadoop-2.x
> > > > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and
> Hadoop-2.6.x
> > > > > > releases
> > > > > > are the most tested hadoop releases and we recommend running with
> > > those
> > > > > > versions
> > > > > > (or later versions). Earlier Hadoop-2 based releases
> (hadoop-2.2.x
> > > and
> > > > > > 2.3.x)
> > > > > > are not tested to the full extend. More information can be found
> > > here:
> > > > > > https://hbase.apache.org/book/configuration.html#hadoop
> > > > > >
> > > > > >
> > > > > > Supported Java versions
> > > > > > -------------------------
> > > > > > 1.0.0 release drops support for JDK6. Only JDK7 is supported.
> JDK8
> > > > > support
> > > > > > is experimental. More information can be found here:
> > > > > > https://hbase.apache.org/book/configuration.html#java
> > > > > >
> > > > > >
> > > > > > Voting
> > > > > > ------
> > > > > > Please try to test and vote on this release by Feb 19 2015
> 11:59PM
> > > PDT.
> > > > > > We will have a 5 day voting period because this is the sixth RC.
> > > Please
> > > > > try
> > > > > > to
> > > > > > spend some time for testing this important release.
> > > > > >
> > > > > > [] +1 Release the artifacts as 1.0.0
> > > > > > [] -1 DO NOT release the artifacts as 1.0.0, because...
> > > > > >
> > > > > > Gratitute
> > > > > > ---------
> > > > > > Last but not least, 1.0.0 release has been in a long time making
> > with
> > > > > > contributions from a very large group of awesome people and hard
> > work
> > > > > from
> > > > > > committers and contributors. We would like to extend our thanks
> to
> > > > > > everybody
> > > > > > who worked on this release or contributed to HBase over the
> years.
> > > > > >
> > > > > >
> > > > > > References
> > > > > > ----------
> > > > > > [1]
> https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > > > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > > > > > [3] http://s.apache.org/hbase-1.0-api
> > > > > > [4]
> > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > > > > > [5]
> > > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > > > > >
> > > > > > Enis
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best regards,
> > > > >
> > > > > - Andy
> > > > >
> > > > > Problems worthy of attack prove their worth by hitting back. - Piet
> > > Hein
> > > > > (via Tom White)
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Enis Söztutar <en...@gmail.com>.
I did not run the unit tests locally. I was relying on the following build
which is 100% pass:
https://builds.apache.org/view/All/job/HBase-1.0/746/
It has the exact RC5 bits (6c98bff7b719efdb16f71606f3b7d8229445eb81). Let
me kick a local UT run just in case.
Enis
On Thu, Feb 19, 2015 at 9:05 AM, Andrew Purtell <ap...@apache.org> wrote:
> That list is missing unit testing. Did you happen to do that when building
> but not mention it Enis? If so did they all pass for you?
>
> On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <en...@gmail.com> wrote:
>
> > Here is my RC5 testing so far:
> >
> > - checked checksums, sigs
> > - checked the bin and src artifacts
> > - checked layouts
> > - checked java files in src tarball, and jar files in bin tarball
> > - checked the book and the site (they are new style)
> > - checked javadocs for both devapi and userapi
> > - checked reported version, build time, revision
> > - run some smoke tests using shell
> > - started local mode
> > - run LTT local mode
> > - checked the webUIs of master and region servers
> > - checked JMX dump and debug dump
> > - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0 2.5.1
> > 2.5.2 2.6.0
> > - Deployed at a 6 node cluster with Hadoop-2.6.0
> > - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX encoding
> > - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY compression
> > - Tested with Bucket cache with 500M off heap
> >
> > I am still running larger scale tests, and some CM tests on the cluster.
> > Will report back tomorrow and cast my vote.
> >
> > Enis
> >
> >
> > On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <pa...@gmail.com> wrote:
> >
> > > TestCacheOnWrite itself has some problems. It
> > > uses TestHFileWriterV2.randomOrderedKey to generate a random byte
> array,
> > > then use first 32 bytes as row and other parts as family and qualifier,
> > but
> > > TestHFileWriterV2.randomOrderedKey may return a byte array only
> contains
> > 32
> > > bytes, so there will be family and qualifier with zero length.
> > >
> > > I do not know if this is the reason why this test is flaky since it
> use a
> > > Random with pre-defined seed so the random sequence should be stable. I
> > can
> > > modify the KeyValue generation part to see if it helps.
> > >
> > > BTW, the name 'randomOrderedKey' is ambiguous, may change to '
> > > randomOrderedRow'?
> > >
> > > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> > >
> > > > I'm not able to get a clean unit test run when building from source
> > using
> > > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe
> more
> > > but
> > > > the build doesn't get past hbase-server. Maybe these are known
> issues?
> > If
> > > > not I'll dig in when I get some time.
> > > >
> > > >
> > > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org>
> > wrote:
> > > >
> > > > > It gives me great pleasure to announce that the sixth release
> > candidate
> > > > for
> > > > > the release
> > > > > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > > > >
> > > > > Maven artifacts are also available in the temporary repository
> > > > >
> > https://repository.apache.org/content/repositories/orgapachehbase-1065
> > > > >
> > > > > Signed with my code signing key E964B5FF. Can be found here:
> > > > > https://people.apache.org/keys/committer/enis.asc
> > > > >
> > > > > Signed tag in the repository can be found here:
> > > > >
> > > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > > > >
> > > > > HBase 1.0.0 is the next stable release, and the start of "semantic
> > > > > versioned"
> > > > > releases (See [1]).
> > > > >
> > > > > The theme of 1.0.0 release is to become a stable base for future
> 1.x
> > > > series
> > > > > of releases. We aim to achieve at least the same level of stability
> > of
> > > > 0.98
> > > > > releases.
> > > > >
> > > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together
> > > with
> > > > > the
> > > > > previous 0.99.x releases, major changes in 1.0.0 are listed (but
> not
> > > > > limited to)
> > > > > below. Note that all previous 0.99.x releases are developer preview
> > > > > releases, and will
> > > > > NOT be supported in any form.
> > > > >
> > > > > API Cleanup and changes
> > > > > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > > > > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > > > > We advise to update your application to use the new style of
> APIs,
> > > > since
> > > > > deprecated APIs might be removed in future releases (2.x). See
> [2]
> > > and
> > > > > [3]
> > > > > for an overview of changes. All Client side API's are marked with
> > > > > InterfaceAudience.Public class, indicating that the class/method
> is
> > > an
> > > > > official "client API" for HBase. All 1.x releases are planned to
> be
> > > API
> > > > > compatible for these classes. See [1] for an overview.
> > > > >
> > > > > Master runs a Region Server as well
> > > > > Starting with 1.0.0, the HBase master server and backup master
> > > servers
> > > > > will
> > > > > also act as a region server. RPC port and info port for web UI is
> > > > shared
> > > > > for
> > > > > the master and region server roles. Active master can host
> regions
> > of
> > > > > defined tables if configured (disabled by default). Backup
> masters
> > > will
> > > > > not
> > > > > host regions.
> > > > >
> > > > > Read availability using timeline consistent region replicas
> > > > > This release contains Phase 1 items for experimental "Read
> > > availability
> > > > > using
> > > > > timeline consistent region replicas" feature. A region can be
> > hosted
> > > in
> > > > > multiple region servers in read-only mode. One of the replicas
> for
> > > the
> > > > > region
> > > > > will be primary, accepting writes, and other replicas will be
> > sharing
> > > > the
> > > > > same
> > > > > data files. Read requests can be done against any replica for the
> > > > region
> > > > > with
> > > > > backup RPCs for high availability with timeline consistency
> > > guarantees.
> > > > > More
> > > > > information can be found at HBASE-10070.
> > > > >
> > > > > Online config change and other forward ports from 0.89-fb branch
> > > > > HBASE-12147 forward ported online config change which enables
> some
> > of
> > > > the
> > > > > configuration from the server to be reloaded without restarting
> the
> > > > > region
> > > > > servers.
> > > > >
> > > > > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > > > > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > > > > - Automatic tuning of global memstore and block cache sizes
> > > > > - Various security, tags and visibility labels improvements
> > > > > - Bucket cache improvements (usability and compressed data blocks)
> > > > > - A new pluggable replication endpoint to plug in to HBase's
> > > > inter-cluster
> > > > > replication to replicate to a custom data store
> > > > > - A Dockerfile to easily build and run HBase from source
> > > > > - Truncate table command
> > > > > - Region assignment to use hbase:meta table instead of zookeeper
> for
> > > > > faster
> > > > > region assignment (disabled by default)
> > > > > - Extensive documentation improvements
> > > > > - [HBASE-12511] - namespace permissions - add support from table
> > > > creation
> > > > > privilege in a namespace 'C'
> > > > > - [HBASE-12568] - Adopt Semantic Versioning and document it in the
> > > book
> > > > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for
> Thrift
> > > > Server
> > > > > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> > > online
> > > > > configuration capability' to branch-1
> > > > > - [HBASE-10560] - Per cell TTLs
> > > > > - [HBASE-11997] - CopyTable with bulkload
> > > > > - [HBASE-11990] - Make setting the start and stop row for a
> specific
> > > > > prefix easier
> > > > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > > > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > > > > - [HBASE-12032] - Script to stop regionservers via RPC
> > > > > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> > > j.u.regex
> > > > > in RegexStringComparator
> > > > > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > > > > - [HBASE-11804] - Raise default heap size if unspecified
> > > > > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > > > > - [HBASE-12126] - Region server coprocessor endpoint
> > > > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > > > > - [HBASE-12075] - Preemptive Fast Fail
> > > > > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > > > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> > > MIN_VERSIONS
> > > > > - [HBASE-12434] - Add a command to compact all the regions in a
> > > > > regionserver
> > > > > - [HBASE-8707] - Add LongComparator for filter
> > > > > - [HBASE-12286] - [shell] Add server/cluster online load of
> > > > configuration
> > > > > changes
> > > > > - [HBASE-12361] - Show data locality of region in table page
> > > > > - [HBASE-12496] - A blockedRequestsCount metric
> > > > > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> > > mechanism)
> > > > to
> > > > > branch-1
> > > > > - [HBASE-12731] - Heap occupancy based client pushback
> > > > > - [HBASE-12728] - buffered writes substantially less useful after
> > > > removal
> > > > > of HTablePool
> > > > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > > > > - Various fixes to REST server
> > > > > - Internal refactoring for abstracting away zookeeper usage
> > > > > - Better support for Cell interface internally in read and write
> > paths
> > > > for
> > > > > better performance and flexibility
> > > > > - Combining internal mvcc and seqId infrastructure
> > > > > - Ring buffer based WAL improvements
> > > > > - Switch to using new style of client APIs internally (in a lot of
> > > > places)
> > > > > - Improvements in visibility labels
> > > > > - Perf improvements
> > > > > - Numerous improvements in other areas and bug fixes.
> > > > >
> > > > > 1.0.0 release has these changes in default behavior (see [4])
> > > > > - Zookeeper 3.4.x is required
> > > > > - Hadoop-2.x is required
> > > > > - JDK-1.7 is required
> > > > > - Default ports have changed from 600XX range into out of
> ephemeral
> > > > 160XX
> > > > > range.
> > > > > - Hfile version 3 has been enabled by default.
> > > > > - Slab cache has been removed (use bucket cache instead)
> > > > > - Default heap for region servers (and master) is changed from 1GB
> > to
> > > > > the jdk's default. On most platforms, it will default to 1/4 of
> > > > physical
> > > > > memory
> > > > > - Some client facing APIs (HTableInterface, etc) has been
> deprecated
> > > and
> > > > > replaced.
> > > > > - Custom Filter implementations should switch to using the new
> > > > recommended
> > > > > APIs.
> > > > > - Some authorization permissions (especially regarding namespaces)
> > > have
> > > > > been
> > > > > changed (HBASE-12511, HBASE-8015)
> > > > > - Mapred package and classes under there has been un-deprecated.
> > > > > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > > > > - HTrace dependency is moved to the Apache artifacts (
> > > > > https://htrace.incubator.apache.org/)
> > > > > - Various updates to dependency versions
> > > > >
> > > > > Full list of the issues can be found at:
> > > > > - 1.0.0 issues :
> > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > > > > - 0.99.2 issues :
> > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > > > > - 0.99.1 issues :
> > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > > > > - 0.99.0 issues :
> > > > >
> > > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > > > >
> > > > > Compatibility
> > > > > -------------
> > > > > Source Compatibility:
> > > > > Client side code in HBase-1.0.0 is (mostly) source compatible with
> > > > earlier
> > > > > versions. Some minor API changes might be needed from the client
> > side.
> > > > >
> > > > >
> > > > > Wire Compatibility:
> > > > > HBase-1.0.0 release is wire compatible with 0.98.x releases.
> Clients
> > > and
> > > > > servers running in different versions as long as new features are
> not
> > > > used
> > > > > should be possible.
> > > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as
> well.
> > > > 1.0.0
> > > > > introduces a new file format (hfile v3) that is enabled by default
> > that
> > > > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly
> to
> > > > 1.0.0
> > > > > is
> > > > > not supported.
> > > > > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > > > >
> > > > > Binary Compatibility:
> > > > > Binary compatibility at the Java API layer with earlier versions
> > > (0.98.x,
> > > > > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> > > > client
> > > > > code and any server side code (coprocessors, filters etc) referring
> > to
> > > > > hbase jars.
> > > > >
> > > > > Upgrading
> > > > > ---------
> > > > > See [4] for upgrade instructions and extended discussion on the
> > > changes.
> > > > >
> > > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling
> > upgrade
> > > > > fashion
> > > > > is supported.
> > > > >
> > > > > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> > > > restart
> > > > > of
> > > > > the cluster.
> > > > >
> > > > > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade
> > from
> > > > > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster
> > level
> > > > > metadata.
> > > > > See [5] for details.
> > > > >
> > > > >
> > > > > Supported Hadoop versions
> > > > > -------------------------
> > > > > 1.0.0 release drops support for Hadoop-1.x releases. Only
> Hadoop-2.x
> > > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > > > > releases
> > > > > are the most tested hadoop releases and we recommend running with
> > those
> > > > > versions
> > > > > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x
> > and
> > > > > 2.3.x)
> > > > > are not tested to the full extend. More information can be found
> > here:
> > > > > https://hbase.apache.org/book/configuration.html#hadoop
> > > > >
> > > > >
> > > > > Supported Java versions
> > > > > -------------------------
> > > > > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> > > > support
> > > > > is experimental. More information can be found here:
> > > > > https://hbase.apache.org/book/configuration.html#java
> > > > >
> > > > >
> > > > > Voting
> > > > > ------
> > > > > Please try to test and vote on this release by Feb 19 2015 11:59PM
> > PDT.
> > > > > We will have a 5 day voting period because this is the sixth RC.
> > Please
> > > > try
> > > > > to
> > > > > spend some time for testing this important release.
> > > > >
> > > > > [] +1 Release the artifacts as 1.0.0
> > > > > [] -1 DO NOT release the artifacts as 1.0.0, because...
> > > > >
> > > > > Gratitute
> > > > > ---------
> > > > > Last but not least, 1.0.0 release has been in a long time making
> with
> > > > > contributions from a very large group of awesome people and hard
> work
> > > > from
> > > > > committers and contributors. We would like to extend our thanks to
> > > > > everybody
> > > > > who worked on this release or contributed to HBase over the years.
> > > > >
> > > > >
> > > > > References
> > > > > ----------
> > > > > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > > > > [3] http://s.apache.org/hbase-1.0-api
> > > > > [4]
> https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > > > > [5]
> > https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > > > >
> > > > > Enis
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Best regards,
> > > >
> > > > - Andy
> > > >
> > > > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein
> > > > (via Tom White)
> > > >
> > >
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Andrew Purtell <ap...@apache.org>.
That list is missing unit testing. Did you happen to do that when building
but not mention it Enis? If so did they all pass for you?
On Wed, Feb 18, 2015 at 7:48 PM, Enis Söztutar <en...@gmail.com> wrote:
> Here is my RC5 testing so far:
>
> - checked checksums, sigs
> - checked the bin and src artifacts
> - checked layouts
> - checked java files in src tarball, and jar files in bin tarball
> - checked the book and the site (they are new style)
> - checked javadocs for both devapi and userapi
> - checked reported version, build time, revision
> - run some smoke tests using shell
> - started local mode
> - run LTT local mode
> - checked the webUIs of master and region servers
> - checked JMX dump and debug dump
> - Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0 2.5.1
> 2.5.2 2.6.0
> - Deployed at a 6 node cluster with Hadoop-2.6.0
> - Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX encoding
> - Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY compression
> - Tested with Bucket cache with 500M off heap
>
> I am still running larger scale tests, and some CM tests on the cluster.
> Will report back tomorrow and cast my vote.
>
> Enis
>
>
> On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <pa...@gmail.com> wrote:
>
> > TestCacheOnWrite itself has some problems. It
> > uses TestHFileWriterV2.randomOrderedKey to generate a random byte array,
> > then use first 32 bytes as row and other parts as family and qualifier,
> but
> > TestHFileWriterV2.randomOrderedKey may return a byte array only contains
> 32
> > bytes, so there will be family and qualifier with zero length.
> >
> > I do not know if this is the reason why this test is flaky since it use a
> > Random with pre-defined seed so the random sequence should be stable. I
> can
> > modify the KeyValue generation part to see if it helps.
> >
> > BTW, the name 'randomOrderedKey' is ambiguous, may change to '
> > randomOrderedRow'?
> >
> > 2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> >
> > > I'm not able to get a clean unit test run when building from source
> using
> > > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe more
> > but
> > > the build doesn't get past hbase-server. Maybe these are known issues?
> If
> > > not I'll dig in when I get some time.
> > >
> > >
> > > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org>
> wrote:
> > >
> > > > It gives me great pleasure to announce that the sixth release
> candidate
> > > for
> > > > the release
> > > > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > > >
> > > > Maven artifacts are also available in the temporary repository
> > > >
> https://repository.apache.org/content/repositories/orgapachehbase-1065
> > > >
> > > > Signed with my code signing key E964B5FF. Can be found here:
> > > > https://people.apache.org/keys/committer/enis.asc
> > > >
> > > > Signed tag in the repository can be found here:
> > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > > >
> > > > HBase 1.0.0 is the next stable release, and the start of "semantic
> > > > versioned"
> > > > releases (See [1]).
> > > >
> > > > The theme of 1.0.0 release is to become a stable base for future 1.x
> > > series
> > > > of releases. We aim to achieve at least the same level of stability
> of
> > > 0.98
> > > > releases.
> > > >
> > > > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together
> > with
> > > > the
> > > > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > > > limited to)
> > > > below. Note that all previous 0.99.x releases are developer preview
> > > > releases, and will
> > > > NOT be supported in any form.
> > > >
> > > > API Cleanup and changes
> > > > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > > > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > > > We advise to update your application to use the new style of APIs,
> > > since
> > > > deprecated APIs might be removed in future releases (2.x). See [2]
> > and
> > > > [3]
> > > > for an overview of changes. All Client side API's are marked with
> > > > InterfaceAudience.Public class, indicating that the class/method is
> > an
> > > > official "client API" for HBase. All 1.x releases are planned to be
> > API
> > > > compatible for these classes. See [1] for an overview.
> > > >
> > > > Master runs a Region Server as well
> > > > Starting with 1.0.0, the HBase master server and backup master
> > servers
> > > > will
> > > > also act as a region server. RPC port and info port for web UI is
> > > shared
> > > > for
> > > > the master and region server roles. Active master can host regions
> of
> > > > defined tables if configured (disabled by default). Backup masters
> > will
> > > > not
> > > > host regions.
> > > >
> > > > Read availability using timeline consistent region replicas
> > > > This release contains Phase 1 items for experimental "Read
> > availability
> > > > using
> > > > timeline consistent region replicas" feature. A region can be
> hosted
> > in
> > > > multiple region servers in read-only mode. One of the replicas for
> > the
> > > > region
> > > > will be primary, accepting writes, and other replicas will be
> sharing
> > > the
> > > > same
> > > > data files. Read requests can be done against any replica for the
> > > region
> > > > with
> > > > backup RPCs for high availability with timeline consistency
> > guarantees.
> > > > More
> > > > information can be found at HBASE-10070.
> > > >
> > > > Online config change and other forward ports from 0.89-fb branch
> > > > HBASE-12147 forward ported online config change which enables some
> of
> > > the
> > > > configuration from the server to be reloaded without restarting the
> > > > region
> > > > servers.
> > > >
> > > > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > > > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > > > - Automatic tuning of global memstore and block cache sizes
> > > > - Various security, tags and visibility labels improvements
> > > > - Bucket cache improvements (usability and compressed data blocks)
> > > > - A new pluggable replication endpoint to plug in to HBase's
> > > inter-cluster
> > > > replication to replicate to a custom data store
> > > > - A Dockerfile to easily build and run HBase from source
> > > > - Truncate table command
> > > > - Region assignment to use hbase:meta table instead of zookeeper for
> > > > faster
> > > > region assignment (disabled by default)
> > > > - Extensive documentation improvements
> > > > - [HBASE-12511] - namespace permissions - add support from table
> > > creation
> > > > privilege in a namespace 'C'
> > > > - [HBASE-12568] - Adopt Semantic Versioning and document it in the
> > book
> > > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> > > Server
> > > > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> > online
> > > > configuration capability' to branch-1
> > > > - [HBASE-10560] - Per cell TTLs
> > > > - [HBASE-11997] - CopyTable with bulkload
> > > > - [HBASE-11990] - Make setting the start and stop row for a specific
> > > > prefix easier
> > > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > > > - [HBASE-12032] - Script to stop regionservers via RPC
> > > > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> > j.u.regex
> > > > in RegexStringComparator
> > > > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > > > - [HBASE-11804] - Raise default heap size if unspecified
> > > > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > > > - [HBASE-12126] - Region server coprocessor endpoint
> > > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > > > - [HBASE-12075] - Preemptive Fast Fail
> > > > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> > MIN_VERSIONS
> > > > - [HBASE-12434] - Add a command to compact all the regions in a
> > > > regionserver
> > > > - [HBASE-8707] - Add LongComparator for filter
> > > > - [HBASE-12286] - [shell] Add server/cluster online load of
> > > configuration
> > > > changes
> > > > - [HBASE-12361] - Show data locality of region in table page
> > > > - [HBASE-12496] - A blockedRequestsCount metric
> > > > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> > mechanism)
> > > to
> > > > branch-1
> > > > - [HBASE-12731] - Heap occupancy based client pushback
> > > > - [HBASE-12728] - buffered writes substantially less useful after
> > > removal
> > > > of HTablePool
> > > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > > > - Various fixes to REST server
> > > > - Internal refactoring for abstracting away zookeeper usage
> > > > - Better support for Cell interface internally in read and write
> paths
> > > for
> > > > better performance and flexibility
> > > > - Combining internal mvcc and seqId infrastructure
> > > > - Ring buffer based WAL improvements
> > > > - Switch to using new style of client APIs internally (in a lot of
> > > places)
> > > > - Improvements in visibility labels
> > > > - Perf improvements
> > > > - Numerous improvements in other areas and bug fixes.
> > > >
> > > > 1.0.0 release has these changes in default behavior (see [4])
> > > > - Zookeeper 3.4.x is required
> > > > - Hadoop-2.x is required
> > > > - JDK-1.7 is required
> > > > - Default ports have changed from 600XX range into out of ephemeral
> > > 160XX
> > > > range.
> > > > - Hfile version 3 has been enabled by default.
> > > > - Slab cache has been removed (use bucket cache instead)
> > > > - Default heap for region servers (and master) is changed from 1GB
> to
> > > > the jdk's default. On most platforms, it will default to 1/4 of
> > > physical
> > > > memory
> > > > - Some client facing APIs (HTableInterface, etc) has been deprecated
> > and
> > > > replaced.
> > > > - Custom Filter implementations should switch to using the new
> > > recommended
> > > > APIs.
> > > > - Some authorization permissions (especially regarding namespaces)
> > have
> > > > been
> > > > changed (HBASE-12511, HBASE-8015)
> > > > - Mapred package and classes under there has been un-deprecated.
> > > > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > > > - HTrace dependency is moved to the Apache artifacts (
> > > > https://htrace.incubator.apache.org/)
> > > > - Various updates to dependency versions
> > > >
> > > > Full list of the issues can be found at:
> > > > - 1.0.0 issues :
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > > > - 0.99.2 issues :
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > > > - 0.99.1 issues :
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > > > - 0.99.0 issues :
> > > >
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > > >
> > > > Compatibility
> > > > -------------
> > > > Source Compatibility:
> > > > Client side code in HBase-1.0.0 is (mostly) source compatible with
> > > earlier
> > > > versions. Some minor API changes might be needed from the client
> side.
> > > >
> > > >
> > > > Wire Compatibility:
> > > > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients
> > and
> > > > servers running in different versions as long as new features are not
> > > used
> > > > should be possible.
> > > > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> > > 1.0.0
> > > > introduces a new file format (hfile v3) that is enabled by default
> that
> > > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> > > 1.0.0
> > > > is
> > > > not supported.
> > > > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > > >
> > > > Binary Compatibility:
> > > > Binary compatibility at the Java API layer with earlier versions
> > (0.98.x,
> > > > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> > > client
> > > > code and any server side code (coprocessors, filters etc) referring
> to
> > > > hbase jars.
> > > >
> > > > Upgrading
> > > > ---------
> > > > See [4] for upgrade instructions and extended discussion on the
> > changes.
> > > >
> > > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling
> upgrade
> > > > fashion
> > > > is supported.
> > > >
> > > > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> > > restart
> > > > of
> > > > the cluster.
> > > >
> > > > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade
> from
> > > > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster
> level
> > > > metadata.
> > > > See [5] for details.
> > > >
> > > >
> > > > Supported Hadoop versions
> > > > -------------------------
> > > > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > > > releases
> > > > are the most tested hadoop releases and we recommend running with
> those
> > > > versions
> > > > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x
> and
> > > > 2.3.x)
> > > > are not tested to the full extend. More information can be found
> here:
> > > > https://hbase.apache.org/book/configuration.html#hadoop
> > > >
> > > >
> > > > Supported Java versions
> > > > -------------------------
> > > > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> > > support
> > > > is experimental. More information can be found here:
> > > > https://hbase.apache.org/book/configuration.html#java
> > > >
> > > >
> > > > Voting
> > > > ------
> > > > Please try to test and vote on this release by Feb 19 2015 11:59PM
> PDT.
> > > > We will have a 5 day voting period because this is the sixth RC.
> Please
> > > try
> > > > to
> > > > spend some time for testing this important release.
> > > >
> > > > [] +1 Release the artifacts as 1.0.0
> > > > [] -1 DO NOT release the artifacts as 1.0.0, because...
> > > >
> > > > Gratitute
> > > > ---------
> > > > Last but not least, 1.0.0 release has been in a long time making with
> > > > contributions from a very large group of awesome people and hard work
> > > from
> > > > committers and contributors. We would like to extend our thanks to
> > > > everybody
> > > > who worked on this release or contributed to HBase over the years.
> > > >
> > > >
> > > > References
> > > > ----------
> > > > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > > > [3] http://s.apache.org/hbase-1.0-api
> > > > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > > > [5]
> https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > > >
> > > > Enis
> > > >
> > >
> > >
> > >
> > > --
> > > Best regards,
> > >
> > > - Andy
> > >
> > > Problems worthy of attack prove their worth by hitting back. - Piet
> Hein
> > > (via Tom White)
> > >
> >
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Enis Söztutar <en...@gmail.com>.
Here is my RC5 testing so far:
- checked checksums, sigs
- checked the bin and src artifacts
- checked layouts
- checked java files in src tarball, and jar files in bin tarball
- checked the book and the site (they are new style)
- checked javadocs for both devapi and userapi
- checked reported version, build time, revision
- run some smoke tests using shell
- started local mode
- run LTT local mode
- checked the webUIs of master and region servers
- checked JMX dump and debug dump
- Build src with hadoop versions 2.2.0 2.3.0 2.4.0 2.4.1 2.5.0 2.5.1
2.5.2 2.6.0
- Deployed at a 6 node cluster with Hadoop-2.6.0
- Run LTT over tables with NONE, DIFF, FAST_DIFF, and PREFIX encoding
- Run LTT over tables with NONE, GZ, LZO, LZ4 and SNAPPY compression
- Tested with Bucket cache with 500M off heap
I am still running larger scale tests, and some CM tests on the cluster.
Will report back tomorrow and cast my vote.
Enis
On Wed, Feb 18, 2015 at 4:47 PM, 张铎 <pa...@gmail.com> wrote:
> TestCacheOnWrite itself has some problems. It
> uses TestHFileWriterV2.randomOrderedKey to generate a random byte array,
> then use first 32 bytes as row and other parts as family and qualifier, but
> TestHFileWriterV2.randomOrderedKey may return a byte array only contains 32
> bytes, so there will be family and qualifier with zero length.
>
> I do not know if this is the reason why this test is flaky since it use a
> Random with pre-defined seed so the random sequence should be stable. I can
> modify the KeyValue generation part to see if it helps.
>
> BTW, the name 'randomOrderedKey' is ambiguous, may change to '
> randomOrderedRow'?
>
> 2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
>
> > I'm not able to get a clean unit test run when building from source using
> > 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe more
> but
> > the build doesn't get past hbase-server. Maybe these are known issues? If
> > not I'll dig in when I get some time.
> >
> >
> > On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
> >
> > > It gives me great pleasure to announce that the sixth release candidate
> > for
> > > the release
> > > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> > >
> > > Maven artifacts are also available in the temporary repository
> > > https://repository.apache.org/content/repositories/orgapachehbase-1065
> > >
> > > Signed with my code signing key E964B5FF. Can be found here:
> > > https://people.apache.org/keys/committer/enis.asc
> > >
> > > Signed tag in the repository can be found here:
> > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> > >
> > > HBase 1.0.0 is the next stable release, and the start of "semantic
> > > versioned"
> > > releases (See [1]).
> > >
> > > The theme of 1.0.0 release is to become a stable base for future 1.x
> > series
> > > of releases. We aim to achieve at least the same level of stability of
> > 0.98
> > > releases.
> > >
> > > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together
> with
> > > the
> > > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > > limited to)
> > > below. Note that all previous 0.99.x releases are developer preview
> > > releases, and will
> > > NOT be supported in any form.
> > >
> > > API Cleanup and changes
> > > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > > We advise to update your application to use the new style of APIs,
> > since
> > > deprecated APIs might be removed in future releases (2.x). See [2]
> and
> > > [3]
> > > for an overview of changes. All Client side API's are marked with
> > > InterfaceAudience.Public class, indicating that the class/method is
> an
> > > official "client API" for HBase. All 1.x releases are planned to be
> API
> > > compatible for these classes. See [1] for an overview.
> > >
> > > Master runs a Region Server as well
> > > Starting with 1.0.0, the HBase master server and backup master
> servers
> > > will
> > > also act as a region server. RPC port and info port for web UI is
> > shared
> > > for
> > > the master and region server roles. Active master can host regions of
> > > defined tables if configured (disabled by default). Backup masters
> will
> > > not
> > > host regions.
> > >
> > > Read availability using timeline consistent region replicas
> > > This release contains Phase 1 items for experimental "Read
> availability
> > > using
> > > timeline consistent region replicas" feature. A region can be hosted
> in
> > > multiple region servers in read-only mode. One of the replicas for
> the
> > > region
> > > will be primary, accepting writes, and other replicas will be sharing
> > the
> > > same
> > > data files. Read requests can be done against any replica for the
> > region
> > > with
> > > backup RPCs for high availability with timeline consistency
> guarantees.
> > > More
> > > information can be found at HBASE-10070.
> > >
> > > Online config change and other forward ports from 0.89-fb branch
> > > HBASE-12147 forward ported online config change which enables some of
> > the
> > > configuration from the server to be reloaded without restarting the
> > > region
> > > servers.
> > >
> > > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > > - Automatic tuning of global memstore and block cache sizes
> > > - Various security, tags and visibility labels improvements
> > > - Bucket cache improvements (usability and compressed data blocks)
> > > - A new pluggable replication endpoint to plug in to HBase's
> > inter-cluster
> > > replication to replicate to a custom data store
> > > - A Dockerfile to easily build and run HBase from source
> > > - Truncate table command
> > > - Region assignment to use hbase:meta table instead of zookeeper for
> > > faster
> > > region assignment (disabled by default)
> > > - Extensive documentation improvements
> > > - [HBASE-12511] - namespace permissions - add support from table
> > creation
> > > privilege in a namespace 'C'
> > > - [HBASE-12568] - Adopt Semantic Versioning and document it in the
> book
> > > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> > Server
> > > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with
> online
> > > configuration capability' to branch-1
> > > - [HBASE-10560] - Per cell TTLs
> > > - [HBASE-11997] - CopyTable with bulkload
> > > - [HBASE-11990] - Make setting the start and stop row for a specific
> > > prefix easier
> > > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > > - [HBASE-12032] - Script to stop regionservers via RPC
> > > - [HBASE-11907] - Use the joni byte[] regex engine in place of
> j.u.regex
> > > in RegexStringComparator
> > > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > > - [HBASE-11804] - Raise default heap size if unspecified
> > > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > > - [HBASE-12126] - Region server coprocessor endpoint
> > > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > > - [HBASE-12075] - Preemptive Fast Fail
> > > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with
> MIN_VERSIONS
> > > - [HBASE-12434] - Add a command to compact all the regions in a
> > > regionserver
> > > - [HBASE-8707] - Add LongComparator for filter
> > > - [HBASE-12286] - [shell] Add server/cluster online load of
> > configuration
> > > changes
> > > - [HBASE-12361] - Show data locality of region in table page
> > > - [HBASE-12496] - A blockedRequestsCount metric
> > > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback
> mechanism)
> > to
> > > branch-1
> > > - [HBASE-12731] - Heap occupancy based client pushback
> > > - [HBASE-12728] - buffered writes substantially less useful after
> > removal
> > > of HTablePool
> > > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > > - Various fixes to REST server
> > > - Internal refactoring for abstracting away zookeeper usage
> > > - Better support for Cell interface internally in read and write paths
> > for
> > > better performance and flexibility
> > > - Combining internal mvcc and seqId infrastructure
> > > - Ring buffer based WAL improvements
> > > - Switch to using new style of client APIs internally (in a lot of
> > places)
> > > - Improvements in visibility labels
> > > - Perf improvements
> > > - Numerous improvements in other areas and bug fixes.
> > >
> > > 1.0.0 release has these changes in default behavior (see [4])
> > > - Zookeeper 3.4.x is required
> > > - Hadoop-2.x is required
> > > - JDK-1.7 is required
> > > - Default ports have changed from 600XX range into out of ephemeral
> > 160XX
> > > range.
> > > - Hfile version 3 has been enabled by default.
> > > - Slab cache has been removed (use bucket cache instead)
> > > - Default heap for region servers (and master) is changed from 1GB to
> > > the jdk's default. On most platforms, it will default to 1/4 of
> > physical
> > > memory
> > > - Some client facing APIs (HTableInterface, etc) has been deprecated
> and
> > > replaced.
> > > - Custom Filter implementations should switch to using the new
> > recommended
> > > APIs.
> > > - Some authorization permissions (especially regarding namespaces)
> have
> > > been
> > > changed (HBASE-12511, HBASE-8015)
> > > - Mapred package and classes under there has been un-deprecated.
> > > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > > - HTrace dependency is moved to the Apache artifacts (
> > > https://htrace.incubator.apache.org/)
> > > - Various updates to dependency versions
> > >
> > > Full list of the issues can be found at:
> > > - 1.0.0 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > > - 0.99.2 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > > - 0.99.1 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > > - 0.99.0 issues :
> > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> > >
> > > Compatibility
> > > -------------
> > > Source Compatibility:
> > > Client side code in HBase-1.0.0 is (mostly) source compatible with
> > earlier
> > > versions. Some minor API changes might be needed from the client side.
> > >
> > >
> > > Wire Compatibility:
> > > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients
> and
> > > servers running in different versions as long as new features are not
> > used
> > > should be possible.
> > > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> > 1.0.0
> > > introduces a new file format (hfile v3) that is enabled by default that
> > > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> > 1.0.0
> > > is
> > > not supported.
> > > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> > >
> > > Binary Compatibility:
> > > Binary compatibility at the Java API layer with earlier versions
> (0.98.x,
> > > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> > client
> > > code and any server side code (coprocessors, filters etc) referring to
> > > hbase jars.
> > >
> > > Upgrading
> > > ---------
> > > See [4] for upgrade instructions and extended discussion on the
> changes.
> > >
> > > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > > fashion
> > > is supported.
> > >
> > > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> > restart
> > > of
> > > the cluster.
> > >
> > > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > > metadata.
> > > See [5] for details.
> > >
> > >
> > > Supported Hadoop versions
> > > -------------------------
> > > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > > releases
> > > are the most tested hadoop releases and we recommend running with those
> > > versions
> > > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > > 2.3.x)
> > > are not tested to the full extend. More information can be found here:
> > > https://hbase.apache.org/book/configuration.html#hadoop
> > >
> > >
> > > Supported Java versions
> > > -------------------------
> > > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> > support
> > > is experimental. More information can be found here:
> > > https://hbase.apache.org/book/configuration.html#java
> > >
> > >
> > > Voting
> > > ------
> > > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > > We will have a 5 day voting period because this is the sixth RC. Please
> > try
> > > to
> > > spend some time for testing this important release.
> > >
> > > [] +1 Release the artifacts as 1.0.0
> > > [] -1 DO NOT release the artifacts as 1.0.0, because...
> > >
> > > Gratitute
> > > ---------
> > > Last but not least, 1.0.0 release has been in a long time making with
> > > contributions from a very large group of awesome people and hard work
> > from
> > > committers and contributors. We would like to extend our thanks to
> > > everybody
> > > who worked on this release or contributed to HBase over the years.
> > >
> > >
> > > References
> > > ----------
> > > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > > [3] http://s.apache.org/hbase-1.0-api
> > > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> > >
> > > Enis
> > >
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
> >
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by 张铎 <pa...@gmail.com>.
TestCacheOnWrite itself has some problems. It
uses TestHFileWriterV2.randomOrderedKey to generate a random byte array,
then use first 32 bytes as row and other parts as family and qualifier, but
TestHFileWriterV2.randomOrderedKey may return a byte array only contains 32
bytes, so there will be family and qualifier with zero length.
I do not know if this is the reason why this test is flaky since it use a
Random with pre-defined seed so the random sequence should be stable. I can
modify the KeyValue generation part to see if it helps.
BTW, the name 'randomOrderedKey' is ambiguous, may change to '
randomOrderedRow'?
2015-02-19 7:11 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> I'm not able to get a clean unit test run when building from source using
> 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe more but
> the build doesn't get past hbase-server. Maybe these are known issues? If
> not I'll dig in when I get some time.
>
>
> On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
>
> > It gives me great pleasure to announce that the sixth release candidate
> for
> > the release
> > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1065
> >
> > Signed with my code signing key E964B5FF. Can be found here:
> > https://people.apache.org/keys/committer/enis.asc
> >
> > Signed tag in the repository can be found here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >
> > HBase 1.0.0 is the next stable release, and the start of "semantic
> > versioned"
> > releases (See [1]).
> >
> > The theme of 1.0.0 release is to become a stable base for future 1.x
> series
> > of releases. We aim to achieve at least the same level of stability of
> 0.98
> > releases.
> >
> > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> > the
> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > limited to)
> > below. Note that all previous 0.99.x releases are developer preview
> > releases, and will
> > NOT be supported in any form.
> >
> > API Cleanup and changes
> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > We advise to update your application to use the new style of APIs,
> since
> > deprecated APIs might be removed in future releases (2.x). See [2] and
> > [3]
> > for an overview of changes. All Client side API's are marked with
> > InterfaceAudience.Public class, indicating that the class/method is an
> > official "client API" for HBase. All 1.x releases are planned to be API
> > compatible for these classes. See [1] for an overview.
> >
> > Master runs a Region Server as well
> > Starting with 1.0.0, the HBase master server and backup master servers
> > will
> > also act as a region server. RPC port and info port for web UI is
> shared
> > for
> > the master and region server roles. Active master can host regions of
> > defined tables if configured (disabled by default). Backup masters will
> > not
> > host regions.
> >
> > Read availability using timeline consistent region replicas
> > This release contains Phase 1 items for experimental "Read availability
> > using
> > timeline consistent region replicas" feature. A region can be hosted in
> > multiple region servers in read-only mode. One of the replicas for the
> > region
> > will be primary, accepting writes, and other replicas will be sharing
> the
> > same
> > data files. Read requests can be done against any replica for the
> region
> > with
> > backup RPCs for high availability with timeline consistency guarantees.
> > More
> > information can be found at HBASE-10070.
> >
> > Online config change and other forward ports from 0.89-fb branch
> > HBASE-12147 forward ported online config change which enables some of
> the
> > configuration from the server to be reloaded without restarting the
> > region
> > servers.
> >
> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > - Automatic tuning of global memstore and block cache sizes
> > - Various security, tags and visibility labels improvements
> > - Bucket cache improvements (usability and compressed data blocks)
> > - A new pluggable replication endpoint to plug in to HBase's
> inter-cluster
> > replication to replicate to a custom data store
> > - A Dockerfile to easily build and run HBase from source
> > - Truncate table command
> > - Region assignment to use hbase:meta table instead of zookeeper for
> > faster
> > region assignment (disabled by default)
> > - Extensive documentation improvements
> > - [HBASE-12511] - namespace permissions - add support from table
> creation
> > privilege in a namespace 'C'
> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> Server
> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> > configuration capability' to branch-1
> > - [HBASE-10560] - Per cell TTLs
> > - [HBASE-11997] - CopyTable with bulkload
> > - [HBASE-11990] - Make setting the start and stop row for a specific
> > prefix easier
> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > - [HBASE-12032] - Script to stop regionservers via RPC
> > - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> > in RegexStringComparator
> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > - [HBASE-11804] - Raise default heap size if unspecified
> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > - [HBASE-12126] - Region server coprocessor endpoint
> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > - [HBASE-12075] - Preemptive Fast Fail
> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> > - [HBASE-12434] - Add a command to compact all the regions in a
> > regionserver
> > - [HBASE-8707] - Add LongComparator for filter
> > - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> > changes
> > - [HBASE-12361] - Show data locality of region in table page
> > - [HBASE-12496] - A blockedRequestsCount metric
> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> to
> > branch-1
> > - [HBASE-12731] - Heap occupancy based client pushback
> > - [HBASE-12728] - buffered writes substantially less useful after
> removal
> > of HTablePool
> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > - Various fixes to REST server
> > - Internal refactoring for abstracting away zookeeper usage
> > - Better support for Cell interface internally in read and write paths
> for
> > better performance and flexibility
> > - Combining internal mvcc and seqId infrastructure
> > - Ring buffer based WAL improvements
> > - Switch to using new style of client APIs internally (in a lot of
> places)
> > - Improvements in visibility labels
> > - Perf improvements
> > - Numerous improvements in other areas and bug fixes.
> >
> > 1.0.0 release has these changes in default behavior (see [4])
> > - Zookeeper 3.4.x is required
> > - Hadoop-2.x is required
> > - JDK-1.7 is required
> > - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> > range.
> > - Hfile version 3 has been enabled by default.
> > - Slab cache has been removed (use bucket cache instead)
> > - Default heap for region servers (and master) is changed from 1GB to
> > the jdk's default. On most platforms, it will default to 1/4 of
> physical
> > memory
> > - Some client facing APIs (HTableInterface, etc) has been deprecated and
> > replaced.
> > - Custom Filter implementations should switch to using the new
> recommended
> > APIs.
> > - Some authorization permissions (especially regarding namespaces) have
> > been
> > changed (HBASE-12511, HBASE-8015)
> > - Mapred package and classes under there has been un-deprecated.
> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > - HTrace dependency is moved to the Apache artifacts (
> > https://htrace.incubator.apache.org/)
> > - Various updates to dependency versions
> >
> > Full list of the issues can be found at:
> > - 1.0.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > - 0.99.2 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > - 0.99.1 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > - 0.99.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >
> > Compatibility
> > -------------
> > Source Compatibility:
> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> > versions. Some minor API changes might be needed from the client side.
> >
> >
> > Wire Compatibility:
> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> > servers running in different versions as long as new features are not
> used
> > should be possible.
> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> 1.0.0
> > introduces a new file format (hfile v3) that is enabled by default that
> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> > is
> > not supported.
> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >
> > Binary Compatibility:
> > Binary compatibility at the Java API layer with earlier versions (0.98.x,
> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> > code and any server side code (coprocessors, filters etc) referring to
> > hbase jars.
> >
> > Upgrading
> > ---------
> > See [4] for upgrade instructions and extended discussion on the changes.
> >
> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > fashion
> > is supported.
> >
> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> > of
> > the cluster.
> >
> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > metadata.
> > See [5] for details.
> >
> >
> > Supported Hadoop versions
> > -------------------------
> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > releases
> > are the most tested hadoop releases and we recommend running with those
> > versions
> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > 2.3.x)
> > are not tested to the full extend. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#hadoop
> >
> >
> > Supported Java versions
> > -------------------------
> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> > is experimental. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#java
> >
> >
> > Voting
> > ------
> > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > We will have a 5 day voting period because this is the sixth RC. Please
> try
> > to
> > spend some time for testing this important release.
> >
> > [] +1 Release the artifacts as 1.0.0
> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >
> > Gratitute
> > ---------
> > Last but not least, 1.0.0 release has been in a long time making with
> > contributions from a very large group of awesome people and hard work
> from
> > committers and contributors. We would like to extend our thanks to
> > everybody
> > who worked on this release or contributed to HBase over the years.
> >
> >
> > References
> > ----------
> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > [3] http://s.apache.org/hbase-1.0-api
> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >
> > Enis
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Stack <st...@duboce.net>.
Interesting. I just got a clean build on jdk1.7.0_67 (Failed in ITs). Will
retry a few times.
St.Ack
On Wed, Feb 18, 2015 at 3:11 PM, Andrew Purtell <ap...@apache.org> wrote:
> I'm not able to get a clean unit test run when building from source using
> 7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe more but
> the build doesn't get past hbase-server. Maybe these are known issues? If
> not I'll dig in when I get some time.
>
>
> On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
>
> > It gives me great pleasure to announce that the sixth release candidate
> for
> > the release
> > 1.0.0 (HBase-1.0.0RC5), is available for download at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
> >
> > Maven artifacts are also available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1065
> >
> > Signed with my code signing key E964B5FF. Can be found here:
> > https://people.apache.org/keys/committer/enis.asc
> >
> > Signed tag in the repository can be found here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
> >
> > HBase 1.0.0 is the next stable release, and the start of "semantic
> > versioned"
> > releases (See [1]).
> >
> > The theme of 1.0.0 release is to become a stable base for future 1.x
> series
> > of releases. We aim to achieve at least the same level of stability of
> 0.98
> > releases.
> >
> > 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> > the
> > previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> > limited to)
> > below. Note that all previous 0.99.x releases are developer preview
> > releases, and will
> > NOT be supported in any form.
> >
> > API Cleanup and changes
> > 1.0.0 introduces new APIs, and deprecates some of commonly-used
> > client side APIs (HTableInterface, HTable and HBaseAdmin).
> > We advise to update your application to use the new style of APIs,
> since
> > deprecated APIs might be removed in future releases (2.x). See [2] and
> > [3]
> > for an overview of changes. All Client side API's are marked with
> > InterfaceAudience.Public class, indicating that the class/method is an
> > official "client API" for HBase. All 1.x releases are planned to be API
> > compatible for these classes. See [1] for an overview.
> >
> > Master runs a Region Server as well
> > Starting with 1.0.0, the HBase master server and backup master servers
> > will
> > also act as a region server. RPC port and info port for web UI is
> shared
> > for
> > the master and region server roles. Active master can host regions of
> > defined tables if configured (disabled by default). Backup masters will
> > not
> > host regions.
> >
> > Read availability using timeline consistent region replicas
> > This release contains Phase 1 items for experimental "Read availability
> > using
> > timeline consistent region replicas" feature. A region can be hosted in
> > multiple region servers in read-only mode. One of the replicas for the
> > region
> > will be primary, accepting writes, and other replicas will be sharing
> the
> > same
> > data files. Read requests can be done against any replica for the
> region
> > with
> > backup RPCs for high availability with timeline consistency guarantees.
> > More
> > information can be found at HBASE-10070.
> >
> > Online config change and other forward ports from 0.89-fb branch
> > HBASE-12147 forward ported online config change which enables some of
> the
> > configuration from the server to be reloaded without restarting the
> > region
> > servers.
> >
> > Other notable improvements in 1.0.0 (including previous 0.99.x) are
> > - A new web skin in time for 1.0 (http://hbase.apache.org)
> > - Automatic tuning of global memstore and block cache sizes
> > - Various security, tags and visibility labels improvements
> > - Bucket cache improvements (usability and compressed data blocks)
> > - A new pluggable replication endpoint to plug in to HBase's
> inter-cluster
> > replication to replicate to a custom data store
> > - A Dockerfile to easily build and run HBase from source
> > - Truncate table command
> > - Region assignment to use hbase:meta table instead of zookeeper for
> > faster
> > region assignment (disabled by default)
> > - Extensive documentation improvements
> > - [HBASE-12511] - namespace permissions - add support from table
> creation
> > privilege in a namespace 'C'
> > - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> > - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift
> Server
> > - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> > configuration capability' to branch-1
> > - [HBASE-10560] - Per cell TTLs
> > - [HBASE-11997] - CopyTable with bulkload
> > - [HBASE-11990] - Make setting the start and stop row for a specific
> > prefix easier
> > - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> > - [HBASE-12090] - Bytes: more Unsafe, more Faster
> > - [HBASE-12032] - Script to stop regionservers via RPC
> > - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> > in RegexStringComparator
> > - [HBASE-11796] - Add client support for atomic checkAndMutate
> > - [HBASE-11804] - Raise default heap size if unspecified
> > - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> > - [HBASE-12126] - Region server coprocessor endpoint
> > - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> > - [HBASE-12075] - Preemptive Fast Fail
> > - [HBASE-12354] - Update dependencies in time for 1.0 release
> > - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> > - [HBASE-12434] - Add a command to compact all the regions in a
> > regionserver
> > - [HBASE-8707] - Add LongComparator for filter
> > - [HBASE-12286] - [shell] Add server/cluster online load of
> configuration
> > changes
> > - [HBASE-12361] - Show data locality of region in table page
> > - [HBASE-12496] - A blockedRequestsCount metric
> > - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism)
> to
> > branch-1
> > - [HBASE-12731] - Heap occupancy based client pushback
> > - [HBASE-12728] - buffered writes substantially less useful after
> removal
> > of HTablePool
> > - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> > - Various fixes to REST server
> > - Internal refactoring for abstracting away zookeeper usage
> > - Better support for Cell interface internally in read and write paths
> for
> > better performance and flexibility
> > - Combining internal mvcc and seqId infrastructure
> > - Ring buffer based WAL improvements
> > - Switch to using new style of client APIs internally (in a lot of
> places)
> > - Improvements in visibility labels
> > - Perf improvements
> > - Numerous improvements in other areas and bug fixes.
> >
> > 1.0.0 release has these changes in default behavior (see [4])
> > - Zookeeper 3.4.x is required
> > - Hadoop-2.x is required
> > - JDK-1.7 is required
> > - Default ports have changed from 600XX range into out of ephemeral
> 160XX
> > range.
> > - Hfile version 3 has been enabled by default.
> > - Slab cache has been removed (use bucket cache instead)
> > - Default heap for region servers (and master) is changed from 1GB to
> > the jdk's default. On most platforms, it will default to 1/4 of
> physical
> > memory
> > - Some client facing APIs (HTableInterface, etc) has been deprecated and
> > replaced.
> > - Custom Filter implementations should switch to using the new
> recommended
> > APIs.
> > - Some authorization permissions (especially regarding namespaces) have
> > been
> > changed (HBASE-12511, HBASE-8015)
> > - Mapred package and classes under there has been un-deprecated.
> > - Two new modules (jar files): hbase-annotations and hbase-rest.
> > - HTrace dependency is moved to the Apache artifacts (
> > https://htrace.incubator.apache.org/)
> > - Various updates to dependency versions
> >
> > Full list of the issues can be found at:
> > - 1.0.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> > - 0.99.2 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> > - 0.99.1 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> > - 0.99.0 issues :
> >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
> >
> > Compatibility
> > -------------
> > Source Compatibility:
> > Client side code in HBase-1.0.0 is (mostly) source compatible with
> earlier
> > versions. Some minor API changes might be needed from the client side.
> >
> >
> > Wire Compatibility:
> > HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> > servers running in different versions as long as new features are not
> used
> > should be possible.
> > A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well.
> 1.0.0
> > introduces a new file format (hfile v3) that is enabled by default that
> > 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to
> 1.0.0
> > is
> > not supported.
> > 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
> >
> > Binary Compatibility:
> > Binary compatibility at the Java API layer with earlier versions (0.98.x,
> > 0.96.x and 0.94.x) is not supported. You may have to recompile your
> client
> > code and any server side code (coprocessors, filters etc) referring to
> > hbase jars.
> >
> > Upgrading
> > ---------
> > See [4] for upgrade instructions and extended discussion on the changes.
> >
> > From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> > fashion
> > is supported.
> >
> > From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and
> restart
> > of
> > the cluster.
> >
> > From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> > 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> > metadata.
> > See [5] for details.
> >
> >
> > Supported Hadoop versions
> > -------------------------
> > 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> > releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> > releases
> > are the most tested hadoop releases and we recommend running with those
> > versions
> > (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> > 2.3.x)
> > are not tested to the full extend. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#hadoop
> >
> >
> > Supported Java versions
> > -------------------------
> > 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8
> support
> > is experimental. More information can be found here:
> > https://hbase.apache.org/book/configuration.html#java
> >
> >
> > Voting
> > ------
> > Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> > We will have a 5 day voting period because this is the sixth RC. Please
> try
> > to
> > spend some time for testing this important release.
> >
> > [] +1 Release the artifacts as 1.0.0
> > [] -1 DO NOT release the artifacts as 1.0.0, because...
> >
> > Gratitute
> > ---------
> > Last but not least, 1.0.0 release has been in a long time making with
> > contributions from a very large group of awesome people and hard work
> from
> > committers and contributors. We would like to extend our thanks to
> > everybody
> > who worked on this release or contributed to HBase over the years.
> >
> >
> > References
> > ----------
> > [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> > [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> > [3] http://s.apache.org/hbase-1.0-api
> > [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> > [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
> >
> > Enis
> >
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
>
Re: [VOTE] Sixth release candidate for HBase 1.0.0 (RC5) is
available. Please vote by Feb 19 2015
Posted by Andrew Purtell <ap...@apache.org>.
I'm not able to get a clean unit test run when building from source using
7u67. TestCacheOnWrite and TestSplitLogManager fail for me, maybe more but
the build doesn't get past hbase-server. Maybe these are known issues? If
not I'll dig in when I get some time.
On Sat, Feb 14, 2015 at 9:55 PM, Enis Söztutar <en...@apache.org> wrote:
> It gives me great pleasure to announce that the sixth release candidate for
> the release
> 1.0.0 (HBase-1.0.0RC5), is available for download at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.0.0RC5/
>
> Maven artifacts are also available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1065
>
> Signed with my code signing key E964B5FF. Can be found here:
> https://people.apache.org/keys/committer/enis.asc
>
> Signed tag in the repository can be found here:
>
> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=c4660912e9b46c917a9aba2106be4bf74182a764
>
> HBase 1.0.0 is the next stable release, and the start of "semantic
> versioned"
> releases (See [1]).
>
> The theme of 1.0.0 release is to become a stable base for future 1.x series
> of releases. We aim to achieve at least the same level of stability of 0.98
> releases.
>
> 1.0.0 release contains 202 fixes on top of 0.99.2 release. Together with
> the
> previous 0.99.x releases, major changes in 1.0.0 are listed (but not
> limited to)
> below. Note that all previous 0.99.x releases are developer preview
> releases, and will
> NOT be supported in any form.
>
> API Cleanup and changes
> 1.0.0 introduces new APIs, and deprecates some of commonly-used
> client side APIs (HTableInterface, HTable and HBaseAdmin).
> We advise to update your application to use the new style of APIs, since
> deprecated APIs might be removed in future releases (2.x). See [2] and
> [3]
> for an overview of changes. All Client side API's are marked with
> InterfaceAudience.Public class, indicating that the class/method is an
> official "client API" for HBase. All 1.x releases are planned to be API
> compatible for these classes. See [1] for an overview.
>
> Master runs a Region Server as well
> Starting with 1.0.0, the HBase master server and backup master servers
> will
> also act as a region server. RPC port and info port for web UI is shared
> for
> the master and region server roles. Active master can host regions of
> defined tables if configured (disabled by default). Backup masters will
> not
> host regions.
>
> Read availability using timeline consistent region replicas
> This release contains Phase 1 items for experimental "Read availability
> using
> timeline consistent region replicas" feature. A region can be hosted in
> multiple region servers in read-only mode. One of the replicas for the
> region
> will be primary, accepting writes, and other replicas will be sharing the
> same
> data files. Read requests can be done against any replica for the region
> with
> backup RPCs for high availability with timeline consistency guarantees.
> More
> information can be found at HBASE-10070.
>
> Online config change and other forward ports from 0.89-fb branch
> HBASE-12147 forward ported online config change which enables some of the
> configuration from the server to be reloaded without restarting the
> region
> servers.
>
> Other notable improvements in 1.0.0 (including previous 0.99.x) are
> - A new web skin in time for 1.0 (http://hbase.apache.org)
> - Automatic tuning of global memstore and block cache sizes
> - Various security, tags and visibility labels improvements
> - Bucket cache improvements (usability and compressed data blocks)
> - A new pluggable replication endpoint to plug in to HBase's inter-cluster
> replication to replicate to a custom data store
> - A Dockerfile to easily build and run HBase from source
> - Truncate table command
> - Region assignment to use hbase:meta table instead of zookeeper for
> faster
> region assignment (disabled by default)
> - Extensive documentation improvements
> - [HBASE-12511] - namespace permissions - add support from table creation
> privilege in a namespace 'C'
> - [HBASE-12568] - Adopt Semantic Versioning and document it in the book
> - [HBASE-12640] - Add Thrift-over-HTTPS and doAs support for Thrift Server
> - [HBASE-12651] - Backport HBASE-12559 'Provide LoadBalancer with online
> configuration capability' to branch-1
> - [HBASE-10560] - Per cell TTLs
> - [HBASE-11997] - CopyTable with bulkload
> - [HBASE-11990] - Make setting the start and stop row for a specific
> prefix easier
> - [HBASE-12220] - Add hedgedReads and hedgedReadWins metrics
> - [HBASE-12090] - Bytes: more Unsafe, more Faster
> - [HBASE-12032] - Script to stop regionservers via RPC
> - [HBASE-11907] - Use the joni byte[] regex engine in place of j.u.regex
> in RegexStringComparator
> - [HBASE-11796] - Add client support for atomic checkAndMutate
> - [HBASE-11804] - Raise default heap size if unspecified
> - [HBASE-11890] - HBase REST Client is hard coded to http protocol
> - [HBASE-12126] - Region server coprocessor endpoint
> - [HBASE-12183] - FuzzyRowFilter doesn't support reverse scans
> - [HBASE-12075] - Preemptive Fast Fail
> - [HBASE-12354] - Update dependencies in time for 1.0 release
> - [HBASE-12363] - Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS
> - [HBASE-12434] - Add a command to compact all the regions in a
> regionserver
> - [HBASE-8707] - Add LongComparator for filter
> - [HBASE-12286] - [shell] Add server/cluster online load of configuration
> changes
> - [HBASE-12361] - Show data locality of region in table page
> - [HBASE-12496] - A blockedRequestsCount metric
> - [HBASE-12730] - Backport HBASE-5162 (Basic client pushback mechanism) to
> branch-1
> - [HBASE-12731] - Heap occupancy based client pushback
> - [HBASE-12728] - buffered writes substantially less useful after removal
> of HTablePool
> - [HBASE-5699] - Run with > 1 WAL in HRegionServer
> - Various fixes to REST server
> - Internal refactoring for abstracting away zookeeper usage
> - Better support for Cell interface internally in read and write paths for
> better performance and flexibility
> - Combining internal mvcc and seqId infrastructure
> - Ring buffer based WAL improvements
> - Switch to using new style of client APIs internally (in a lot of places)
> - Improvements in visibility labels
> - Perf improvements
> - Numerous improvements in other areas and bug fixes.
>
> 1.0.0 release has these changes in default behavior (see [4])
> - Zookeeper 3.4.x is required
> - Hadoop-2.x is required
> - JDK-1.7 is required
> - Default ports have changed from 600XX range into out of ephemeral 160XX
> range.
> - Hfile version 3 has been enabled by default.
> - Slab cache has been removed (use bucket cache instead)
> - Default heap for region servers (and master) is changed from 1GB to
> the jdk's default. On most platforms, it will default to 1/4 of physical
> memory
> - Some client facing APIs (HTableInterface, etc) has been deprecated and
> replaced.
> - Custom Filter implementations should switch to using the new recommended
> APIs.
> - Some authorization permissions (especially regarding namespaces) have
> been
> changed (HBASE-12511, HBASE-8015)
> - Mapred package and classes under there has been un-deprecated.
> - Two new modules (jar files): hbase-annotations and hbase-rest.
> - HTrace dependency is moved to the Apache artifacts (
> https://htrace.incubator.apache.org/)
> - Various updates to dependency versions
>
> Full list of the issues can be found at:
> - 1.0.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325852
> - 0.99.2 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675
> - 0.99.1 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328551
> - 0.99.0 issues :
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12328822
>
> Compatibility
> -------------
> Source Compatibility:
> Client side code in HBase-1.0.0 is (mostly) source compatible with earlier
> versions. Some minor API changes might be needed from the client side.
>
>
> Wire Compatibility:
> HBase-1.0.0 release is wire compatible with 0.98.x releases. Clients and
> servers running in different versions as long as new features are not used
> should be possible.
> A rolling upgrade from 0.98.x clusters to 1.0.0 is supported as well. 1.0.0
> introduces a new file format (hfile v3) that is enabled by default that
> 0.96.x code cannot read. Thus, rolling upgrade from 0.96 directly to 1.0.0
> is
> not supported.
> 1.0.0 is NOT wire compatible with earlier releases (0.94, etc).
>
> Binary Compatibility:
> Binary compatibility at the Java API layer with earlier versions (0.98.x,
> 0.96.x and 0.94.x) is not supported. You may have to recompile your client
> code and any server side code (coprocessors, filters etc) referring to
> hbase jars.
>
> Upgrading
> ---------
> See [4] for upgrade instructions and extended discussion on the changes.
>
> From 0.98.x : Upgrade from 0.98.x in regular upgrade or rolling upgrade
> fashion
> is supported.
>
> From 0.96.x : Upgrade from 0.96.x is supported with a shutdown and restart
> of
> the cluster.
>
> From 0.94.x : Upgrade from 0.94.x is supported similar to upgrade from
> 0.94 -> 0.96. The upgrade script should be run to rewrite cluster level
> metadata.
> See [5] for details.
>
>
> Supported Hadoop versions
> -------------------------
> 1.0.0 release drops support for Hadoop-1.x releases. Only Hadoop-2.x
> releases are supported. Hadoop-2.4.x, Hadoop-2.5.x and Hadoop-2.6.x
> releases
> are the most tested hadoop releases and we recommend running with those
> versions
> (or later versions). Earlier Hadoop-2 based releases (hadoop-2.2.x and
> 2.3.x)
> are not tested to the full extend. More information can be found here:
> https://hbase.apache.org/book/configuration.html#hadoop
>
>
> Supported Java versions
> -------------------------
> 1.0.0 release drops support for JDK6. Only JDK7 is supported. JDK8 support
> is experimental. More information can be found here:
> https://hbase.apache.org/book/configuration.html#java
>
>
> Voting
> ------
> Please try to test and vote on this release by Feb 19 2015 11:59PM PDT.
> We will have a 5 day voting period because this is the sixth RC. Please try
> to
> spend some time for testing this important release.
>
> [] +1 Release the artifacts as 1.0.0
> [] -1 DO NOT release the artifacts as 1.0.0, because...
>
> Gratitute
> ---------
> Last but not least, 1.0.0 release has been in a long time making with
> contributions from a very large group of awesome people and hard work from
> committers and contributors. We would like to extend our thanks to
> everybody
> who worked on this release or contributed to HBase over the years.
>
>
> References
> ----------
> [1] https://hbase.apache.org/book/upgrading.html#hbase.versioning
> [2] http://www.slideshare.net/xefyr/apache-hbase-10-release
> [3] http://s.apache.org/hbase-1.0-api
> [4] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.changes
> [5] https://hbase.apache.org/book/upgrade1.0.html#upgrade1.0.from.0.94
>
> Enis
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)