You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Andrew Purtell <ap...@apache.org> on 2017/12/09 01:50:10 UTC
[VOTE] The second HBase 1.4.0 release candidate (RC1) is available
The second HBase 1.4.0 release candidate (RC1) is available for download
at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and Maven
artifacts are available in the temporary repository
https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
A detailed source and binary compatibility report for this release is
available for your review at
https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_compatibility_report.html
. All reported compatibility issues should comply with policy but please
review them carefully.
A list of the 660 issues resolved in this release can be found at
https://s.apache.org/OErT .
The changes since RC0 are:
* [HBASE-19180] - Remove unused imports from AlwaysPasses
* [HBASE-19373] - Fix Checkstyle error in hbase-annotations
* [HBASE-19435] - Reopen Files for ClosedChannelException in BucketCache
* [HBASE-19465] - Required httpcore and httpclient jars not included in
binary distribution
* [HBASE-19467] - rsgroups shell commands don't properly display
elapsed time
Please try out the candidate and vote +1/0/-1.
This vote will be open for at least 72 hours. Unless objection I will try
to close it Monday December 18, 2017 if we have sufficient votes.
Prior to making this announcement I made the following preflight checks to
1.4.0RC0 (3d571827cb):
RAT check passes (7u80)
Unit test suite passes (8u131)
LTT load 1M rows with 100% verification and 20% updates (8u131)
PE randomWrite, randomRead, scanRange100 (8u131)
100M rows ITBLL (8u131)
and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
RAT check passes (7u80)
Unit test suite passes (8u131)
Between now and when I want to close the vote I'll write up human readable
release notes for the release announcement as promised.
I also have agreed to run a scale ITBLL test, a performance comparison with
1.2 using YCSB, a performance comparison with 1.2 using PE, and an
analysis of code and allocation hot spot changes from 1.2, all of which I
will publish when available and factor in to my vote.
--
Best regards,
Andrew
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Ted Yu <yu...@gmail.com>.
+1
Checked signatures.
Ran unit tests.
On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org> wrote:
> The second HBase 1.4.0 release candidate (RC1) is available for download
> at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and Maven
> artifacts are available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
>
> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>
> A detailed source and binary compatibility report for this release is
> available for your review at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
> hbase-1.3.1-1.4.0RC1_compatibility_report.html
> . All reported compatibility issues should comply with policy but please
> review them carefully.
>
> A list of the 660 issues resolved in this release can be found at
> https://s.apache.org/OErT .
>
> The changes since RC0 are:
>
> * [HBASE-19180] - Remove unused imports from AlwaysPasses
> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> * [HBASE-19435] - Reopen Files for ClosedChannelException in
> BucketCache
> * [HBASE-19465] - Required httpcore and httpclient jars not included in
> binary distribution
> * [HBASE-19467] - rsgroups shell commands don't properly display
> elapsed time
>
> Please try out the candidate and vote +1/0/-1.
>
> This vote will be open for at least 72 hours. Unless objection I will try
> to close it Monday December 18, 2017 if we have sufficient votes.
>
> Prior to making this announcement I made the following preflight checks to
> 1.4.0RC0 (3d571827cb):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
> LTT load 1M rows with 100% verification and 20% updates (8u131)
> PE randomWrite, randomRead, scanRange100 (8u131)
> 100M rows ITBLL (8u131)
>
> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
>
> Between now and when I want to close the vote I'll write up human readable
> release notes for the release announcement as promised.
>
> I also have agreed to run a scale ITBLL test, a performance comparison with
> 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> analysis of code and allocation hot spot changes from 1.2, all of which I
> will publish when available and factor in to my vote.
>
> --
> Best regards,
> Andrew
>
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Balazs Meszaros <ba...@cloudera.com>.
+1
I ran the same tests as before:
- signatures, checksums are good,
- building and unit tests pass (8u112),
- shell functionalities are ok,
- RS groups work as expected.
Best regards,
Balazs
On Sat, Dec 9, 2017 at 4:37 AM, Guanghao Zhang <zg...@gmail.com> wrote:
> +1 (non-binding)
>
> hbase-1.4.0-bin.tar.gz (jdk8u144)
> - Verified md5sum: ok
> - Start HBase in standalone mode: ok
> - Verified with shell, create/disable/enable/drop/get/put/scan/delete: ok
> - Checked master/regionserver/region Web UI: ok
>
> hbase-1.4.0-src.tar.gz (jdk8u144)
> - Verified md5sum: ok
> - Build tarball: ok
> - Start HBase in standalone mode: ok
> - Verified with shell, create/disable/enable/drop/get/put/scan/delete: ok
> - Checked master/regionserver/region Web UI: ok
>
> One trivial bug for Table ui: the compaction state will show a exception
> message when the table is disabled. Will fill a issue for this.
>
> Thanks.
>
> 2017-12-09 9:50 GMT+08:00 Andrew Purtell <ap...@apache.org>:
>
> > The second HBase 1.4.0 release candidate (RC1) is available for download
> > at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and
> Maven
> > artifacts are available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1186/
> .
> >
> > The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
> >
> > A detailed source and binary compatibility report for this release is
> > available for your review at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
> > hbase-1.3.1-1.4.0RC1_compatibility_report.html
> > . All reported compatibility issues should comply with policy but please
> > review them carefully.
> >
> > A list of the 660 issues resolved in this release can be found at
> > https://s.apache.org/OErT .
> >
> > The changes since RC0 are:
> >
> > * [HBASE-19180] - Remove unused imports from AlwaysPasses
> > * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> > * [HBASE-19435] - Reopen Files for ClosedChannelException in
> > BucketCache
> > * [HBASE-19465] - Required httpcore and httpclient jars not included
> in
> > binary distribution
> > * [HBASE-19467] - rsgroups shell commands don't properly display
> > elapsed time
> >
> > Please try out the candidate and vote +1/0/-1.
> >
> > This vote will be open for at least 72 hours. Unless objection I will try
> > to close it Monday December 18, 2017 if we have sufficient votes.
> >
> > Prior to making this announcement I made the following preflight checks
> to
> > 1.4.0RC0 (3d571827cb):
> >
> > RAT check passes (7u80)
> > Unit test suite passes (8u131)
> > LTT load 1M rows with 100% verification and 20% updates (8u131)
> > PE randomWrite, randomRead, scanRange100 (8u131)
> > 100M rows ITBLL (8u131)
> >
> > and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
> >
> > RAT check passes (7u80)
> > Unit test suite passes (8u131)
> >
> > Between now and when I want to close the vote I'll write up human
> readable
> > release notes for the release announcement as promised.
> >
> > I also have agreed to run a scale ITBLL test, a performance comparison
> with
> > 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> > analysis of code and allocation hot spot changes from 1.2, all of which I
> > will publish when available and factor in to my vote.
> >
> > --
> > Best regards,
> > Andrew
> >
>
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Guanghao Zhang <zg...@gmail.com>.
+1 (non-binding)
hbase-1.4.0-bin.tar.gz (jdk8u144)
- Verified md5sum: ok
- Start HBase in standalone mode: ok
- Verified with shell, create/disable/enable/drop/get/put/scan/delete: ok
- Checked master/regionserver/region Web UI: ok
hbase-1.4.0-src.tar.gz (jdk8u144)
- Verified md5sum: ok
- Build tarball: ok
- Start HBase in standalone mode: ok
- Verified with shell, create/disable/enable/drop/get/put/scan/delete: ok
- Checked master/regionserver/region Web UI: ok
One trivial bug for Table ui: the compaction state will show a exception
message when the table is disabled. Will fill a issue for this.
Thanks.
2017-12-09 9:50 GMT+08:00 Andrew Purtell <ap...@apache.org>:
> The second HBase 1.4.0 release candidate (RC1) is available for download
> at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and Maven
> artifacts are available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
>
> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>
> A detailed source and binary compatibility report for this release is
> available for your review at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
> hbase-1.3.1-1.4.0RC1_compatibility_report.html
> . All reported compatibility issues should comply with policy but please
> review them carefully.
>
> A list of the 660 issues resolved in this release can be found at
> https://s.apache.org/OErT .
>
> The changes since RC0 are:
>
> * [HBASE-19180] - Remove unused imports from AlwaysPasses
> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> * [HBASE-19435] - Reopen Files for ClosedChannelException in
> BucketCache
> * [HBASE-19465] - Required httpcore and httpclient jars not included in
> binary distribution
> * [HBASE-19467] - rsgroups shell commands don't properly display
> elapsed time
>
> Please try out the candidate and vote +1/0/-1.
>
> This vote will be open for at least 72 hours. Unless objection I will try
> to close it Monday December 18, 2017 if we have sufficient votes.
>
> Prior to making this announcement I made the following preflight checks to
> 1.4.0RC0 (3d571827cb):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
> LTT load 1M rows with 100% verification and 20% updates (8u131)
> PE randomWrite, randomRead, scanRange100 (8u131)
> 100M rows ITBLL (8u131)
>
> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
>
> Between now and when I want to close the vote I'll write up human readable
> release notes for the release announcement as promised.
>
> I also have agreed to run a scale ITBLL test, a performance comparison with
> 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> analysis of code and allocation hot spot changes from 1.2, all of which I
> will publish when available and factor in to my vote.
>
> --
> Best regards,
> Andrew
>
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Mike Drob <md...@apache.org>.
+1 (non-binding)
+ sigs&sums
+ source matches tag
+ source builds (java 1.8.0_131)
+ shell CRUD successful
+ shell startup from bin tar correctly identifies git sha commit
+ web UI gives expected results
+ binary tar able to start and read data written from source tar
+ successful [non-rolling] upgrade from 1.2.6 to 1.4.0 using LTT data
Thanks for the tremendous amount of effort that has gone into this, Andrew!
On Fri, Dec 15, 2017 at 1:46 AM, Yu Li <ca...@gmail.com> wrote:
> +1
>
> Checked sums and signatures: ok
> Built from source: ok (7u79)
> RAT check: ok (7u79)
> Compatibility check: ok
> - Checked all removed methods and confirmed no IA.Public interface removed
> Unit tests pass: ok (7u79)
> Shell commands: ok (8u101), ran DDL/flush/compact/split commands,
> everything looks good
> Loaded 1M rows with LTT: ok (8u101), all keys verified, latency and logs
> looks good
>
> Checked YCSB perf results: ok
> - Average RT superior than 1.2.6 in all cases except for workloadE
> insertion (10.28ms->14.67ms), acceptable considering the small insertion
> proportion(5%) might generate uncertain results between different runs
> - Great to have such results, thanks for the efforts
>
> Best Regards,
> Yu
>
> On 15 December 2017 at 04:59, Peter Somogyi <ps...@cloudera.com> wrote:
>
> > +1 (non-binding)
> >
> > Signatures, checksums ok.
> > Ran rat check
> > LTT 1M rows
> > Basic commands in shell
> > Build w/o tests using jdk 1.8.0_151 and maven 3.3.9
> >
> > On Sat, Dec 9, 2017 at 2:50 AM, Andrew Purtell <ap...@apache.org>
> > wrote:
> >
> > > The second HBase 1.4.0 release candidate (RC1) is available for
> download
> > > at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and
> > Maven
> > > artifacts are available in the temporary repository
> > > https://repository.apache.org/content/repositories/orgapache
> hbase-1186/
> > .
> > >
> > > The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
> > >
> > > A detailed source and binary compatibility report for this release is
> > > available for your review at
> > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
> > > hbase-1.3.1-1.4.0RC1_compatibility_report.html
> > > . All reported compatibility issues should comply with policy but
> please
> > > review them carefully.
> > >
> > > A list of the 660 issues resolved in this release can be found at
> > > https://s.apache.org/OErT .
> > >
> > > The changes since RC0 are:
> > >
> > > * [HBASE-19180] - Remove unused imports from AlwaysPasses
> > > * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> > > * [HBASE-19435] - Reopen Files for ClosedChannelException in
> > > BucketCache
> > > * [HBASE-19465] - Required httpcore and httpclient jars not
> included
> > in
> > > binary distribution
> > > * [HBASE-19467] - rsgroups shell commands don't properly display
> > > elapsed time
> > >
> > > Please try out the candidate and vote +1/0/-1.
> > >
> > > This vote will be open for at least 72 hours. Unless objection I will
> try
> > > to close it Monday December 18, 2017 if we have sufficient votes.
> > >
> > > Prior to making this announcement I made the following preflight checks
> > to
> > > 1.4.0RC0 (3d571827cb):
> > >
> > > RAT check passes (7u80)
> > > Unit test suite passes (8u131)
> > > LTT load 1M rows with 100% verification and 20% updates (8u131)
> > > PE randomWrite, randomRead, scanRange100 (8u131)
> > > 100M rows ITBLL (8u131)
> > >
> > > and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
> > >
> > > RAT check passes (7u80)
> > > Unit test suite passes (8u131)
> > >
> > > Between now and when I want to close the vote I'll write up human
> > readable
> > > release notes for the release announcement as promised.
> > >
> > > I also have agreed to run a scale ITBLL test, a performance comparison
> > with
> > > 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> > > analysis of code and allocation hot spot changes from 1.2, all of
> which I
> > > will publish when available and factor in to my vote.
> > >
> > > --
> > > Best regards,
> > > Andrew
> > >
> >
>
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Yu Li <ca...@gmail.com>.
+1
Checked sums and signatures: ok
Built from source: ok (7u79)
RAT check: ok (7u79)
Compatibility check: ok
- Checked all removed methods and confirmed no IA.Public interface removed
Unit tests pass: ok (7u79)
Shell commands: ok (8u101), ran DDL/flush/compact/split commands,
everything looks good
Loaded 1M rows with LTT: ok (8u101), all keys verified, latency and logs
looks good
Checked YCSB perf results: ok
- Average RT superior than 1.2.6 in all cases except for workloadE
insertion (10.28ms->14.67ms), acceptable considering the small insertion
proportion(5%) might generate uncertain results between different runs
- Great to have such results, thanks for the efforts
Best Regards,
Yu
On 15 December 2017 at 04:59, Peter Somogyi <ps...@cloudera.com> wrote:
> +1 (non-binding)
>
> Signatures, checksums ok.
> Ran rat check
> LTT 1M rows
> Basic commands in shell
> Build w/o tests using jdk 1.8.0_151 and maven 3.3.9
>
> On Sat, Dec 9, 2017 at 2:50 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > The second HBase 1.4.0 release candidate (RC1) is available for download
> > at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and
> Maven
> > artifacts are available in the temporary repository
> > https://repository.apache.org/content/repositories/orgapachehbase-1186/
> .
> >
> > The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
> >
> > A detailed source and binary compatibility report for this release is
> > available for your review at
> > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
> > hbase-1.3.1-1.4.0RC1_compatibility_report.html
> > . All reported compatibility issues should comply with policy but please
> > review them carefully.
> >
> > A list of the 660 issues resolved in this release can be found at
> > https://s.apache.org/OErT .
> >
> > The changes since RC0 are:
> >
> > * [HBASE-19180] - Remove unused imports from AlwaysPasses
> > * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> > * [HBASE-19435] - Reopen Files for ClosedChannelException in
> > BucketCache
> > * [HBASE-19465] - Required httpcore and httpclient jars not included
> in
> > binary distribution
> > * [HBASE-19467] - rsgroups shell commands don't properly display
> > elapsed time
> >
> > Please try out the candidate and vote +1/0/-1.
> >
> > This vote will be open for at least 72 hours. Unless objection I will try
> > to close it Monday December 18, 2017 if we have sufficient votes.
> >
> > Prior to making this announcement I made the following preflight checks
> to
> > 1.4.0RC0 (3d571827cb):
> >
> > RAT check passes (7u80)
> > Unit test suite passes (8u131)
> > LTT load 1M rows with 100% verification and 20% updates (8u131)
> > PE randomWrite, randomRead, scanRange100 (8u131)
> > 100M rows ITBLL (8u131)
> >
> > and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
> >
> > RAT check passes (7u80)
> > Unit test suite passes (8u131)
> >
> > Between now and when I want to close the vote I'll write up human
> readable
> > release notes for the release announcement as promised.
> >
> > I also have agreed to run a scale ITBLL test, a performance comparison
> with
> > 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> > analysis of code and allocation hot spot changes from 1.2, all of which I
> > will publish when available and factor in to my vote.
> >
> > --
> > Best regards,
> > Andrew
> >
>
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Peter Somogyi <ps...@cloudera.com>.
+1 (non-binding)
Signatures, checksums ok.
Ran rat check
LTT 1M rows
Basic commands in shell
Build w/o tests using jdk 1.8.0_151 and maven 3.3.9
On Sat, Dec 9, 2017 at 2:50 AM, Andrew Purtell <ap...@apache.org> wrote:
> The second HBase 1.4.0 release candidate (RC1) is available for download
> at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and Maven
> artifacts are available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
>
> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>
> A detailed source and binary compatibility report for this release is
> available for your review at
> https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
> hbase-1.3.1-1.4.0RC1_compatibility_report.html
> . All reported compatibility issues should comply with policy but please
> review them carefully.
>
> A list of the 660 issues resolved in this release can be found at
> https://s.apache.org/OErT .
>
> The changes since RC0 are:
>
> * [HBASE-19180] - Remove unused imports from AlwaysPasses
> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> * [HBASE-19435] - Reopen Files for ClosedChannelException in
> BucketCache
> * [HBASE-19465] - Required httpcore and httpclient jars not included in
> binary distribution
> * [HBASE-19467] - rsgroups shell commands don't properly display
> elapsed time
>
> Please try out the candidate and vote +1/0/-1.
>
> This vote will be open for at least 72 hours. Unless objection I will try
> to close it Monday December 18, 2017 if we have sufficient votes.
>
> Prior to making this announcement I made the following preflight checks to
> 1.4.0RC0 (3d571827cb):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
> LTT load 1M rows with 100% verification and 20% updates (8u131)
> PE randomWrite, randomRead, scanRange100 (8u131)
> 100M rows ITBLL (8u131)
>
> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
>
> Between now and when I want to close the vote I'll write up human readable
> release notes for the release announcement as promised.
>
> I also have agreed to run a scale ITBLL test, a performance comparison with
> 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> analysis of code and allocation hot spot changes from 1.2, all of which I
> will publish when available and factor in to my vote.
>
> --
> Best regards,
> Andrew
>
[RESULT] [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Andrew Purtell <ap...@apache.org>.
With 3 binding +1 votes (Ted Yu, Yu Li, and myself), 5 nonbinding +1 votes
(Guanghao Zhang, Balazs Meszaros, Zach York, Peter Somogyi, and Mike Drob),
and no 0 or -1 votes, this vote passes.
Thank you to everyone who voted on the release!
I have released the artifacts for distribution. Now I need to write up
release notes and make the release announcement. Expect that in the next
few days.
On Sun, Dec 17, 2017 at 10:40 AM, Mike Drob <md...@apache.org> wrote:
> +1 (non-binding)
>
> + sigs&sums
> + source matches tag
> + source builds (java 1.8.0_131)
> + shell CRUD successful
> + shell startup from bin tar correctly identifies git sha commit
> + web UI gives expected results
> + binary tar able to start and read data written from source tar
> + successful [non-rolling] upgrade from 1.2.6 to 1.4.0 using LTT data
>
> Thanks for the tremendous amount of effort that has gone into this, Andrew!
>
>
> On Fri, Dec 15, 2017 at 1:46 AM, Yu Li <ca...@gmail.com> wrote:
>
> > +1
> >
> > Checked sums and signatures: ok
> > Built from source: ok (7u79)
> > RAT check: ok (7u79)
> > Compatibility check: ok
> > - Checked all removed methods and confirmed no IA.Public interface
> removed
> > Unit tests pass: ok (7u79)
> > Shell commands: ok (8u101), ran DDL/flush/compact/split commands,
> > everything looks good
> > Loaded 1M rows with LTT: ok (8u101), all keys verified, latency and logs
> > looks good
> >
> > Checked YCSB perf results: ok
> > - Average RT superior than 1.2.6 in all cases except for workloadE
> > insertion (10.28ms->14.67ms), acceptable considering the small insertion
> > proportion(5%) might generate uncertain results between different runs
> > - Great to have such results, thanks for the efforts
> >
> > Best Regards,
> > Yu
> >
> > On 15 December 2017 at 04:59, Peter Somogyi <ps...@cloudera.com>
> wrote:
> >
> > > +1 (non-binding)
> > >
> > > Signatures, checksums ok.
> > > Ran rat check
> > > LTT 1M rows
> > > Basic commands in shell
> > > Build w/o tests using jdk 1.8.0_151 and maven 3.3.9
> > >
> > > On Sat, Dec 9, 2017 at 2:50 AM, Andrew Purtell <ap...@apache.org>
> > > wrote:
> > >
> > > > The second HBase 1.4.0 release candidate (RC1) is available for
> > download
> > > > at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and
> > > Maven
> > > > artifacts are available in the temporary repository
> > > > https://repository.apache.org/content/repositories/orgapache
> > hbase-1186/
> > > .
> > > >
> > > > The git tag corresponding to the candidate is '1.4.0RC1'
> (10b9b9fae6).
> > > >
> > > > A detailed source and binary compatibility report for this release is
> > > > available for your review at
> > > > https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
> > > > hbase-1.3.1-1.4.0RC1_compatibility_report.html
> > > > . All reported compatibility issues should comply with policy but
> > please
> > > > review them carefully.
> > > >
> > > > A list of the 660 issues resolved in this release can be found at
> > > > https://s.apache.org/OErT .
> > > >
> > > > The changes since RC0 are:
> > > >
> > > > * [HBASE-19180] - Remove unused imports from AlwaysPasses
> > > > * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> > > > * [HBASE-19435] - Reopen Files for ClosedChannelException in
> > > > BucketCache
> > > > * [HBASE-19465] - Required httpcore and httpclient jars not
> > included
> > > in
> > > > binary distribution
> > > > * [HBASE-19467] - rsgroups shell commands don't properly display
> > > > elapsed time
> > > >
> > > > Please try out the candidate and vote +1/0/-1.
> > > >
> > > > This vote will be open for at least 72 hours. Unless objection I will
> > try
> > > > to close it Monday December 18, 2017 if we have sufficient votes.
> > > >
> > > > Prior to making this announcement I made the following preflight
> checks
> > > to
> > > > 1.4.0RC0 (3d571827cb):
> > > >
> > > > RAT check passes (7u80)
> > > > Unit test suite passes (8u131)
> > > > LTT load 1M rows with 100% verification and 20% updates (8u131)
> > > > PE randomWrite, randomRead, scanRange100 (8u131)
> > > > 100M rows ITBLL (8u131)
> > > >
> > > > and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
> > > >
> > > > RAT check passes (7u80)
> > > > Unit test suite passes (8u131)
> > > >
> > > > Between now and when I want to close the vote I'll write up human
> > > readable
> > > > release notes for the release announcement as promised.
> > > >
> > > > I also have agreed to run a scale ITBLL test, a performance
> comparison
> > > with
> > > > 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> > > > analysis of code and allocation hot spot changes from 1.2, all of
> > which I
> > > > will publish when available and factor in to my vote.
>
--
Best regards,
Andrew
Words like orphans lost among the crosstalk, meaning torn from truth's
decrepit hands
- A23, Crosstalk
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Stack <st...@duboce.net>.
Nice analysis Andy.
St.Ack
On Mon, Dec 18, 2017 at 11:54 AM, Andrew Purtell <ap...@apache.org>
wrote:
> And here are comparative profiling results between 1.2.6 and 1.4.0 RC1. I
> collected Flight Recorder traces for the randomRead, randomWrite,
> sequentialRead, sequentialWrite, and increment PerformanceEvaluation
> workloads. (Also, randomSeekScan but I think I made an error during test
> execution, so the data is included but not analyzed.) Traces were collected
> from the regionserver on a single host dev cluster running separate
> processes for namenode, datanode, zookeeper, master, regionserver, and PE
> client. To prime the system I loaded 10 million rows using './bin/hbase pe
> --nomapred --blockEncoding=FAST_DIFF --rows=10000000 randomWrite 1' and
> took a snapshot. For every workload I did the following:
>
> 1. Disable the table, restore from snapshot, enable the table
> 2. Shut down the regionserver
> 3. Start the regionserver
> 4. Start continuous profiling
> 5. Run the workload
> 6. Dump the JFR data
> 7. Repeat for next workload
>
> Because the lifetime of the regionserver process, therefore the JFR event
> trace, is the same as the workload you can compare all counts directly.
>
> Find the data here: https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_
> to_1.4.0RC1_jfr.tar.xz (17 MB)
>
> Some observations:
>
> - GC times are improved with 1.4.0 RC1 versus 1.2.6: fewer
> collections, shorter pause times, especially for read workloads
> - Object allocation counts are fewer with 1.4.0 RC1 versus 1.2.6
> - Object allocation rate is significantly decreased with 1.4.0 RC1
> versus 1.2.6, especially for read workloads. This can be explained I think
> by reduced allocation of byte[], which dominates out-of-TLAB counts (99% of
> all such allocations)
> - Allocation rate 3.5x less for sequentialRead workload
> - Allocation rate 1.9x less for randomRead workload
> - Allocation rate 2.2x less for increment workload
> - Typically, lower rates measured for allocations in TLABs too
> - Method profiles look pretty similar
> - On CPU time in ConcurrentSkipListMap in the 1.2.6 read traces is
> missing from the 1.4.0 RC1 read traces, except increment, where it is very
> similar. This might be an efficiency win.
>
>
> On Wed, Dec 13, 2017 at 7:24 PM, Andrew Purtell <ap...@apache.org>
> wrote:
>
>> And here are results for PE.
>>
>> https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.png
>> https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.xlsx
>>
>> [image: Inline image 1]
>>
>> Similar to the YCSB results, 1.2.6 and 1.4.0 RC1 are close, but 1.4.0 RC1
>> shows superior results.
>>
>> Cluster: 1 master, 5 regionservers, 1 client
>> AWS Instance Type: c3.4xlarge
>> Hadoop: 2.7.4
>> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>>
>> On Tue, Dec 12, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
>> wrote:
>>
>>> Here are results from a YCSB comparison between 1.2.6 and 1.4.0 RC1:
>>>
>>> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.png
>>> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.xlsx
>>>
>>> [image: Inline image 1]
>>>
>>> They are pretty closely matched but generally 1.4.0 RC1 shows superior
>>> results.
>>>
>>> [R] and [W] mean different things depending on YCSB workload. They will
>>> be obvious except for Workload F, where [R] is READ and [W] is UPDATE. I
>>> didn't include numbers for READ-MODIFY-WRITE.
>>>
>>> Cluster: 1 master, 5 regionservers, 1 client
>>> AWS Instance Type: c3.4xlarge
>>> Hadoop: 2.7.4
>>> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>>>
>>>
>>> On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
>>> wrote:
>>>
>>>> The second HBase 1.4.0 release candidate (RC1) is available for
>>>> download at https://dist.apache.org/repos/
>>>> dist/dev/hbase/hbase-1.4.0RC1/ and Maven artifacts are available in
>>>> the temporary repository https://repository.apache.org/
>>>> content/repositories/orgapachehbase-1186/ .
>>>>
>>>> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>>>>
>>>> A detailed source and binary compatibility report for this release is
>>>> available for your review at https://dist.apache.org/repos/
>>>> dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_compatibi
>>>> lity_report.html . All reported compatibility issues should comply
>>>> with policy but please review them carefully.
>>>>
>>>> A list of the 660 issues resolved in this release can be found at
>>>> https://s.apache.org/OErT .
>>>>
>>>> The changes since RC0 are:
>>>>
>>>> * [HBASE-19180] - Remove unused imports from AlwaysPasses
>>>> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
>>>> * [HBASE-19435] - Reopen Files for ClosedChannelException in
>>>> BucketCache
>>>> * [HBASE-19465] - Required httpcore and httpclient jars not
>>>> included in binary distribution
>>>> * [HBASE-19467] - rsgroups shell commands don't properly display
>>>> elapsed time
>>>>
>>>> Please try out the candidate and vote +1/0/-1.
>>>>
>>>> This vote will be open for at least 72 hours. Unless objection I will
>>>> try to close it Monday December 18, 2017 if we have sufficient votes.
>>>>
>>>> Prior to making this announcement I made the following preflight checks
>>>> to 1.4.0RC0 (3d571827cb):
>>>>
>>>> RAT check passes (7u80)
>>>> Unit test suite passes (8u131)
>>>> LTT load 1M rows with 100% verification and 20% updates (8u131)
>>>> PE randomWrite, randomRead, scanRange100 (8u131)
>>>> 100M rows ITBLL (8u131)
>>>>
>>>> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>>>>
>>>> RAT check passes (7u80)
>>>> Unit test suite passes (8u131)
>>>>
>>>> Between now and when I want to close the vote I'll write up human
>>>> readable release notes for the release announcement as promised.
>>>>
>>>> I also have agreed to run a scale ITBLL test, a performance comparison
>>>> with 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
>>>> analysis of code and allocation hot spot changes from 1.2, all of which I
>>>> will publish when available and factor in to my vote.
>>>>
>>>> --
>>>> Best regards,
>>>> Andrew
>>>>
>>>>
>>>
>>>
>>> --
>>> Best regards,
>>> Andrew
>>>
>>> Words like orphans lost among the crosstalk, meaning torn from truth's
>>> decrepit hands
>>> - A23, Crosstalk
>>>
>>
>>
>>
>> --
>> Best regards,
>> Andrew
>>
>> Words like orphans lost among the crosstalk, meaning torn from truth's
>> decrepit hands
>> - A23, Crosstalk
>>
>
>
>
> --
> Best regards,
> Andrew
>
> Words like orphans lost among the crosstalk, meaning torn from truth's
> decrepit hands
> - A23, Crosstalk
>
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Andrew Purtell <ap...@apache.org>.
And here are comparative profiling results between 1.2.6 and 1.4.0 RC1. I
collected Flight Recorder traces for the randomRead, randomWrite,
sequentialRead, sequentialWrite, and increment PerformanceEvaluation
workloads. (Also, randomSeekScan but I think I made an error during test
execution, so the data is included but not analyzed.) Traces were collected
from the regionserver on a single host dev cluster running separate
processes for namenode, datanode, zookeeper, master, regionserver, and PE
client. To prime the system I loaded 10 million rows using './bin/hbase pe
--nomapred --blockEncoding=FAST_DIFF --rows=10000000 randomWrite 1' and
took a snapshot. For every workload I did the following:
1. Disable the table, restore from snapshot, enable the table
2. Shut down the regionserver
3. Start the regionserver
4. Start continuous profiling
5. Run the workload
6. Dump the JFR data
7. Repeat for next workload
Because the lifetime of the regionserver process, therefore the JFR event
trace, is the same as the workload you can compare all counts directly.
Find the data here:
https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_to_1.4.0RC1_jfr.tar.xz
(17 MB)
Some observations:
- GC times are improved with 1.4.0 RC1 versus 1.2.6: fewer collections,
shorter pause times, especially for read workloads
- Object allocation counts are fewer with 1.4.0 RC1 versus 1.2.6
- Object allocation rate is significantly decreased with 1.4.0 RC1
versus 1.2.6, especially for read workloads. This can be explained I think
by reduced allocation of byte[], which dominates out-of-TLAB counts (99% of
all such allocations)
- Allocation rate 3.5x less for sequentialRead workload
- Allocation rate 1.9x less for randomRead workload
- Allocation rate 2.2x less for increment workload
- Typically, lower rates measured for allocations in TLABs too
- Method profiles look pretty similar
- On CPU time in ConcurrentSkipListMap in the 1.2.6 read traces is
missing from the 1.4.0 RC1 read traces, except increment, where it is very
similar. This might be an efficiency win.
On Wed, Dec 13, 2017 at 7:24 PM, Andrew Purtell <ap...@apache.org> wrote:
> And here are results for PE.
>
> https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.png
> https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.xlsx
>
> [image: Inline image 1]
>
> Similar to the YCSB results, 1.2.6 and 1.4.0 RC1 are close, but 1.4.0 RC1
> shows superior results.
>
> Cluster: 1 master, 5 regionservers, 1 client
> AWS Instance Type: c3.4xlarge
> Hadoop: 2.7.4
> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>
> On Tue, Dec 12, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
> wrote:
>
>> Here are results from a YCSB comparison between 1.2.6 and 1.4.0 RC1:
>>
>> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.png
>> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.xlsx
>>
>> [image: Inline image 1]
>>
>> They are pretty closely matched but generally 1.4.0 RC1 shows superior
>> results.
>>
>> [R] and [W] mean different things depending on YCSB workload. They will
>> be obvious except for Workload F, where [R] is READ and [W] is UPDATE. I
>> didn't include numbers for READ-MODIFY-WRITE.
>>
>> Cluster: 1 master, 5 regionservers, 1 client
>> AWS Instance Type: c3.4xlarge
>> Hadoop: 2.7.4
>> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>>
>>
>> On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
>> wrote:
>>
>>> The second HBase 1.4.0 release candidate (RC1) is available for
>>> download at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
>>> and Maven artifacts are available in the temporary repository
>>> https://repository.apache.org/content/repositories/orgapachehbase-1186/
>>> .
>>>
>>> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>>>
>>> A detailed source and binary compatibility report for this release is
>>> available for your review at https://dist.apache.org/repos/
>>> dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_compatibi
>>> lity_report.html . All reported compatibility issues should comply
>>> with policy but please review them carefully.
>>>
>>> A list of the 660 issues resolved in this release can be found at
>>> https://s.apache.org/OErT .
>>>
>>> The changes since RC0 are:
>>>
>>> * [HBASE-19180] - Remove unused imports from AlwaysPasses
>>> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
>>> * [HBASE-19435] - Reopen Files for ClosedChannelException in
>>> BucketCache
>>> * [HBASE-19465] - Required httpcore and httpclient jars not included
>>> in binary distribution
>>> * [HBASE-19467] - rsgroups shell commands don't properly display
>>> elapsed time
>>>
>>> Please try out the candidate and vote +1/0/-1.
>>>
>>> This vote will be open for at least 72 hours. Unless objection I will
>>> try to close it Monday December 18, 2017 if we have sufficient votes.
>>>
>>> Prior to making this announcement I made the following preflight checks
>>> to 1.4.0RC0 (3d571827cb):
>>>
>>> RAT check passes (7u80)
>>> Unit test suite passes (8u131)
>>> LTT load 1M rows with 100% verification and 20% updates (8u131)
>>> PE randomWrite, randomRead, scanRange100 (8u131)
>>> 100M rows ITBLL (8u131)
>>>
>>> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>>>
>>> RAT check passes (7u80)
>>> Unit test suite passes (8u131)
>>>
>>> Between now and when I want to close the vote I'll write up human
>>> readable release notes for the release announcement as promised.
>>>
>>> I also have agreed to run a scale ITBLL test, a performance comparison
>>> with 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
>>> analysis of code and allocation hot spot changes from 1.2, all of which I
>>> will publish when available and factor in to my vote.
>>>
>>> --
>>> Best regards,
>>> Andrew
>>>
>>>
>>
>>
>> --
>> Best regards,
>> Andrew
>>
>> Words like orphans lost among the crosstalk, meaning torn from truth's
>> decrepit hands
>> - A23, Crosstalk
>>
>
>
>
> --
> Best regards,
> Andrew
>
> Words like orphans lost among the crosstalk, meaning torn from truth's
> decrepit hands
> - A23, Crosstalk
>
--
Best regards,
Andrew
Words like orphans lost among the crosstalk, meaning torn from truth's
decrepit hands
- A23, Crosstalk
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Zach York <zy...@gmail.com>.
+1 (non-binding)
* checked signatures
* build passes (1.8.0_92)
* 1 unit test failed on my test run, but passed on rerun:
** [ERROR] Errors:
** [ERROR] TestHTraceHooks.testTraceCreateTable:130 »
ConcurrentModification
On Wed, Dec 13, 2017 at 7:24 PM, Andrew Purtell <ap...@apache.org> wrote:
> And here are results for PE.
>
> https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.png
> https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.xlsx
>
> [image: Inline image 1]
>
> Similar to the YCSB results, 1.2.6 and 1.4.0 RC1 are close, but 1.4.0 RC1
> shows superior results.
>
> Cluster: 1 master, 5 regionservers, 1 client
> AWS Instance Type: c3.4xlarge
> Hadoop: 2.7.4
> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>
> On Tue, Dec 12, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
> wrote:
>
>> Here are results from a YCSB comparison between 1.2.6 and 1.4.0 RC1:
>>
>> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.png
>> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.xlsx
>>
>> [image: Inline image 1]
>>
>> They are pretty closely matched but generally 1.4.0 RC1 shows superior
>> results.
>>
>> [R] and [W] mean different things depending on YCSB workload. They will
>> be obvious except for Workload F, where [R] is READ and [W] is UPDATE. I
>> didn't include numbers for READ-MODIFY-WRITE.
>>
>> Cluster: 1 master, 5 regionservers, 1 client
>> AWS Instance Type: c3.4xlarge
>> Hadoop: 2.7.4
>> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>>
>>
>> On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
>> wrote:
>>
>>> The second HBase 1.4.0 release candidate (RC1) is available for
>>> download at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/
>>> and Maven artifacts are available in the temporary repository
>>> https://repository.apache.org/content/repositories/orgapachehbase-1186/
>>> .
>>>
>>> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>>>
>>> A detailed source and binary compatibility report for this release is
>>> available for your review at https://dist.apache.org/repos/
>>> dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_compatibi
>>> lity_report.html . All reported compatibility issues should comply
>>> with policy but please review them carefully.
>>>
>>> A list of the 660 issues resolved in this release can be found at
>>> https://s.apache.org/OErT .
>>>
>>> The changes since RC0 are:
>>>
>>> * [HBASE-19180] - Remove unused imports from AlwaysPasses
>>> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
>>> * [HBASE-19435] - Reopen Files for ClosedChannelException in
>>> BucketCache
>>> * [HBASE-19465] - Required httpcore and httpclient jars not included
>>> in binary distribution
>>> * [HBASE-19467] - rsgroups shell commands don't properly display
>>> elapsed time
>>>
>>> Please try out the candidate and vote +1/0/-1.
>>>
>>> This vote will be open for at least 72 hours. Unless objection I will
>>> try to close it Monday December 18, 2017 if we have sufficient votes.
>>>
>>> Prior to making this announcement I made the following preflight checks
>>> to 1.4.0RC0 (3d571827cb):
>>>
>>> RAT check passes (7u80)
>>> Unit test suite passes (8u131)
>>> LTT load 1M rows with 100% verification and 20% updates (8u131)
>>> PE randomWrite, randomRead, scanRange100 (8u131)
>>> 100M rows ITBLL (8u131)
>>>
>>> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>>>
>>> RAT check passes (7u80)
>>> Unit test suite passes (8u131)
>>>
>>> Between now and when I want to close the vote I'll write up human
>>> readable release notes for the release announcement as promised.
>>>
>>> I also have agreed to run a scale ITBLL test, a performance comparison
>>> with 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
>>> analysis of code and allocation hot spot changes from 1.2, all of which I
>>> will publish when available and factor in to my vote.
>>>
>>> --
>>> Best regards,
>>> Andrew
>>>
>>>
>>
>>
>> --
>> Best regards,
>> Andrew
>>
>> Words like orphans lost among the crosstalk, meaning torn from truth's
>> decrepit hands
>> - A23, Crosstalk
>>
>
>
>
> --
> Best regards,
> Andrew
>
> Words like orphans lost among the crosstalk, meaning torn from truth's
> decrepit hands
> - A23, Crosstalk
>
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Andrew Purtell <ap...@apache.org>.
And here are results for PE.
https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.png
https://bigdatasf.s3.amazonaws.com/assets/pe_1.2.6_1.4.0RC1.xlsx
[image: Inline image 1]
Similar to the YCSB results, 1.2.6 and 1.4.0 RC1 are close, but 1.4.0 RC1
shows superior results.
Cluster: 1 master, 5 regionservers, 1 client
AWS Instance Type: c3.4xlarge
Hadoop: 2.7.4
OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
On Tue, Dec 12, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org> wrote:
> Here are results from a YCSB comparison between 1.2.6 and 1.4.0 RC1:
>
> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.png
> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.xlsx
>
> [image: Inline image 1]
>
> They are pretty closely matched but generally 1.4.0 RC1 shows superior
> results.
>
> [R] and [W] mean different things depending on YCSB workload. They will be
> obvious except for Workload F, where [R] is READ and [W] is UPDATE. I
> didn't include numbers for READ-MODIFY-WRITE.
>
> Cluster: 1 master, 5 regionservers, 1 client
> AWS Instance Type: c3.4xlarge
> Hadoop: 2.7.4
> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>
>
> On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
> wrote:
>
>> The second HBase 1.4.0 release candidate (RC1) is available for download
>> at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and
>> Maven artifacts are available in the temporary repository
>> https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
>>
>> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>>
>> A detailed source and binary compatibility report for this release is
>> available for your review at https://dist.apache.org/repos/
>> dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_compatibi
>> lity_report.html . All reported compatibility issues should comply with
>> policy but please review them carefully.
>>
>> A list of the 660 issues resolved in this release can be found at
>> https://s.apache.org/OErT .
>>
>> The changes since RC0 are:
>>
>> * [HBASE-19180] - Remove unused imports from AlwaysPasses
>> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
>> * [HBASE-19435] - Reopen Files for ClosedChannelException in
>> BucketCache
>> * [HBASE-19465] - Required httpcore and httpclient jars not included
>> in binary distribution
>> * [HBASE-19467] - rsgroups shell commands don't properly display
>> elapsed time
>>
>> Please try out the candidate and vote +1/0/-1.
>>
>> This vote will be open for at least 72 hours. Unless objection I will try
>> to close it Monday December 18, 2017 if we have sufficient votes.
>>
>> Prior to making this announcement I made the following preflight checks
>> to 1.4.0RC0 (3d571827cb):
>>
>> RAT check passes (7u80)
>> Unit test suite passes (8u131)
>> LTT load 1M rows with 100% verification and 20% updates (8u131)
>> PE randomWrite, randomRead, scanRange100 (8u131)
>> 100M rows ITBLL (8u131)
>>
>> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>>
>> RAT check passes (7u80)
>> Unit test suite passes (8u131)
>>
>> Between now and when I want to close the vote I'll write up human
>> readable release notes for the release announcement as promised.
>>
>> I also have agreed to run a scale ITBLL test, a performance comparison
>> with 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
>> analysis of code and allocation hot spot changes from 1.2, all of which I
>> will publish when available and factor in to my vote.
>>
>> --
>> Best regards,
>> Andrew
>>
>>
>
>
> --
> Best regards,
> Andrew
>
> Words like orphans lost among the crosstalk, meaning torn from truth's
> decrepit hands
> - A23, Crosstalk
>
--
Best regards,
Andrew
Words like orphans lost among the crosstalk, meaning torn from truth's
decrepit hands
- A23, Crosstalk
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Andrew Purtell <ap...@apache.org>.
Times are in milliseconds.
On Tue, Dec 12, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org> wrote:
> Here are results from a YCSB comparison between 1.2.6 and 1.4.0 RC1:
>
> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.png
> https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.xlsx
>
> [image: Inline image 1]
>
> They are pretty closely matched but generally 1.4.0 RC1 shows superior
> results.
>
> [R] and [W] mean different things depending on YCSB workload. They will be
> obvious except for Workload F, where [R] is READ and [W] is UPDATE. I
> didn't include numbers for READ-MODIFY-WRITE.
>
> Cluster: 1 master, 5 regionservers, 1 client
> AWS Instance Type: c3.4xlarge
> Hadoop: 2.7.4
> OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
>
>
> On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org>
> wrote:
>
>> The second HBase 1.4.0 release candidate (RC1) is available for download
>> at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and
>> Maven artifacts are available in the temporary repository
>> https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
>>
>> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>>
>> A detailed source and binary compatibility report for this release is
>> available for your review at https://dist.apache.org/repos/
>> dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_compatibi
>> lity_report.html . All reported compatibility issues should comply with
>> policy but please review them carefully.
>>
>> A list of the 660 issues resolved in this release can be found at
>> https://s.apache.org/OErT .
>>
>> The changes since RC0 are:
>>
>> * [HBASE-19180] - Remove unused imports from AlwaysPasses
>> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
>> * [HBASE-19435] - Reopen Files for ClosedChannelException in
>> BucketCache
>> * [HBASE-19465] - Required httpcore and httpclient jars not included
>> in binary distribution
>> * [HBASE-19467] - rsgroups shell commands don't properly display
>> elapsed time
>>
>> Please try out the candidate and vote +1/0/-1.
>>
>> This vote will be open for at least 72 hours. Unless objection I will try
>> to close it Monday December 18, 2017 if we have sufficient votes.
>>
>> Prior to making this announcement I made the following preflight checks
>> to 1.4.0RC0 (3d571827cb):
>>
>> RAT check passes (7u80)
>> Unit test suite passes (8u131)
>> LTT load 1M rows with 100% verification and 20% updates (8u131)
>> PE randomWrite, randomRead, scanRange100 (8u131)
>> 100M rows ITBLL (8u131)
>>
>> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>>
>> RAT check passes (7u80)
>> Unit test suite passes (8u131)
>>
>> Between now and when I want to close the vote I'll write up human
>> readable release notes for the release announcement as promised.
>>
>> I also have agreed to run a scale ITBLL test, a performance comparison
>> with 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
>> analysis of code and allocation hot spot changes from 1.2, all of which I
>> will publish when available and factor in to my vote.
>>
>> --
>> Best regards,
>> Andrew
>>
>>
>
>
> --
> Best regards,
> Andrew
>
> Words like orphans lost among the crosstalk, meaning torn from truth's
> decrepit hands
> - A23, Crosstalk
>
--
Best regards,
Andrew
Words like orphans lost among the crosstalk, meaning torn from truth's
decrepit hands
- A23, Crosstalk
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Andrew Purtell <ap...@apache.org>.
Here are results from a YCSB comparison between 1.2.6 and 1.4.0 RC1:
https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.png
https://bigdatasf.s3.amazonaws.com/assets/ycsb_1.2.6_to_1.4.0RC1.xlsx
[image: Inline image 1]
They are pretty closely matched but generally 1.4.0 RC1 shows superior
results.
[R] and [W] mean different things depending on YCSB workload. They will be
obvious except for Workload F, where [R] is READ and [W] is UPDATE. I
didn't include numbers for READ-MODIFY-WRITE.
Cluster: 1 master, 5 regionservers, 1 client
AWS Instance Type: c3.4xlarge
Hadoop: 2.7.4
OS: Amazon Linux AMI 2017.09, kernel 4.4.51-40.58.amzn1.x86_64
On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org> wrote:
> The second HBase 1.4.0 release candidate (RC1) is available for download
> at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and Maven
> artifacts are available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
>
> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>
> A detailed source and binary compatibility report for this release is
> available for your review at https://dist.apache.org/repos/
> dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_
> compatibility_report.html . All reported compatibility issues should
> comply with policy but please review them carefully.
>
> A list of the 660 issues resolved in this release can be found at
> https://s.apache.org/OErT .
>
> The changes since RC0 are:
>
> * [HBASE-19180] - Remove unused imports from AlwaysPasses
> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> * [HBASE-19435] - Reopen Files for ClosedChannelException in
> BucketCache
> * [HBASE-19465] - Required httpcore and httpclient jars not included
> in binary distribution
> * [HBASE-19467] - rsgroups shell commands don't properly display
> elapsed time
>
> Please try out the candidate and vote +1/0/-1.
>
> This vote will be open for at least 72 hours. Unless objection I will try
> to close it Monday December 18, 2017 if we have sufficient votes.
>
> Prior to making this announcement I made the following preflight checks to
> 1.4.0RC0 (3d571827cb):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
> LTT load 1M rows with 100% verification and 20% updates (8u131)
> PE randomWrite, randomRead, scanRange100 (8u131)
> 100M rows ITBLL (8u131)
>
> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
>
> Between now and when I want to close the vote I'll write up human readable
> release notes for the release announcement as promised.
>
> I also have agreed to run a scale ITBLL test, a performance comparison
> with 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> analysis of code and allocation hot spot changes from 1.2, all of which I
> will publish when available and factor in to my vote.
>
> --
> Best regards,
> Andrew
>
>
--
Best regards,
Andrew
Words like orphans lost among the crosstalk, meaning torn from truth's
decrepit hands
- A23, Crosstalk
Re: [VOTE] The second HBase 1.4.0 release candidate (RC1) is available
Posted by Andrew Purtell <ap...@apache.org>.
For those who voted on RC0, are you willing to transfer your vote to RC1?
If so, please cast it. There were 5 changes in RC1 not in RC0. See below
for the list.
On Fri, Dec 8, 2017 at 5:50 PM, Andrew Purtell <ap...@apache.org> wrote:
> The second HBase 1.4.0 release candidate (RC1) is available for download
> at https://dist.apache.org/repos/dist/dev/hbase/hbase-1.4.0RC1/ and Maven
> artifacts are available in the temporary repository
> https://repository.apache.org/content/repositories/orgapachehbase-1186/ .
>
> The git tag corresponding to the candidate is '1.4.0RC1' (10b9b9fae6).
>
> A detailed source and binary compatibility report for this release is
> available for your review at https://dist.apache.org/repos/
> dist/dev/hbase/hbase-1.4.0RC1/hbase-1.3.1-1.4.0RC1_
> compatibility_report.html . All reported compatibility issues should
> comply with policy but please review them carefully.
>
> A list of the 660 issues resolved in this release can be found at
> https://s.apache.org/OErT .
>
> The changes since RC0 are:
>
> * [HBASE-19180] - Remove unused imports from AlwaysPasses
> * [HBASE-19373] - Fix Checkstyle error in hbase-annotations
> * [HBASE-19435] - Reopen Files for ClosedChannelException in
> BucketCache
> * [HBASE-19465] - Required httpcore and httpclient jars not included
> in binary distribution
> * [HBASE-19467] - rsgroups shell commands don't properly display
> elapsed time
>
> Please try out the candidate and vote +1/0/-1.
>
> This vote will be open for at least 72 hours. Unless objection I will try
> to close it Monday December 18, 2017 if we have sufficient votes.
>
> Prior to making this announcement I made the following preflight checks to
> 1.4.0RC0 (3d571827cb):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
> LTT load 1M rows with 100% verification and 20% updates (8u131)
> PE randomWrite, randomRead, scanRange100 (8u131)
> 100M rows ITBLL (8u131)
>
> and the following preflight checks to 1.4.0RC1 (10b9b9fae6):
>
> RAT check passes (7u80)
> Unit test suite passes (8u131)
>
> Between now and when I want to close the vote I'll write up human readable
> release notes for the release announcement as promised.
>
> I also have agreed to run a scale ITBLL test, a performance comparison
> with 1.2 using YCSB, a performance comparison with 1.2 using PE, and an
> analysis of code and allocation hot spot changes from 1.2, all of which I
> will publish when available and factor in to my vote.
>
> --
> Best regards,
> Andrew
>
>
--
Best regards,
Andrew
Words like orphans lost among the crosstalk, meaning torn from truth's
decrepit hands
- A23, Crosstalk