You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by lars hofhansl <la...@apache.org> on 2013/07/19 23:33:51 UTC
[ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download
The 1st 0.94.10 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.10-rc0/
Signed with my code signing key: C7CFE328
Like the previous point releases, 0.94.10 is a primarily a bug fix release. This RC has 35 issues resolved against it:
[HBASE-8774] - Add BatchSize and Filter to Thrift2
[HBASE-8819] - Port HBASE-5428 to Thrift 2
[HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
[HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
[HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to Thrift2 - Add BatchSize Test
[HBASE-8938] - Thrift2 does not close scanner instance
[HBASE-8432] - a
table with unbalanced regions will balance indefinitely with the 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
[HBASE-8678] - Wrongly delete cells in some case which can not be deleted
[HBASE-8695] - The HBase thrift service ignores XML configuration
[HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
[HBASE-8782] - Thrift2 can not parse values when using framed transport
[HBASE-8794] - DependentColumnFilter.toString() throws NullPointerException
[HBASE-8811] - REST service ignores misspelled "check=" parameter, causing unexpected mutations
[HBASE-8814] - Possible NPE in split if a region has empty store files.
[HBASE-8858] - Backport hbase-6979 "recovered.edits file should not break distributed log splitting"
[HBASE-8910] -
HMaster.abortNow shouldn't try to become a master again if it was stopped
[HBASE-8967] - Duplicate call to snapshotManager.stop() in HRegionServer
[HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log the master address which already read from the zk.
[HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
[HBASE-8988] - Reuse the thread pool in the shell to not run out of threads
[HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is minimal
[HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
[HBASE-8806] - Row locks are acquired repeatedly in HRegion.doMiniBatchMutation for duplicate rows.
[HBASE-8809] - Include deletes in the scan (setRaw) method does not respect the time range or the filter
[HBASE-8847] -
Filter.transform() always applies unconditionally, even when combined in a FilterList
[HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test to Test MTTR) to 0.94
[HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
[HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and Improve ExplicitColumnTracker performance.
[HBASE-8829] - Improve failed TestMetaScanner assert message so can see where/why failure
[HBASE-7770] - minor integration test framework fixes
[HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
[HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is flaky
[HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow addition of more actions and policies.
[HBASE-8934] -
Fix bunch of flaky tests
[HBASE-8969] - Backport HBASE-8535+HBASE-8586 TestHCM#testDeleteForZKConnLeak enhancement to 0.94
The list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
Here're the jenkins runs for this RC: https://builds.apache.org/job/HBase-0.94.10/1/ and https://builds.apache.org/job/HBase-0.94.10-security/1/
Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 26th on whether we should release this as 0.94.10.
The release testing spreadsheet is available here:
https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
(if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
Thanks.
-- Lars
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Filed HBASE-9037.
________________________________
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev <de...@hbase.apache.org>
Sent: Wednesday, July 24, 2013 3:27 PM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download
I turn logs to info in all my test because of that...
Le 2013-07-24 18:22, "Jean-Daniel Cryans" <jd...@apache.org> a écrit :
> Yeah AFAIK it's almost always been like this.
>
> J-D
>
> On Wed, Jul 24, 2013 at 11:17 AM, lars hofhansl <la...@apache.org> wrote:
> > Thanks Stack!
> >
> > Hmm... That log message is not new. That's a pretty small block cache,
> so probably needs to evict often.
> > Could be a little less verbose about it, or make this trace.
> >
> >
> > -- Lars
> >
> >
> >
> > ________________________________
> > From: Stack <st...@duboce.net>
> > To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <
> larsh@apache.org>
> > Sent: Wednesday, July 24, 2013 11:04 AM
> > Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is
> available for download
> >
> >
> > +1
> >
> > Compared md5s.
> > Dir layout looks right.
> > Doc checks out.
> > Runs fine in standalone mode.
> > Loaded some data. Confirmed it is there.
> > Restarted. Reconfirmed data still there.
> > Checked logs.
> >
> > I see this every 4ms or so when reading.
> >
> > 21 2013-07-24 10:55:24,594 DEBUG
> > org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> > completed; freed=24.78 MB, total=185.13 MB, single=0 KB, multi=207.88 MB,
> > memory=0.64 KB
> > 20 2013-07-24 10:55:28,975 DEBUG
> > org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> > started; Attempting to free 24.75 MB of total=209.91 MB
> >
> > Loads of it. Not enough to sink the RC but annoying.
> >
> > St.Ack
> >
> >
> > On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl <la...@apache.org> wrote:
> >
> >> The 1st 0.94.10 RC is available for download at
> >> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> >> Signed with my code signing key: C7CFE328
> >>
> >> Like the previous point releases, 0.94.10 is a primarily a bug fix
> >> release. This RC has 35 issues resolved against it:
> >> [HBASE-8774] - Add BatchSize and Filter to Thrift2
> >> [HBASE-8819] - Port HBASE-5428 to Thrift 2
> >> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> >> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> >> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> >> Thrift2 - Add BatchSize Test
> >> [HBASE-8938] - Thrift2 does not close scanner instance
> >> [HBASE-8432] - a
> >> table with unbalanced regions will balance indefinitely with the
> >> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> >> [HBASE-8678] - Wrongly delete cells in some case which can not be
> >> deleted
> >> [HBASE-8695] - The HBase thrift service ignores XML configuration
> >> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> >> [HBASE-8782] - Thrift2 can not parse values when using framed
> transport
> >> [HBASE-8794] - DependentColumnFilter.toString() throws
> >> NullPointerException
> >> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> >> causing unexpected mutations
> >> [HBASE-8814] - Possible NPE in split if a region has empty store
> files.
> >> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> >> break distributed log splitting"
> >> [HBASE-8910] -
> >> HMaster.abortNow shouldn't try to become a master again if it was
> stopped
> >> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> >> HRegionServer
> >> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> >> the master address which already read from the zk.
> >> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> >> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> >> threads
> >> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag
> is
> >> minimal
> >> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> >> [HBASE-8806] - Row locks are acquired repeatedly in
> >> HRegion.doMiniBatchMutation for duplicate rows.
> >> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> >> respect the time range or the filter
> >> [HBASE-8847] -
> >> Filter.transform() always applies unconditionally, even when combined
> in
> >> a FilterList
> >> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration
> Test
> >> to Test MTTR) to 0.94
> >> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> >> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> >> Improve ExplicitColumnTracker performance.
> >> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> >> see where/why failure
> >> [HBASE-7770] - minor integration test framework fixes
> >> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> >> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort
> is
> >> flaky
> >> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to
> allow
> >> addition of more actions and policies.
> >> [HBASE-8934] -
> >> Fix bunch of flaky tests
> >> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> >> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
> >>
> >> The list of changes is also available here:
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
> >>
> >> Here're the jenkins runs for this RC:
> >> https://builds.apache.org/job/HBase-0.94.10/1/ and
> >> https://builds.apache.org/job/HBase-0.94.10-security/1/
> >>
> >> Please try out the RC, check out the doc, take it for a spin, etc, and
> >> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
> >>
> >> The release testing spreadsheet is available here:
> >>
> >>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> >> (if you test this release, please add your test to this spreadsheet, so
> >> that we can gauge the coverage)
> >>
> >> Thanks.
> >>
> >> -- Lars
>
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
I turn logs to info in all my test because of that...
Le 2013-07-24 18:22, "Jean-Daniel Cryans" <jd...@apache.org> a écrit :
> Yeah AFAIK it's almost always been like this.
>
> J-D
>
> On Wed, Jul 24, 2013 at 11:17 AM, lars hofhansl <la...@apache.org> wrote:
> > Thanks Stack!
> >
> > Hmm... That log message is not new. That's a pretty small block cache,
> so probably needs to evict often.
> > Could be a little less verbose about it, or make this trace.
> >
> >
> > -- Lars
> >
> >
> >
> > ________________________________
> > From: Stack <st...@duboce.net>
> > To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <
> larsh@apache.org>
> > Sent: Wednesday, July 24, 2013 11:04 AM
> > Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is
> available for download
> >
> >
> > +1
> >
> > Compared md5s.
> > Dir layout looks right.
> > Doc checks out.
> > Runs fine in standalone mode.
> > Loaded some data. Confirmed it is there.
> > Restarted. Reconfirmed data still there.
> > Checked logs.
> >
> > I see this every 4ms or so when reading.
> >
> > 21 2013-07-24 10:55:24,594 DEBUG
> > org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> > completed; freed=24.78 MB, total=185.13 MB, single=0 KB, multi=207.88 MB,
> > memory=0.64 KB
> > 20 2013-07-24 10:55:28,975 DEBUG
> > org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> > started; Attempting to free 24.75 MB of total=209.91 MB
> >
> > Loads of it. Not enough to sink the RC but annoying.
> >
> > St.Ack
> >
> >
> > On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl <la...@apache.org> wrote:
> >
> >> The 1st 0.94.10 RC is available for download at
> >> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> >> Signed with my code signing key: C7CFE328
> >>
> >> Like the previous point releases, 0.94.10 is a primarily a bug fix
> >> release. This RC has 35 issues resolved against it:
> >> [HBASE-8774] - Add BatchSize and Filter to Thrift2
> >> [HBASE-8819] - Port HBASE-5428 to Thrift 2
> >> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> >> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> >> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> >> Thrift2 - Add BatchSize Test
> >> [HBASE-8938] - Thrift2 does not close scanner instance
> >> [HBASE-8432] - a
> >> table with unbalanced regions will balance indefinitely with the
> >> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> >> [HBASE-8678] - Wrongly delete cells in some case which can not be
> >> deleted
> >> [HBASE-8695] - The HBase thrift service ignores XML configuration
> >> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> >> [HBASE-8782] - Thrift2 can not parse values when using framed
> transport
> >> [HBASE-8794] - DependentColumnFilter.toString() throws
> >> NullPointerException
> >> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> >> causing unexpected mutations
> >> [HBASE-8814] - Possible NPE in split if a region has empty store
> files.
> >> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> >> break distributed log splitting"
> >> [HBASE-8910] -
> >> HMaster.abortNow shouldn't try to become a master again if it was
> stopped
> >> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> >> HRegionServer
> >> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> >> the master address which already read from the zk.
> >> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> >> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> >> threads
> >> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag
> is
> >> minimal
> >> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> >> [HBASE-8806] - Row locks are acquired repeatedly in
> >> HRegion.doMiniBatchMutation for duplicate rows.
> >> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> >> respect the time range or the filter
> >> [HBASE-8847] -
> >> Filter.transform() always applies unconditionally, even when combined
> in
> >> a FilterList
> >> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration
> Test
> >> to Test MTTR) to 0.94
> >> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> >> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> >> Improve ExplicitColumnTracker performance.
> >> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> >> see where/why failure
> >> [HBASE-7770] - minor integration test framework fixes
> >> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> >> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort
> is
> >> flaky
> >> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to
> allow
> >> addition of more actions and policies.
> >> [HBASE-8934] -
> >> Fix bunch of flaky tests
> >> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> >> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
> >>
> >> The list of changes is also available here:
> >>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
> >>
> >> Here're the jenkins runs for this RC:
> >> https://builds.apache.org/job/HBase-0.94.10/1/ and
> >> https://builds.apache.org/job/HBase-0.94.10-security/1/
> >>
> >> Please try out the RC, check out the doc, take it for a spin, etc, and
> >> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
> >>
> >> The release testing spreadsheet is available here:
> >>
> >>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> >> (if you test this release, please add your test to this spreadsheet, so
> >> that we can gauge the coverage)
> >>
> >> Thanks.
> >>
> >> -- Lars
>
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available
for download
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Yeah AFAIK it's almost always been like this.
J-D
On Wed, Jul 24, 2013 at 11:17 AM, lars hofhansl <la...@apache.org> wrote:
> Thanks Stack!
>
> Hmm... That log message is not new. That's a pretty small block cache, so probably needs to evict often.
> Could be a little less verbose about it, or make this trace.
>
>
> -- Lars
>
>
>
> ________________________________
> From: Stack <st...@duboce.net>
> To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Sent: Wednesday, July 24, 2013 11:04 AM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download
>
>
> +1
>
> Compared md5s.
> Dir layout looks right.
> Doc checks out.
> Runs fine in standalone mode.
> Loaded some data. Confirmed it is there.
> Restarted. Reconfirmed data still there.
> Checked logs.
>
> I see this every 4ms or so when reading.
>
> 21 2013-07-24 10:55:24,594 DEBUG
> org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> completed; freed=24.78 MB, total=185.13 MB, single=0 KB, multi=207.88 MB,
> memory=0.64 KB
> 20 2013-07-24 10:55:28,975 DEBUG
> org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
> started; Attempting to free 24.75 MB of total=209.91 MB
>
> Loads of it. Not enough to sink the RC but annoying.
>
> St.Ack
>
>
> On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl <la...@apache.org> wrote:
>
>> The 1st 0.94.10 RC is available for download at
>> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
>> Signed with my code signing key: C7CFE328
>>
>> Like the previous point releases, 0.94.10 is a primarily a bug fix
>> release. This RC has 35 issues resolved against it:
>> [HBASE-8774] - Add BatchSize and Filter to Thrift2
>> [HBASE-8819] - Port HBASE-5428 to Thrift 2
>> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
>> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
>> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
>> Thrift2 - Add BatchSize Test
>> [HBASE-8938] - Thrift2 does not close scanner instance
>> [HBASE-8432] - a
>> table with unbalanced regions will balance indefinitely with the
>> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
>> [HBASE-8678] - Wrongly delete cells in some case which can not be
>> deleted
>> [HBASE-8695] - The HBase thrift service ignores XML configuration
>> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
>> [HBASE-8782] - Thrift2 can not parse values when using framed transport
>> [HBASE-8794] - DependentColumnFilter.toString() throws
>> NullPointerException
>> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
>> causing unexpected mutations
>> [HBASE-8814] - Possible NPE in split if a region has empty store files.
>> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
>> break distributed log splitting"
>> [HBASE-8910] -
>> HMaster.abortNow shouldn't try to become a master again if it was stopped
>> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
>> HRegionServer
>> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
>> the master address which already read from the zk.
>> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
>> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
>> threads
>> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is
>> minimal
>> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
>> [HBASE-8806] - Row locks are acquired repeatedly in
>> HRegion.doMiniBatchMutation for duplicate rows.
>> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
>> respect the time range or the filter
>> [HBASE-8847] -
>> Filter.transform() always applies unconditionally, even when combined in
>> a FilterList
>> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test
>> to Test MTTR) to 0.94
>> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
>> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
>> Improve ExplicitColumnTracker performance.
>> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
>> see where/why failure
>> [HBASE-7770] - minor integration test framework fixes
>> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
>> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is
>> flaky
>> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow
>> addition of more actions and policies.
>> [HBASE-8934] -
>> Fix bunch of flaky tests
>> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
>> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
>>
>> The list of changes is also available here:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
>>
>> Here're the jenkins runs for this RC:
>> https://builds.apache.org/job/HBase-0.94.10/1/ and
>> https://builds.apache.org/job/HBase-0.94.10-security/1/
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and
>> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
>>
>> The release testing spreadsheet is available here:
>>
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
>> (if you test this release, please add your test to this spreadsheet, so
>> that we can gauge the coverage)
>>
>> Thanks.
>>
>> -- Lars
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Thanks Stack!
Hmm... That log message is not new. That's a pretty small block cache, so probably needs to evict often.
Could be a little less verbose about it, or make this trace.
-- Lars
________________________________
From: Stack <st...@duboce.net>
To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Sent: Wednesday, July 24, 2013 11:04 AM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download
+1
Compared md5s.
Dir layout looks right.
Doc checks out.
Runs fine in standalone mode.
Loaded some data. Confirmed it is there.
Restarted. Reconfirmed data still there.
Checked logs.
I see this every 4ms or so when reading.
21 2013-07-24 10:55:24,594 DEBUG
org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
completed; freed=24.78 MB, total=185.13 MB, single=0 KB, multi=207.88 MB,
memory=0.64 KB
20 2013-07-24 10:55:28,975 DEBUG
org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
started; Attempting to free 24.75 MB of total=209.91 MB
Loads of it. Not enough to sink the RC but annoying.
St.Ack
On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl <la...@apache.org> wrote:
> The 1st 0.94.10 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.10 is a primarily a bug fix
> release. This RC has 35 issues resolved against it:
> [HBASE-8774] - Add BatchSize and Filter to Thrift2
> [HBASE-8819] - Port HBASE-5428 to Thrift 2
> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> Thrift2 - Add BatchSize Test
> [HBASE-8938] - Thrift2 does not close scanner instance
> [HBASE-8432] - a
> table with unbalanced regions will balance indefinitely with the
> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> [HBASE-8678] - Wrongly delete cells in some case which can not be
> deleted
> [HBASE-8695] - The HBase thrift service ignores XML configuration
> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> [HBASE-8782] - Thrift2 can not parse values when using framed transport
> [HBASE-8794] - DependentColumnFilter.toString() throws
> NullPointerException
> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> causing unexpected mutations
> [HBASE-8814] - Possible NPE in split if a region has empty store files.
> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> break distributed log splitting"
> [HBASE-8910] -
> HMaster.abortNow shouldn't try to become a master again if it was stopped
> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> HRegionServer
> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> the master address which already read from the zk.
> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> threads
> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is
> minimal
> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> [HBASE-8806] - Row locks are acquired repeatedly in
> HRegion.doMiniBatchMutation for duplicate rows.
> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> respect the time range or the filter
> [HBASE-8847] -
> Filter.transform() always applies unconditionally, even when combined in
> a FilterList
> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test
> to Test MTTR) to 0.94
> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> Improve ExplicitColumnTracker performance.
> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> see where/why failure
> [HBASE-7770] - minor integration test framework fixes
> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is
> flaky
> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow
> addition of more actions and policies.
> [HBASE-8934] -
> Fix bunch of flaky tests
> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.10/1/ and
> https://builds.apache.org/job/HBase-0.94.10-security/1/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
>
> The release testing spreadsheet is available here:
>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> (if you test this release, please add your test to this spreadsheet, so
> that we can gauge the coverage)
>
> Thanks.
>
> -- Lars
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available
for download
Posted by Stack <st...@duboce.net>.
+1
Compared md5s.
Dir layout looks right.
Doc checks out.
Runs fine in standalone mode.
Loaded some data. Confirmed it is there.
Restarted. Reconfirmed data still there.
Checked logs.
I see this every 4ms or so when reading.
21 2013-07-24 10:55:24,594 DEBUG
org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
completed; freed=24.78 MB, total=185.13 MB, single=0 KB, multi=207.88 MB,
memory=0.64 KB
20 2013-07-24 10:55:28,975 DEBUG
org.apache.hadoop.hbase.io.hfile.LruBlockCache: Block cache LRU eviction
started; Attempting to free 24.75 MB of total=209.91 MB
Loads of it. Not enough to sink the RC but annoying.
St.Ack
On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl <la...@apache.org> wrote:
> The 1st 0.94.10 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.10 is a primarily a bug fix
> release. This RC has 35 issues resolved against it:
> [HBASE-8774] - Add BatchSize and Filter to Thrift2
> [HBASE-8819] - Port HBASE-5428 to Thrift 2
> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> Thrift2 - Add BatchSize Test
> [HBASE-8938] - Thrift2 does not close scanner instance
> [HBASE-8432] - a
> table with unbalanced regions will balance indefinitely with the
> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> [HBASE-8678] - Wrongly delete cells in some case which can not be
> deleted
> [HBASE-8695] - The HBase thrift service ignores XML configuration
> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> [HBASE-8782] - Thrift2 can not parse values when using framed transport
> [HBASE-8794] - DependentColumnFilter.toString() throws
> NullPointerException
> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> causing unexpected mutations
> [HBASE-8814] - Possible NPE in split if a region has empty store files.
> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> break distributed log splitting"
> [HBASE-8910] -
> HMaster.abortNow shouldn't try to become a master again if it was stopped
> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> HRegionServer
> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> the master address which already read from the zk.
> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> threads
> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is
> minimal
> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> [HBASE-8806] - Row locks are acquired repeatedly in
> HRegion.doMiniBatchMutation for duplicate rows.
> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> respect the time range or the filter
> [HBASE-8847] -
> Filter.transform() always applies unconditionally, even when combined in
> a FilterList
> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test
> to Test MTTR) to 0.94
> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> Improve ExplicitColumnTracker performance.
> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> see where/why failure
> [HBASE-7770] - minor integration test framework fixes
> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is
> flaky
> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow
> addition of more actions and policies.
> [HBASE-8934] -
> Fix bunch of flaky tests
> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.10/1/ and
> https://builds.apache.org/job/HBase-0.94.10-security/1/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
>
> The release testing spreadsheet is available here:
>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> (if you test this release, please add your test to this spreadsheet, so
> that we can gauge the coverage)
>
> Thanks.
>
> -- Lars
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
You have another option Lars. Just promote me as a commiter and you will
have your 2 +1 ;)
2013/7/23 lars hofhansl <la...@apache.org>
> Thank you JM!
>
> And also thanks to J-D (on another thread) for having a look.
>
> With J-D's +1 I need one more +1 from a committer.
>
>
> Thanks.
>
>
> -- Lars
>
>
>
> ----- Original Message -----
> From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev@hbase.apache.org; lars hofhansl <la...@apache.org>
> Cc:
> Sent: Tuesday, July 23, 2013 9:07 AM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is
> available
> for download
>
> Here we go ;)
>
> Downloaded, validated the signatures and uncompressed the files. => Passed.
> On the README.txt file, checked link for 6. => 404 page not found. since
> current directory doesn't exist, other links will fail too.
> Checked the CHANGE.txt file => Seems to be ok.
> Randomly checked the documentation => docs/bulk-loads.html point to an
> external page. Should it not be to a local one?
> Ran all tests => Passed.
> Started it, looked at the logs, the UI, all is fine.
> Ran PE, results similar between 0.94.9 and 0.94.10 (Numbers below are ms
> spent to run the test, average on 10 tests.)
> ||Test||0.94.9||0.94.10||
>
> |org.apache.hadoop.hbase.PerformanceEvaluation$FilteredScanTest|2172297.6|2141379.4|
>
> |org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest|2574442.3|2533646.4|
>
> |org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange100Test|19098.3|19205|
>
> |org.apache.hadoop.hbase.PerformanceEvaluation$RandomSeekScanTest|154499.7|153022.8|
>
> |org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest|84760.2|85176.2|
>
> |org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest|43636.175|44185.7375|
>
> Did rolling restart on a 8 node cluster, restarted the master => Ok.
> Checked the logs and UI => Ok.
> Stopped master, configured balancer to default, merged a 71 region table
> into one single region => Ok.
> Major compacted the table, got it automatically splited to 2 regions,
> manually split it to 32 regions, waited for balancer => Ok.
> Stopped master again, reconfigured custom balancer, restarted, rebalanced
> => Ok.
> From shell: Create table, scan, balance, drop => Ok.
>
> IntegrationTestLoadAndVerify still give strange results =>
> REFERENCES_CHECKED=9855348 (Should be 10000000)
> Ran IntegrationTestBigLinkedList => Perfect.
>
> So a big overall +1 for me ;)
>
> Deployed in my "prod" cluster. Thanks all for this release.
>
> 2013/7/19 lars hofhansl <la...@apache.org>
>
> > The 1st 0.94.10 RC is available for download at
> > http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> > Signed with my code signing key: C7CFE328
> >
> > Like the previous point releases, 0.94.10 is a primarily a bug fix
> > release. This RC has 35 issues resolved against it:
> > [HBASE-8774] - Add BatchSize and Filter to Thrift2
> > [HBASE-8819] - Port HBASE-5428 to Thrift 2
> > [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> > [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> > [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> > Thrift2 - Add BatchSize Test
> > [HBASE-8938] - Thrift2 does not close scanner instance
> > [HBASE-8432] - a
> > table with unbalanced regions will balance indefinitely with the
> > 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> > [HBASE-8678] - Wrongly delete cells in some case which can not be
> > deleted
> > [HBASE-8695] - The HBase thrift service ignores XML configuration
> > [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> > [HBASE-8782] - Thrift2 can not parse values when using framed
> transport
> > [HBASE-8794] - DependentColumnFilter.toString() throws
> > NullPointerException
> > [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> > causing unexpected mutations
> > [HBASE-8814] - Possible NPE in split if a region has empty store
> files.
> > [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> > break distributed log splitting"
> > [HBASE-8910] -
> > HMaster.abortNow shouldn't try to become a master again if it was
> stopped
> > [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> > HRegionServer
> > [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> > the master address which already read from the zk.
> > [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> > [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> > threads
> > [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is
> > minimal
> > [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> > [HBASE-8806] - Row locks are acquired repeatedly in
> > HRegion.doMiniBatchMutation for duplicate rows.
> > [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> > respect the time range or the filter
> > [HBASE-8847] -
> > Filter.transform() always applies unconditionally, even when combined in
> > a FilterList
> > [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration
> Test
> > to Test MTTR) to 0.94
> > [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> > [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> > Improve ExplicitColumnTracker performance.
> > [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> > see where/why failure
> > [HBASE-7770] - minor integration test framework fixes
> > [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> > [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort
> is
> > flaky
> > [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow
> > addition of more actions and policies.
> > [HBASE-8934] -
> > Fix bunch of flaky tests
> > [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> > TestHCM#testDeleteForZKConnLeak enhancement to 0.94
> >
> > The list of changes is also available here:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
> >
> > Here're the jenkins runs for this RC:
> > https://builds.apache.org/job/HBase-0.94.10/1/ and
> > https://builds.apache.org/job/HBase-0.94.10-security/1/
> >
> > Please try out the RC, check out the doc, take it for a spin, etc, and
> > vote +1/-1 by July 26th on whether we should release this as 0.94.10.
> >
> > The release testing spreadsheet is available here:
> >
> >
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> > (if you test this release, please add your test to this spreadsheet, so
> > that we can gauge the coverage)
> >
> > Thanks.
> >
> > -- Lars
>
>
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Thank you JM!
And also thanks to J-D (on another thread) for having a look.
With J-D's +1 I need one more +1 from a committer.
Thanks.
-- Lars
----- Original Message -----
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev@hbase.apache.org; lars hofhansl <la...@apache.org>
Cc:
Sent: Tuesday, July 23, 2013 9:07 AM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available
for download
Here we go ;)
Downloaded, validated the signatures and uncompressed the files. => Passed.
On the README.txt file, checked link for 6. => 404 page not found. since
current directory doesn't exist, other links will fail too.
Checked the CHANGE.txt file => Seems to be ok.
Randomly checked the documentation => docs/bulk-loads.html point to an
external page. Should it not be to a local one?
Ran all tests => Passed.
Started it, looked at the logs, the UI, all is fine.
Ran PE, results similar between 0.94.9 and 0.94.10 (Numbers below are ms
spent to run the test, average on 10 tests.)
||Test||0.94.9||0.94.10||
|org.apache.hadoop.hbase.PerformanceEvaluation$FilteredScanTest|2172297.6|2141379.4|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest|2574442.3|2533646.4|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange100Test|19098.3|19205|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomSeekScanTest|154499.7|153022.8|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest|84760.2|85176.2|
|org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest|43636.175|44185.7375|
Did rolling restart on a 8 node cluster, restarted the master => Ok.
Checked the logs and UI => Ok.
Stopped master, configured balancer to default, merged a 71 region table
into one single region => Ok.
Major compacted the table, got it automatically splited to 2 regions,
manually split it to 32 regions, waited for balancer => Ok.
Stopped master again, reconfigured custom balancer, restarted, rebalanced
=> Ok.
From shell: Create table, scan, balance, drop => Ok.
IntegrationTestLoadAndVerify still give strange results =>
REFERENCES_CHECKED=9855348 (Should be 10000000)
Ran IntegrationTestBigLinkedList => Perfect.
So a big overall +1 for me ;)
Deployed in my "prod" cluster. Thanks all for this release.
2013/7/19 lars hofhansl <la...@apache.org>
> The 1st 0.94.10 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.10 is a primarily a bug fix
> release. This RC has 35 issues resolved against it:
> [HBASE-8774] - Add BatchSize and Filter to Thrift2
> [HBASE-8819] - Port HBASE-5428 to Thrift 2
> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> Thrift2 - Add BatchSize Test
> [HBASE-8938] - Thrift2 does not close scanner instance
> [HBASE-8432] - a
> table with unbalanced regions will balance indefinitely with the
> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> [HBASE-8678] - Wrongly delete cells in some case which can not be
> deleted
> [HBASE-8695] - The HBase thrift service ignores XML configuration
> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> [HBASE-8782] - Thrift2 can not parse values when using framed transport
> [HBASE-8794] - DependentColumnFilter.toString() throws
> NullPointerException
> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> causing unexpected mutations
> [HBASE-8814] - Possible NPE in split if a region has empty store files.
> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> break distributed log splitting"
> [HBASE-8910] -
> HMaster.abortNow shouldn't try to become a master again if it was stopped
> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> HRegionServer
> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> the master address which already read from the zk.
> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> threads
> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is
> minimal
> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> [HBASE-8806] - Row locks are acquired repeatedly in
> HRegion.doMiniBatchMutation for duplicate rows.
> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> respect the time range or the filter
> [HBASE-8847] -
> Filter.transform() always applies unconditionally, even when combined in
> a FilterList
> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test
> to Test MTTR) to 0.94
> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> Improve ExplicitColumnTracker performance.
> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> see where/why failure
> [HBASE-7770] - minor integration test framework fixes
> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is
> flaky
> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow
> addition of more actions and policies.
> [HBASE-8934] -
> Fix bunch of flaky tests
> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.10/1/ and
> https://builds.apache.org/job/HBase-0.94.10-security/1/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
>
> The release testing spreadsheet is available here:
>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> (if you test this release, please add your test to this spreadsheet, so
> that we can gauge the coverage)
>
> Thanks.
>
> -- Lars
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Here we go ;)
Downloaded, validated the signatures and uncompressed the files. => Passed.
On the README.txt file, checked link for 6. => 404 page not found. since
current directory doesn't exist, other links will fail too.
Checked the CHANGE.txt file => Seems to be ok.
Randomly checked the documentation => docs/bulk-loads.html point to an
external page. Should it not be to a local one?
Ran all tests => Passed.
Started it, looked at the logs, the UI, all is fine.
Ran PE, results similar between 0.94.9 and 0.94.10 (Numbers below are ms
spent to run the test, average on 10 tests.)
||Test||0.94.9||0.94.10||
|org.apache.hadoop.hbase.PerformanceEvaluation$FilteredScanTest|2172297.6|2141379.4|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest|2574442.3|2533646.4|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomScanWithRange100Test|19098.3|19205|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomSeekScanTest|154499.7|153022.8|
|org.apache.hadoop.hbase.PerformanceEvaluation$RandomWriteTest|84760.2|85176.2|
|org.apache.hadoop.hbase.PerformanceEvaluation$SequentialWriteTest|43636.175|44185.7375|
Did rolling restart on a 8 node cluster, restarted the master => Ok.
Checked the logs and UI => Ok.
Stopped master, configured balancer to default, merged a 71 region table
into one single region => Ok.
Major compacted the table, got it automatically splited to 2 regions,
manually split it to 32 regions, waited for balancer => Ok.
Stopped master again, reconfigured custom balancer, restarted, rebalanced
=> Ok.
>From shell: Create table, scan, balance, drop => Ok.
IntegrationTestLoadAndVerify still give strange results =>
REFERENCES_CHECKED=9855348 (Should be 10000000)
Ran IntegrationTestBigLinkedList => Perfect.
So a big overall +1 for me ;)
Deployed in my "prod" cluster. Thanks all for this release.
2013/7/19 lars hofhansl <la...@apache.org>
> The 1st 0.94.10 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.10 is a primarily a bug fix
> release. This RC has 35 issues resolved against it:
> [HBASE-8774] - Add BatchSize and Filter to Thrift2
> [HBASE-8819] - Port HBASE-5428 to Thrift 2
> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> Thrift2 - Add BatchSize Test
> [HBASE-8938] - Thrift2 does not close scanner instance
> [HBASE-8432] - a
> table with unbalanced regions will balance indefinitely with the
> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> [HBASE-8678] - Wrongly delete cells in some case which can not be
> deleted
> [HBASE-8695] - The HBase thrift service ignores XML configuration
> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> [HBASE-8782] - Thrift2 can not parse values when using framed transport
> [HBASE-8794] - DependentColumnFilter.toString() throws
> NullPointerException
> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> causing unexpected mutations
> [HBASE-8814] - Possible NPE in split if a region has empty store files.
> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> break distributed log splitting"
> [HBASE-8910] -
> HMaster.abortNow shouldn't try to become a master again if it was stopped
> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> HRegionServer
> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> the master address which already read from the zk.
> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> threads
> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is
> minimal
> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> [HBASE-8806] - Row locks are acquired repeatedly in
> HRegion.doMiniBatchMutation for duplicate rows.
> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> respect the time range or the filter
> [HBASE-8847] -
> Filter.transform() always applies unconditionally, even when combined in
> a FilterList
> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test
> to Test MTTR) to 0.94
> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> Improve ExplicitColumnTracker performance.
> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> see where/why failure
> [HBASE-7770] - minor integration test framework fixes
> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is
> flaky
> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow
> addition of more actions and policies.
> [HBASE-8934] -
> Fix bunch of flaky tests
> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.10/1/ and
> https://builds.apache.org/job/HBase-0.94.10-security/1/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
>
> The release testing spreadsheet is available here:
>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> (if you test this release, please add your test to this spreadsheet, so
> that we can gauge the coverage)
>
> Thanks.
>
> -- Lars
Re: [ANNOUNCE] The 1st hbase 0.94.10 release candidate is available
for download
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Tried out the secure tar on a single node, ran some PE, +1
J-D
On Fri, Jul 19, 2013 at 2:33 PM, lars hofhansl <la...@apache.org> wrote:
> The 1st 0.94.10 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.10-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.10 is a primarily a bug fix
> release. This RC has 35 issues resolved against it:
> [HBASE-8774] - Add BatchSize and Filter to Thrift2
> [HBASE-8819] - Port HBASE-5428 to Thrift 2
> [HBASE-8826] - Ensure HBASE-8695 is covered in Thrift 2
> [HBASE-8832] - Ensure HBASE-4658 is supported by Thrift 2
> [HBASE-8876] - Addendum to HBASE-8774 Add BatchSize and Filter to
> Thrift2 - Add BatchSize Test
> [HBASE-8938] - Thrift2 does not close scanner instance
> [HBASE-8432] - a
> table with unbalanced regions will balance indefinitely with the
> 'org.apache.hadoop.hbase.master.DefaultLoadBalancer'
> [HBASE-8678] - Wrongly delete cells in some case which can not be
> deleted
> [HBASE-8695] - The HBase thrift service ignores XML configuration
> [HBASE-8776] - tweak retry settings some more (on trunk and 0.94)
> [HBASE-8782] - Thrift2 can not parse values when using framed transport
> [HBASE-8794] - DependentColumnFilter.toString() throws
> NullPointerException
> [HBASE-8811] - REST service ignores misspelled "check=" parameter,
> causing unexpected mutations
> [HBASE-8814] - Possible NPE in split if a region has empty store files.
> [HBASE-8858] - Backport hbase-6979 "recovered.edits file should not
> break distributed log splitting"
> [HBASE-8910] -
> HMaster.abortNow shouldn't try to become a master again if it was stopped
> [HBASE-8967] - Duplicate call to snapshotManager.stop() in
> HRegionServer
> [HBASE-8968] - Avoid call to zk in HRegionServer#getMaster() to log
> the master address which already read from the zk.
> [HBASE-8971] - Bump 0.94 version to 0.94.10-SNAPSHOT
> [HBASE-8988] - Reuse the thread pool in the shell to not run out of
> threads
> [HBASE-8599] - HLogs in ZK are not cleaned up when replication lag is
> minimal
> [HBASE-8767] - Backport hbase-8001 and hbase-8012, avoid lazy seek
> [HBASE-8806] - Row locks are acquired repeatedly in
> HRegion.doMiniBatchMutation for duplicate rows.
> [HBASE-8809] - Include deletes in the scan (setRaw) method does not
> respect the time range or the filter
> [HBASE-8847] -
> Filter.transform() always applies unconditionally, even when combined in
> a FilterList
> [HBASE-8908] - Backport HBASE-8882 and HBASE-8904 (An Integration Test
> to Test MTTR) to 0.94
> [HBASE-8921] - [thrift2] Add GenericOptionsParser to Thrift 2 server
> [HBASE-8945] - Backport to 0.94: HBASE-7952 Remove update() and
> Improve ExplicitColumnTracker performance.
> [HBASE-8829] - Improve failed TestMetaScanner assert message so can
> see where/why failure
> [HBASE-7770] - minor integration test framework fixes
> [HBASE-8885] - Fix and reenable TestGet failing#testDynamicFilter
> [HBASE-8914] - [0.94] TestRegionServerCoprocessorExceptionWithAbort is
> flaky
> [HBASE-8928] - Make ChaosMonkey & LoadTest tools extensible, to allow
> addition of more actions and policies.
> [HBASE-8934] -
> Fix bunch of flaky tests
> [HBASE-8969] - Backport HBASE-8535+HBASE-8586
> TestHCM#testDeleteForZKConnLeak enhancement to 0.94
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324627
>
> Here're the jenkins runs for this RC:
> https://builds.apache.org/job/HBase-0.94.10/1/ and
> https://builds.apache.org/job/HBase-0.94.10-security/1/
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by July 26th on whether we should release this as 0.94.10.
>
> The release testing spreadsheet is available here:
>
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdHRzYUcyYlU0NTVNQjFMenBCeDd5MVE#gid=0
> (if you test this release, please add your test to this spreadsheet, so
> that we can gauge the coverage)
>
> Thanks.
>
> -- Lars