You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by lars hofhansl <la...@apache.org> on 2014/05/24 07:35:33 UTC
[VOTE] The 1st hbase 0.94.20 release candidate is available for download
Just to make you folks work over the long weekend...
The 1st 0.94.20 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.20-rc0/
Signed with my code signing key: C7CFE328
HBase 0.94.20 is a small bug fix release with 12 fixes:
[HBASE-10936] - Add zeroByte encoding test
[HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some log entries from being replayed
[HBASE-11110] - Ability to load FilterList class is dependent on context classloader
[HBASE-11143] - Improve replication metrics
[HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is always shown
[HBASE-11212] - Fix increment index in KeyValueSortReducer
[HBASE-11225] - Backport fix for HBASE-10417 'index is not incremented in PutSortReducer#reduce()'
[HBASE-11247] - [0.94] update maven-site-plugin to 3.3
[HBASE-11008] - Align bulk load, flush, and compact to require Action.CREATE
[HBASE-11119] - Update ExportSnapShot to optionally not use a tmp file on external file system
[HBASE-11128] - Add -target option to ExportSnapshot to export with a different name
[HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
The list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12326654
Since Apache Jenkins appears to be out on vacation, I built this on my own machine. I ran the full test suite a few times.
Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by EOD May 30th on whether we should release this as 0.94.20.
Thanks.
-- Lars
Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download
Posted by Andrew Purtell <ap...@apache.org>.
+1
Checksum ok
Signature ok
File layout ok
All unit tests pass 25 out of 25 times on JDK 6 and JDK 7.
Ran a local load test, logs looked ok
On Fri, May 23, 2014 at 10:35 PM, lars hofhansl <la...@apache.org> wrote:
> Just to make you folks work over the long weekend...
>
> The 1st 0.94.20 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.20-rc0/
> Signed with my code signing key: C7CFE328
>
> HBase 0.94.20 is a small bug fix release with 12 fixes:
> [HBASE-10936] - Add zeroByte encoding test
> [HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some
> log entries from being replayed
> [HBASE-11110] - Ability to load FilterList class is dependent on
> context classloader
> [HBASE-11143] - Improve replication metrics
> [HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is
> always shown
> [HBASE-11212] - Fix increment index in KeyValueSortReducer
> [HBASE-11225] - Backport fix for HBASE-10417 'index is not incremented
> in PutSortReducer#reduce()'
> [HBASE-11247] - [0.94] update maven-site-plugin to 3.3
> [HBASE-11008] - Align bulk load, flush, and compact to require
> Action.CREATE
> [HBASE-11119] - Update ExportSnapShot to optionally not use a tmp file
> on external file system
> [HBASE-11128] - Add -target option to ExportSnapshot to export with a
> different name
> [HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12326654
>
> Since Apache Jenkins appears to be out on vacation, I built this on my own
> machine. I ran the full test suite a few times.
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by EOD May 30th on whether we should release this as 0.94.20.
>
> Thanks.
>
> -- Lars
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download
Posted by Ted Yu <yu...@gmail.com>.
+1
- checked documentation and tarball
- ran unit test suite using jdk 1.7 which passed - see bottom of email
- ran in local and distributed mode
- checked the UI pages
Tests run: 1559, Failures: 0, Errors: 0, Skipped: 16
[INFO]
------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO]
------------------------------------------------------------------------
[INFO] Total time: 1:12:10.094s
On Fri, May 23, 2014 at 10:35 PM, lars hofhansl <la...@apache.org> wrote:
> Just to make you folks work over the long weekend...
>
> The 1st 0.94.20 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.20-rc0/
> Signed with my code signing key: C7CFE328
>
> HBase 0.94.20 is a small bug fix release with 12 fixes:
> [HBASE-10936] - Add zeroByte encoding test
> [HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some
> log entries from being replayed
> [HBASE-11110] - Ability to load FilterList class is dependent on
> context classloader
> [HBASE-11143] - Improve replication metrics
> [HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is
> always shown
> [HBASE-11212] - Fix increment index in KeyValueSortReducer
> [HBASE-11225] - Backport fix for HBASE-10417 'index is not incremented
> in PutSortReducer#reduce()'
> [HBASE-11247] - [0.94] update maven-site-plugin to 3.3
> [HBASE-11008] - Align bulk load, flush, and compact to require
> Action.CREATE
> [HBASE-11119] - Update ExportSnapShot to optionally not use a tmp file
> on external file system
> [HBASE-11128] - Add -target option to ExportSnapshot to export with a
> different name
> [HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12326654
>
> Since Apache Jenkins appears to be out on vacation, I built this on my own
> machine. I ran the full test suite a few times.
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by EOD May 30th on whether we should release this as 0.94.20.
>
> Thanks.
>
> -- Lars
>
Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Thanks Stack. The security folder is still there on purpose. I just changed the pom to always pull the secure files into the build (not just for the secure target).
-- Lars
________________________________
From: Stack <st...@duboce.net>
To: HBase Dev List <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Sent: Tuesday, May 27, 2014 1:02 PM
Subject: Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download
+1
Checked hash.
Layout looks good (did we mean to get rid of the security folder?)
Docs look good.
Simple PE tests on standalone seem to do the right thing.
St.Ack
On Fri, May 23, 2014 at 10:35 PM, lars hofhansl <la...@apache.org> wrote:
> Just to make you folks work over the long weekend...
>
> The 1st 0.94.20 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.20-rc0/
> Signed with my code signing key: C7CFE328
>
> HBase 0.94.20 is a small bug fix release with 12 fixes:
> [HBASE-10936] - Add zeroByte encoding test
> [HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some
> log entries from being replayed
> [HBASE-11110] - Ability to load FilterList class is dependent on
> context classloader
> [HBASE-11143] - Improve replication metrics
> [HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is
> always shown
> [HBASE-11212] - Fix increment index in KeyValueSortReducer
> [HBASE-11225] - Backport fix for HBASE-10417 'index is not incremented
> in PutSortReducer#reduce()'
> [HBASE-11247] - [0.94] update maven-site-plugin to 3.3
> [HBASE-11008] - Align bulk load, flush, and compact to require
> Action.CREATE
> [HBASE-11119] - Update ExportSnapShot to optionally not use a tmp file
> on external file system
> [HBASE-11128] - Add -target option to ExportSnapshot to export with a
> different name
> [HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12326654
>
> Since Apache Jenkins appears to be out on vacation, I built this on my own
> machine. I ran the full test suite a few times.
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by EOD May 30th on whether we should release this as 0.94.20.
>
> Thanks.
>
> -- Lars
>
Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download
Posted by Stack <st...@duboce.net>.
+1
Checked hash.
Layout looks good (did we mean to get rid of the security folder?)
Docs look good.
Simple PE tests on standalone seem to do the right thing.
St.Ack
On Fri, May 23, 2014 at 10:35 PM, lars hofhansl <la...@apache.org> wrote:
> Just to make you folks work over the long weekend...
>
> The 1st 0.94.20 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.20-rc0/
> Signed with my code signing key: C7CFE328
>
> HBase 0.94.20 is a small bug fix release with 12 fixes:
> [HBASE-10936] - Add zeroByte encoding test
> [HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some
> log entries from being replayed
> [HBASE-11110] - Ability to load FilterList class is dependent on
> context classloader
> [HBASE-11143] - Improve replication metrics
> [HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is
> always shown
> [HBASE-11212] - Fix increment index in KeyValueSortReducer
> [HBASE-11225] - Backport fix for HBASE-10417 'index is not incremented
> in PutSortReducer#reduce()'
> [HBASE-11247] - [0.94] update maven-site-plugin to 3.3
> [HBASE-11008] - Align bulk load, flush, and compact to require
> Action.CREATE
> [HBASE-11119] - Update ExportSnapShot to optionally not use a tmp file
> on external file system
> [HBASE-11128] - Add -target option to ExportSnapshot to export with a
> different name
> [HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12326654
>
> Since Apache Jenkins appears to be out on vacation, I built this on my own
> machine. I ran the full test suite a few times.
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by EOD May 30th on whether we should release this as 0.94.20.
>
> Thanks.
>
> -- Lars
>
Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
IntegrationTestsDriver failed with 2 issues.
1) org.apache.hadoop.hbase.TableExistsException:
org.apache.hadoop.hbase.TableExistsException: IntegrationTestLoadAndVerify
2)
testContinuousIngest(org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList)
java.lang.RuntimeException: Verify.verify failed
The 2nd one is not a surprise since it also failed when I ran it manually.
The 1st one was not expected but I don't think it's a big issue. Seems that
one table should have been deleted and was not.
JM
2014-05-25 23:17 GMT-04:00 Jean-Marc Spaggiari <je...@spaggiari.org>:
> tl.tr: +1
>
> Over all the tests I always check logs and HBCK.
>
> Downloaded, checked the signatures, decompressed, CHANGES.txt,
> documentation => Passed.
> Ran all the tests => Passed.
> Ran performances tests (See below) => Passed.
> Ran load test tool => Passed
> Ran IntegrationTestLoadAndVerify => Passed
> Ran HLogPerformanceEvaluation => Passed
> Ran IntegrationTestBigLinkedList => Still fail like for 0.94.19
> Manually created one table, put, scan, alter_table, compact, merge, drop,
> etc => Passed
> Deployed on a 8 nodes cluster, rolling restart => Passed
> Changed balancer, restart, rebalance => Passed.
> Stop, mass merged 32 regions into one, restart, major compact => Passed.
> Restored customized balancer, restart, rebalance => Passed.
> Integration tests are currently running, but so far, so good. I will
> report if they fail before end of day tomorrow.
>
> So only concerns are still with IntegrationTestBigLinkedList and
> hbase.HFilePerformanceEvaluation.GaussianRandomReadBenchmark, but same as
> 0.94.19.
>
> Now jumping on 0.98 tests ;)
>
>
> 0.94.19 0.94.20FilteredScanTest 0,230,23 RandomReadTest825 808
> RandomSeekScanTest 178172 RandomScanWithRange10Test286 286
> RandomScanWithRange100Test 147147 RandomScanWithRange1000Test39,40 38,22
> SequentialReadTest 1 2251 217 SequentialWriteTest13 826 13 732
> RandomWriteTest 13 57414 091 GaussianRandomReadBenchmark9 395 9 404
> SequentialReadBenchmark 3 009 2102 938 638 SequentialWriteBenchmark909 579912 469
> UniformRandomReadBenchmark 10 354 10 299UniformRandomSmallScan 233 931
> 233 583 LoadTestToolreal 19m11.070s
> user 37m5.328s
> sys 11m10.724s real 19m30.113s
> user 37m12.300s
> sys 11m19.224s IntegrationTestLoadAnVerifyreal 4m7.909s
> user 1m30.668s
> sys 0m7.136s real 4m11.269s
> user 1m32.904s
> sys 0m7.176s HLogPerformanceEvaluation10597,149 10431,988
> IntegrationTestBigLinkedList real 6m26.026s
> user 3m0.156s
> sys 0m10.436s real 6m0.125s
> user 3m0.004s
> sys 0m11.312s
>
>
>
> 2014-05-24 1:35 GMT-04:00 lars hofhansl <la...@apache.org>:
>
> Just to make you folks work over the long weekend...
>>
>> The 1st 0.94.20 RC is available for download at
>> http://people.apache.org/~larsh/hbase-0.94.20-rc0/
>> Signed with my code signing key: C7CFE328
>>
>> HBase 0.94.20 is a small bug fix release with 12 fixes:
>> [HBASE-10936] - Add zeroByte encoding test
>> [HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some
>> log entries from being replayed
>> [HBASE-11110] - Ability to load FilterList class is dependent on
>> context classloader
>> [HBASE-11143] - Improve replication metrics
>> [HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is
>> always shown
>> [HBASE-11212] - Fix increment index in KeyValueSortReducer
>> [HBASE-11225] - Backport fix for HBASE-10417 'index is not
>> incremented in PutSortReducer#reduce()'
>> [HBASE-11247] - [0.94] update maven-site-plugin to 3.3
>> [HBASE-11008] - Align bulk load, flush, and compact to require
>> Action.CREATE
>> [HBASE-11119] - Update ExportSnapShot to optionally not use a tmp
>> file on external file system
>> [HBASE-11128] - Add -target option to ExportSnapshot to export with a
>> different name
>> [HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
>>
>> The list of changes is also available here:
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12326654
>>
>> Since Apache Jenkins appears to be out on vacation, I built this on my
>> own machine. I ran the full test suite a few times.
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and
>> vote +1/-1 by EOD May 30th on whether we should release this as 0.94.20.
>>
>> Thanks.
>>
>> -- Lars
>>
>
>
Re: [VOTE] The 1st hbase 0.94.20 release candidate is available for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
tl.tr: +1
Over all the tests I always check logs and HBCK.
Downloaded, checked the signatures, decompressed, CHANGES.txt,
documentation => Passed.
Ran all the tests => Passed.
Ran performances tests (See below) => Passed.
Ran load test tool => Passed
Ran IntegrationTestLoadAndVerify => Passed
Ran HLogPerformanceEvaluation => Passed
Ran IntegrationTestBigLinkedList => Still fail like for 0.94.19
Manually created one table, put, scan, alter_table, compact, merge, drop,
etc => Passed
Deployed on a 8 nodes cluster, rolling restart => Passed
Changed balancer, restart, rebalance => Passed.
Stop, mass merged 32 regions into one, restart, major compact => Passed.
Restored customized balancer, restart, rebalance => Passed.
Integration tests are currently running, but so far, so good. I will report
if they fail before end of day tomorrow.
So only concerns are still with IntegrationTestBigLinkedList and
hbase.HFilePerformanceEvaluation.GaussianRandomReadBenchmark, but same as
0.94.19.
Now jumping on 0.98 tests ;)
0.94.19 0.94.20FilteredScanTest 0,230,23 RandomReadTest825 808
RandomSeekScanTest 178172 RandomScanWithRange10Test286 286
RandomScanWithRange100Test 147147 RandomScanWithRange1000Test39,40 38,22
SequentialReadTest 1 2251 217 SequentialWriteTest13 826 13 732
RandomWriteTest 13 57414 091 GaussianRandomReadBenchmark9 395 9 404
SequentialReadBenchmark 3 009 2102 938 638 SequentialWriteBenchmark909
579912 469
UniformRandomReadBenchmark 10 354 10 299UniformRandomSmallScan 233 931
233 583 LoadTestToolreal 19m11.070s
user 37m5.328s
sys 11m10.724s real 19m30.113s
user 37m12.300s
sys 11m19.224s IntegrationTestLoadAnVerifyreal 4m7.909s
user 1m30.668s
sys 0m7.136s real 4m11.269s
user 1m32.904s
sys 0m7.176s HLogPerformanceEvaluation10597,149 10431,988
IntegrationTestBigLinkedList real 6m26.026s
user 3m0.156s
sys 0m10.436s real 6m0.125s
user 3m0.004s
sys 0m11.312s
2014-05-24 1:35 GMT-04:00 lars hofhansl <la...@apache.org>:
> Just to make you folks work over the long weekend...
>
> The 1st 0.94.20 RC is available for download at
> http://people.apache.org/~larsh/hbase-0.94.20-rc0/
> Signed with my code signing key: C7CFE328
>
> HBase 0.94.20 is a small bug fix release with 12 fixes:
> [HBASE-10936] - Add zeroByte encoding test
> [HBASE-10958] - [dataloss] Bulk loading with seqids can prevent some
> log entries from being replayed
> [HBASE-11110] - Ability to load FilterList class is dependent on
> context classloader
> [HBASE-11143] - Improve replication metrics
> [HBASE-11188] - "Inconsistent configuration" for SchemaMetrics is
> always shown
> [HBASE-11212] - Fix increment index in KeyValueSortReducer
> [HBASE-11225] - Backport fix for HBASE-10417 'index is not incremented
> in PutSortReducer#reduce()'
> [HBASE-11247] - [0.94] update maven-site-plugin to 3.3
> [HBASE-11008] - Align bulk load, flush, and compact to require
> Action.CREATE
> [HBASE-11119] - Update ExportSnapShot to optionally not use a tmp file
> on external file system
> [HBASE-11128] - Add -target option to ExportSnapshot to export with a
> different name
> [HBASE-11134] - Add a -list-snapshots option to SnapshotInfo
>
> The list of changes is also available here:
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12326654
>
> Since Apache Jenkins appears to be out on vacation, I built this on my own
> machine. I ran the full test suite a few times.
>
> Please try out the RC, check out the doc, take it for a spin, etc, and
> vote +1/-1 by EOD May 30th on whether we should release this as 0.94.20.
>
> Thanks.
>
> -- Lars
>