You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by lars hofhansl <la...@apache.org> on 2013/06/25 00:51:48 UTC
[ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
Signed with my code signing key: C7CFE328
Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
[HBASE-8453] - TestImportExport failing again due to configuration issues
[HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
[HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
[HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
[HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
[HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
[HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
[HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
[HBASE-8656] - Rpc call may not be notified in SecureClient
[HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
[HBASE-8684] - Table Coprocessor can't access external HTable by default
[HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
[HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
[HBASE-8742] - HTableDescriptor Properties not preserved when cloning
[HBASE-8743] - upgrade hadoop-23 version to 0.23.7
[HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
[HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
[HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
[HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
[HBASE-8609] - Make the CopyTable support startRow, stopRow options
[HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
[HBASE-8683] - Add major compaction support in CompactionTool
[HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
[HBASE-8702] - Make WALEditCodec pluggable
[HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
[HBASE-8603] - Backport HBASE-6921 to 0.94
The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
The release testing spreadsheet is available here:
https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
(if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
Thanks.
-- Lars
ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
The usual friendly reminder to please test release, so that I can release this tomorrow.
Thanks.
-- Lars
----- Original Message -----
From: lars hofhansl <la...@apache.org>
To: hbase-dev <de...@hbase.apache.org>
Cc:
Sent: Monday, June 24, 2013 3:51 PM
Subject: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
Signed with my code signing key: C7CFE328
Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
[HBASE-8453] - TestImportExport failing again due to configuration issues
[HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
[HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
[HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
[HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
[HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
[HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
[HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
[HBASE-8656] - Rpc call may not be notified in SecureClient
[HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
[HBASE-8684] - Table Coprocessor can't access external HTable by default
[HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
[HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
[HBASE-8742] - HTableDescriptor Properties not preserved when cloning
[HBASE-8743] - upgrade hadoop-23 version to 0.23.7
[HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
[HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
[HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
[HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
[HBASE-8609] - Make the CopyTable support startRow, stopRow options
[HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
[HBASE-8683] - Add major compaction support in CompactionTool
[HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
[HBASE-8702] - Make WALEditCodec pluggable
[HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
[HBASE-8603] - Backport HBASE-6921 to 0.94
The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
The release testing spreadsheet is available here:
https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
(if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
Thanks.
-- Lars
ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Thanks JM.
Hmm... TestRegionObserverScannerOpenHook has not failed on jenkins (both Apache or Andy EC2 setup).
The exception just means that a region either moved or was split and has not been reassigned, yet.
Unless this *only* happens in 0.94.9 and did not happen before I do not think this is a reason for concern.
-- Lars
________________________________
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev@hbase.apache.org; lars hofhansl <la...@apache.org>
Sent: Tuesday, June 25, 2013 3:51 PM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Here is my feedback.
- Downloaded the files, checked the signature, uncompressed, checked
changes.txt => Fine
- Checked the documentation => One page not found under "Ref Guide
(multi-page)" link on the index page. Should it be there?
- Ran the test suite on 2 different servers,
TestRegionObserverScannerOpenHook failed 10 times in a row with 8
thread, 4, 2 and 1.
- IntegrationTestLoadAndVerify => REFERENCES_CHECKED=985565 with
0.94.9 and REFERENCES_CHECKED=9855611 with 0.94.8. Don't know what to
deduct.
- integrationTestBigLinkedList => Fine
- HBCK still reporting fine after all those tests.
However, I have this exception many times on the logs, every 3 seconds:
2013-06-24 22:24:01,159 ERROR
org.apache.hadoop.hbase.regionserver.HRegionServer: Closing scanner
for IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
org.apache.hadoop.hbase.NotServingRegionException: Region is not
online: IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3509)
at org.apache.hadoop.hbase.regionserver.HRegionServer$ScannerListener.leaseExpired(HRegionServer.java:2740)
at org.apache.hadoop.hbase.regionserver.Leases.run(Leases.java:100)
at java.lang.Thread.run(Thread.java:662)
- Performed a rolling restart for the RS. 2500 regions to move
around... => Fine. Took 74 minutes. Changed to regoin_mover to
multhread, took 16 minutes.
- Looked at the master and region logs, everything seems to be ok.
- Merged all the regions from a table to a single region.
- Checked HBCK, one issue on one table which is not the one merged.
Issue was not there before the restarts, etc. Few hbck repairs
repaired everything.
- Logs still good, table merged correctly.
- Triggered a major compaction, got the table splitted back to 36 regions.
- Ran the balalancer, region got spreaded over the nodes. => Fine, but
had to run it twice. First time 50% of the regions stayed assigned to
one RS.
- Stopped, restored my customed balancer, restart, rebalanced => Fine.
- Create table, put, scan, get, disable, drop, balance, list,
truncate_preserve, truncate from shell => Fine
- Ran one MR job (416 mappers), went well, nothing in the logs.
So to summarize: +1 ;) Even is there is 2 things to verify
(TestRegionObserverScannerOpenHook and NotServingRegionException). I
don't think they related to this release.
I will post the performances comparison later tonight or tomorrow.
(Need to add 0.94.8 also since I'm late),
JM
2013/6/24 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Oh! Cool! A new toy for the week! ;)
>
> Thanks Lars! I will start right now to test it! (And I will do the
> remaining perf testing just after or in parallel...)
>
> 2013/6/24 lars hofhansl <la...@apache.org>:
>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>> Signed with my code signing key: C7CFE328
>>
>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>> [HBASE-8683] - Add major compaction support in CompactionTool
>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>> [HBASE-8702] - Make WALEditCodec pluggable
>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>
>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>
>> The release testing spreadsheet is available here:
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>
>> Thanks.
>>
>> -- Lars
>>
>> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
I ran PE.randomRead against 0.94.7 and 0.94.9.
0.94.7: 589036ms
0.94.9: 583656ms
This is repeatable.
So I am not sure how you arrive at your numbers where 0.94.8 (and 0.94.9) are supposedly 20% slower than 0.94.7 in this test.
-- Lars
----- Original Message -----
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev@hbase.apache.org; lars hofhansl <la...@apache.org>
Cc:
Sent: Friday, June 28, 2013 8:06 PM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Sorry for the delay team.
The new PDF with the 0.94.8 and 0.94.9 performance graphs is now online.
http://www.spaggiari.org/media/blogs/hbase/pdf/performances_20130628.pdf
JM
2013/6/25 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Here is my feedback.
>
> - Downloaded the files, checked the signature, uncompressed, checked
> changes.txt => Fine
> - Checked the documentation => One page not found under "Ref Guide
> (multi-page)" link on the index page. Should it be there?
> - Ran the test suite on 2 different servers,
> TestRegionObserverScannerOpenHook failed 10 times in a row with 8
> thread, 4, 2 and 1.
> - IntegrationTestLoadAndVerify => REFERENCES_CHECKED=985565 with
> 0.94.9 and REFERENCES_CHECKED=9855611 with 0.94.8. Don't know what to
> deduct.
> - integrationTestBigLinkedList => Fine
> - HBCK still reporting fine after all those tests.
>
> However, I have this exception many times on the logs, every 3 seconds:
>
> 2013-06-24 22:24:01,159 ERROR
> org.apache.hadoop.hbase.regionserver.HRegionServer: Closing scanner
> for IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
> org.apache.hadoop.hbase.NotServingRegionException: Region is not
> online: IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3509)
> at org.apache.hadoop.hbase.regionserver.HRegionServer$ScannerListener.leaseExpired(HRegionServer.java:2740)
> at org.apache.hadoop.hbase.regionserver.Leases.run(Leases.java:100)
> at java.lang.Thread.run(Thread.java:662)
>
> - Performed a rolling restart for the RS. 2500 regions to move
> around... => Fine. Took 74 minutes. Changed to regoin_mover to
> multhread, took 16 minutes.
> - Looked at the master and region logs, everything seems to be ok.
> - Merged all the regions from a table to a single region.
> - Checked HBCK, one issue on one table which is not the one merged.
> Issue was not there before the restarts, etc. Few hbck repairs
> repaired everything.
> - Logs still good, table merged correctly.
> - Triggered a major compaction, got the table splitted back to 36 regions.
> - Ran the balalancer, region got spreaded over the nodes. => Fine, but
> had to run it twice. First time 50% of the regions stayed assigned to
> one RS.
> - Stopped, restored my customed balancer, restart, rebalanced => Fine.
> - Create table, put, scan, get, disable, drop, balance, list,
> truncate_preserve, truncate from shell => Fine
> - Ran one MR job (416 mappers), went well, nothing in the logs.
>
> So to summarize: +1 ;) Even is there is 2 things to verify
> (TestRegionObserverScannerOpenHook and NotServingRegionException). I
> don't think they related to this release.
>
> I will post the performances comparison later tonight or tomorrow.
> (Need to add 0.94.8 also since I'm late),
>
> JM
>
> 2013/6/24 Jean-Marc Spaggiari <je...@spaggiari.org>:
>> Oh! Cool! A new toy for the week! ;)
>>
>> Thanks Lars! I will start right now to test it! (And I will do the
>> remaining perf testing just after or in parallel...)
>>
>> 2013/6/24 lars hofhansl <la...@apache.org>:
>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>> Signed with my code signing key: C7CFE328
>>>
>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>> [HBASE-8702] - Make WALEditCodec pluggable
>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>
>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>
>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>
>>> The release testing spreadsheet is available here:
>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>
>>> Thanks.
>>>
>>> -- Lars
>>>
>>> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Sorry for the delay team.
The new PDF with the 0.94.8 and 0.94.9 performance graphs is now online.
http://www.spaggiari.org/media/blogs/hbase/pdf/performances_20130628.pdf
JM
2013/6/25 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Here is my feedback.
>
> - Downloaded the files, checked the signature, uncompressed, checked
> changes.txt => Fine
> - Checked the documentation => One page not found under "Ref Guide
> (multi-page)" link on the index page. Should it be there?
> - Ran the test suite on 2 different servers,
> TestRegionObserverScannerOpenHook failed 10 times in a row with 8
> thread, 4, 2 and 1.
> - IntegrationTestLoadAndVerify => REFERENCES_CHECKED=985565 with
> 0.94.9 and REFERENCES_CHECKED=9855611 with 0.94.8. Don't know what to
> deduct.
> - integrationTestBigLinkedList => Fine
> - HBCK still reporting fine after all those tests.
>
> However, I have this exception many times on the logs, every 3 seconds:
>
> 2013-06-24 22:24:01,159 ERROR
> org.apache.hadoop.hbase.regionserver.HRegionServer: Closing scanner
> for IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
> org.apache.hadoop.hbase.NotServingRegionException: Region is not
> online: IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3509)
> at org.apache.hadoop.hbase.regionserver.HRegionServer$ScannerListener.leaseExpired(HRegionServer.java:2740)
> at org.apache.hadoop.hbase.regionserver.Leases.run(Leases.java:100)
> at java.lang.Thread.run(Thread.java:662)
>
> - Performed a rolling restart for the RS. 2500 regions to move
> around... => Fine. Took 74 minutes. Changed to regoin_mover to
> multhread, took 16 minutes.
> - Looked at the master and region logs, everything seems to be ok.
> - Merged all the regions from a table to a single region.
> - Checked HBCK, one issue on one table which is not the one merged.
> Issue was not there before the restarts, etc. Few hbck repairs
> repaired everything.
> - Logs still good, table merged correctly.
> - Triggered a major compaction, got the table splitted back to 36 regions.
> - Ran the balalancer, region got spreaded over the nodes. => Fine, but
> had to run it twice. First time 50% of the regions stayed assigned to
> one RS.
> - Stopped, restored my customed balancer, restart, rebalanced => Fine.
> - Create table, put, scan, get, disable, drop, balance, list,
> truncate_preserve, truncate from shell => Fine
> - Ran one MR job (416 mappers), went well, nothing in the logs.
>
> So to summarize: +1 ;) Even is there is 2 things to verify
> (TestRegionObserverScannerOpenHook and NotServingRegionException). I
> don't think they related to this release.
>
> I will post the performances comparison later tonight or tomorrow.
> (Need to add 0.94.8 also since I'm late),
>
> JM
>
> 2013/6/24 Jean-Marc Spaggiari <je...@spaggiari.org>:
>> Oh! Cool! A new toy for the week! ;)
>>
>> Thanks Lars! I will start right now to test it! (And I will do the
>> remaining perf testing just after or in parallel...)
>>
>> 2013/6/24 lars hofhansl <la...@apache.org>:
>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>> Signed with my code signing key: C7CFE328
>>>
>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>> [HBASE-8702] - Make WALEditCodec pluggable
>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>
>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>
>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>
>>> The release testing spreadsheet is available here:
>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>
>>> Thanks.
>>>
>>> -- Lars
>>>
>>> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Here is my feedback.
- Downloaded the files, checked the signature, uncompressed, checked
changes.txt => Fine
- Checked the documentation => One page not found under "Ref Guide
(multi-page)" link on the index page. Should it be there?
- Ran the test suite on 2 different servers,
TestRegionObserverScannerOpenHook failed 10 times in a row with 8
thread, 4, 2 and 1.
- IntegrationTestLoadAndVerify => REFERENCES_CHECKED=985565 with
0.94.9 and REFERENCES_CHECKED=9855611 with 0.94.8. Don't know what to
deduct.
- integrationTestBigLinkedList => Fine
- HBCK still reporting fine after all those tests.
However, I have this exception many times on the logs, every 3 seconds:
2013-06-24 22:24:01,159 ERROR
org.apache.hadoop.hbase.regionserver.HRegionServer: Closing scanner
for IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
org.apache.hadoop.hbase.NotServingRegionException: Region is not
online: IntegrationTestLoadAndVerify,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1372126832536.31c325cb8ae32b1ed0f4c4667d787165.
at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:3509)
at org.apache.hadoop.hbase.regionserver.HRegionServer$ScannerListener.leaseExpired(HRegionServer.java:2740)
at org.apache.hadoop.hbase.regionserver.Leases.run(Leases.java:100)
at java.lang.Thread.run(Thread.java:662)
- Performed a rolling restart for the RS. 2500 regions to move
around... => Fine. Took 74 minutes. Changed to regoin_mover to
multhread, took 16 minutes.
- Looked at the master and region logs, everything seems to be ok.
- Merged all the regions from a table to a single region.
- Checked HBCK, one issue on one table which is not the one merged.
Issue was not there before the restarts, etc. Few hbck repairs
repaired everything.
- Logs still good, table merged correctly.
- Triggered a major compaction, got the table splitted back to 36 regions.
- Ran the balalancer, region got spreaded over the nodes. => Fine, but
had to run it twice. First time 50% of the regions stayed assigned to
one RS.
- Stopped, restored my customed balancer, restart, rebalanced => Fine.
- Create table, put, scan, get, disable, drop, balance, list,
truncate_preserve, truncate from shell => Fine
- Ran one MR job (416 mappers), went well, nothing in the logs.
So to summarize: +1 ;) Even is there is 2 things to verify
(TestRegionObserverScannerOpenHook and NotServingRegionException). I
don't think they related to this release.
I will post the performances comparison later tonight or tomorrow.
(Need to add 0.94.8 also since I'm late),
JM
2013/6/24 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Oh! Cool! A new toy for the week! ;)
>
> Thanks Lars! I will start right now to test it! (And I will do the
> remaining perf testing just after or in parallel...)
>
> 2013/6/24 lars hofhansl <la...@apache.org>:
>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>> Signed with my code signing key: C7CFE328
>>
>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>> [HBASE-8683] - Add major compaction support in CompactionTool
>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>> [HBASE-8702] - Make WALEditCodec pluggable
>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>
>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>
>> The release testing spreadsheet is available here:
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>
>> Thanks.
>>
>> -- Lars
>>
>> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Oh! Cool! A new toy for the week! ;)
Thanks Lars! I will start right now to test it! (And I will do the
remaining perf testing just after or in parallel...)
2013/6/24 lars hofhansl <la...@apache.org>:
> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
> [HBASE-8453] - TestImportExport failing again due to configuration issues
> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
> [HBASE-8656] - Rpc call may not be notified in SecureClient
> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
> [HBASE-8684] - Table Coprocessor can't access external HTable by default
> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
> [HBASE-8683] - Add major compaction support in CompactionTool
> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
> [HBASE-8702] - Make WALEditCodec pluggable
> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
> [HBASE-8603] - Backport HBASE-6921 to 0.94
>
> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>
> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>
> The release testing spreadsheet is available here:
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>
> Thanks.
>
> -- Lars
>
> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Hi Lars,
It's rows/seconds for 1M rows (1M writes, the 1M RandomReads, only
measuring the reads).
I have the same test with 2M running for all 0.94 the releases to see
if it makes a difference.
JM
2013/7/6 lars hofhansl <la...@apache.org>:
> Are these times or ops/sec, or something else?
>
>
>
>
> ----- Original Message -----
> From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev@hbase.apache.org; lars hofhansl <la...@apache.org>
> Cc:
> Sent: Friday, July 5, 2013 8:24 PM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
> for download
>
> I have redo the tests and it's now all very consistent between all the
> recent versions
>
> Min Max Average Min80% Max80% Variance Precision
> hbase-0.94.5 914 1175 929 920 944 172 18.46%
> hbase-0.94.6 913 1176 927 915 954 174 18.80%
> hbase-0.94.7 913 1295 930 919 946 170 18.30%
> hbase-0.94.8 914 947 935 914 945 166 17.78%
> hbase-0.94.9 921 947 936 933 940 164 17.55%
>
> I will try to make the tests last longer to get more precise results...
>
> If we think a few nodes clusters is way beter for the performances
> tracking, then let's work that way. But if we think PE can do the job,
> it's even better ;) I just want to make sure we have accurate results
> and that we performance test the right things...
>
> I will re-run that, update the pdf and upload it again...
>
> JM
>
> 2013/7/4 lars hofhansl <la...@apache.org>:
>> Thanks for doing all this work!
>>
>> I did find a pretty high variance between the runs, which may be at issue here.
>>
>> Maybe there are effects that only show on certain setups (disk drives, ram, jvm version, etc).
>>
>> Maybe we can compare setups offline.
>>
>> -- Lars
>>
>>
>>
>> ----- Original Message -----
>> From: Jean-Marc Spaggiari <je...@spaggiari.org>
>> To: dev@hbase.apache.org
>> Cc:
>> Sent: Thursday, July 4, 2013 9:25 AM
>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
>> for download
>>
>> Ok. I get similar performances between 0.94.7 and 0.94.9 for the randomRead
>>
>> 0.94.7 => 1124179.9ms
>> 0.94.9 => 1110489.3ms
>>
>> I will re-run the tests one by one for all the 0.94.x versions and
>> update my charts...
>>
>> 2013/7/3 Jean-Marc Spaggiari <je...@spaggiari.org>:
>>> Ok. Test pass if I run it alone:
>>>
>>> mvn clean test -P runSmallTests -Djava.net.preferIPv4Stack=true
>>> -Dtest=org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>>
>>> -------------------------------------------------------
>>> T E S T S
>>> -------------------------------------------------------
>>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.642 sec
>>>
>>> Results :
>>>
>>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
>>>
>>>
>>>
>>> And finally passed on another one:
>>> Results :
>>>
>>> Tests run: 1359, Failures: 0, Errors: 0, Skipped: 13
>>>
>>> [INFO] ------------------------------------------------------------------------
>>> [INFO] BUILD SUCCESS
>>> [INFO] ------------------------------------------------------------------------
>>> [INFO] Total time: 1:33:34.925s
>>> [INFO] Finished at: Tue Jul 02 16:37:59 EDT 2013
>>> [INFO] Final Memory: 44M/594M
>>> [INFO] ------------------------------------------------------------------------
>>>
>>>
>>> So it's all +1 for me.
>>>
>>> JM
>>>
>>> 2013/7/2 Elliott Clark <ec...@apache.org>:
>>>> +1
>>>>
>>>> untared.
>>>> Checked the sig.
>>>> Ran Ycsb.
>>>> Ran PE.
>>>> upgraded from 94.8.
>>>>
>>>> On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
>>>>> passes fine here too
>>>>>
>>>>>
>>>>>
>>>>> ----- Original Message -----
>>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
>>>>> Cc:
>>>>> Sent: Tuesday, July 2, 2013 11:22 AM
>>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
>>>>> for download
>>>>>
>>>>> Yup:
>>>>>
>>>>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>>>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>>>>>
>>>>> Have you looked at the log to see on what error it fails?
>>>>>
>>>>> J-D
>>>>>
>>>>> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
>>>>> <je...@spaggiari.org> wrote:
>>>>>> JD, does TestRegionObserverScannerOpenHook work for you?
>>>>>>
>>>>>> I will retry to run it again on 3 different computers to see.
>>>>>>
>>>>>> JM
>>>>>>
>>>>>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>>>>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>>>>>
>>>>>>> -- Lars
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> ________________________________
>>>>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>>>>>> Sent: Monday, July 1, 2013 10:35 AM
>>>>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>>>>>
>>>>>>>
>>>>>>> I ran some PE single node tests on both tars, looked at the web UIs
>>>>>>> and logs. I'm +1 on this RC.
>>>>>>>
>>>>>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>>>>>> are not backup masters is kinda ugly.
>>>>>>>
>>>>>>> J-D
>>>>>>>
>>>>>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>>>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>>>>>> Signed with my code signing key: C7CFE328
>>>>>>>>
>>>>>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>>>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>>>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>>>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>>>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>>>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>>>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>>>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>>>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>>>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>>>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>>>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>>>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>>>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>>>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>>>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>>>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>>>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>>>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>>>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>>>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>>>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>>>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>>>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>>>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>>>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>>>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>>>>>
>>>>>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>>>>>
>>>>>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>>>>>
>>>>>>>> The release testing spreadsheet is available here:
>>>>>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>>>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>>>>>
>>>>>>>> Thanks.
>>>>>>>>
>>>>>>>> -- Lars
>>>>>>>>
>>>>>>>> ps. I will likely be without access to the Internet for the next five days
>>>>>
>>
>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Are these times or ops/sec, or something else?
----- Original Message -----
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev@hbase.apache.org; lars hofhansl <la...@apache.org>
Cc:
Sent: Friday, July 5, 2013 8:24 PM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
I have redo the tests and it's now all very consistent between all the
recent versions
Min Max Average Min80% Max80% Variance Precision
hbase-0.94.5 914 1175 929 920 944 172 18.46%
hbase-0.94.6 913 1176 927 915 954 174 18.80%
hbase-0.94.7 913 1295 930 919 946 170 18.30%
hbase-0.94.8 914 947 935 914 945 166 17.78%
hbase-0.94.9 921 947 936 933 940 164 17.55%
I will try to make the tests last longer to get more precise results...
If we think a few nodes clusters is way beter for the performances
tracking, then let's work that way. But if we think PE can do the job,
it's even better ;) I just want to make sure we have accurate results
and that we performance test the right things...
I will re-run that, update the pdf and upload it again...
JM
2013/7/4 lars hofhansl <la...@apache.org>:
> Thanks for doing all this work!
>
> I did find a pretty high variance between the runs, which may be at issue here.
>
> Maybe there are effects that only show on certain setups (disk drives, ram, jvm version, etc).
>
> Maybe we can compare setups offline.
>
> -- Lars
>
>
>
> ----- Original Message -----
> From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev@hbase.apache.org
> Cc:
> Sent: Thursday, July 4, 2013 9:25 AM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
> for download
>
> Ok. I get similar performances between 0.94.7 and 0.94.9 for the randomRead
>
> 0.94.7 => 1124179.9ms
> 0.94.9 => 1110489.3ms
>
> I will re-run the tests one by one for all the 0.94.x versions and
> update my charts...
>
> 2013/7/3 Jean-Marc Spaggiari <je...@spaggiari.org>:
>> Ok. Test pass if I run it alone:
>>
>> mvn clean test -P runSmallTests -Djava.net.preferIPv4Stack=true
>> -Dtest=org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>
>> -------------------------------------------------------
>> T E S T S
>> -------------------------------------------------------
>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.642 sec
>>
>> Results :
>>
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
>>
>>
>>
>> And finally passed on another one:
>> Results :
>>
>> Tests run: 1359, Failures: 0, Errors: 0, Skipped: 13
>>
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 1:33:34.925s
>> [INFO] Finished at: Tue Jul 02 16:37:59 EDT 2013
>> [INFO] Final Memory: 44M/594M
>> [INFO] ------------------------------------------------------------------------
>>
>>
>> So it's all +1 for me.
>>
>> JM
>>
>> 2013/7/2 Elliott Clark <ec...@apache.org>:
>>> +1
>>>
>>> untared.
>>> Checked the sig.
>>> Ran Ycsb.
>>> Ran PE.
>>> upgraded from 94.8.
>>>
>>> On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
>>>> passes fine here too
>>>>
>>>>
>>>>
>>>> ----- Original Message -----
>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
>>>> Cc:
>>>> Sent: Tuesday, July 2, 2013 11:22 AM
>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
>>>> for download
>>>>
>>>> Yup:
>>>>
>>>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>>>>
>>>> Have you looked at the log to see on what error it fails?
>>>>
>>>> J-D
>>>>
>>>> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
>>>> <je...@spaggiari.org> wrote:
>>>>> JD, does TestRegionObserverScannerOpenHook work for you?
>>>>>
>>>>> I will retry to run it again on 3 different computers to see.
>>>>>
>>>>> JM
>>>>>
>>>>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>>>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>>>>
>>>>>> -- Lars
>>>>>>
>>>>>>
>>>>>>
>>>>>> ________________________________
>>>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>>>>> Sent: Monday, July 1, 2013 10:35 AM
>>>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>>>>
>>>>>>
>>>>>> I ran some PE single node tests on both tars, looked at the web UIs
>>>>>> and logs. I'm +1 on this RC.
>>>>>>
>>>>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>>>>> are not backup masters is kinda ugly.
>>>>>>
>>>>>> J-D
>>>>>>
>>>>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>>>>> Signed with my code signing key: C7CFE328
>>>>>>>
>>>>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>>>>
>>>>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>>>>
>>>>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>>>>
>>>>>>> The release testing spreadsheet is available here:
>>>>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>>>>
>>>>>>> Thanks.
>>>>>>>
>>>>>>> -- Lars
>>>>>>>
>>>>>>> ps. I will likely be without access to the Internet for the next five days
>>>>
>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
I have redo the tests and it's now all very consistent between all the
recent versions
Min Max Average Min80% Max80% Variance Precision
hbase-0.94.5 914 1175 929 920 944 172 18.46%
hbase-0.94.6 913 1176 927 915 954 174 18.80%
hbase-0.94.7 913 1295 930 919 946 170 18.30%
hbase-0.94.8 914 947 935 914 945 166 17.78%
hbase-0.94.9 921 947 936 933 940 164 17.55%
I will try to make the tests last longer to get more precise results...
If we think a few nodes clusters is way beter for the performances
tracking, then let's work that way. But if we think PE can do the job,
it's even better ;) I just want to make sure we have accurate results
and that we performance test the right things...
I will re-run that, update the pdf and upload it again...
JM
2013/7/4 lars hofhansl <la...@apache.org>:
> Thanks for doing all this work!
>
> I did find a pretty high variance between the runs, which may be at issue here.
>
> Maybe there are effects that only show on certain setups (disk drives, ram, jvm version, etc).
>
> Maybe we can compare setups offline.
>
> -- Lars
>
>
>
> ----- Original Message -----
> From: Jean-Marc Spaggiari <je...@spaggiari.org>
> To: dev@hbase.apache.org
> Cc:
> Sent: Thursday, July 4, 2013 9:25 AM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
> for download
>
> Ok. I get similar performances between 0.94.7 and 0.94.9 for the randomRead
>
> 0.94.7 => 1124179.9ms
> 0.94.9 => 1110489.3ms
>
> I will re-run the tests one by one for all the 0.94.x versions and
> update my charts...
>
> 2013/7/3 Jean-Marc Spaggiari <je...@spaggiari.org>:
>> Ok. Test pass if I run it alone:
>>
>> mvn clean test -P runSmallTests -Djava.net.preferIPv4Stack=true
>> -Dtest=org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>
>> -------------------------------------------------------
>> T E S T S
>> -------------------------------------------------------
>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.642 sec
>>
>> Results :
>>
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
>>
>>
>>
>> And finally passed on another one:
>> Results :
>>
>> Tests run: 1359, Failures: 0, Errors: 0, Skipped: 13
>>
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 1:33:34.925s
>> [INFO] Finished at: Tue Jul 02 16:37:59 EDT 2013
>> [INFO] Final Memory: 44M/594M
>> [INFO] ------------------------------------------------------------------------
>>
>>
>> So it's all +1 for me.
>>
>> JM
>>
>> 2013/7/2 Elliott Clark <ec...@apache.org>:
>>> +1
>>>
>>> untared.
>>> Checked the sig.
>>> Ran Ycsb.
>>> Ran PE.
>>> upgraded from 94.8.
>>>
>>> On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
>>>> passes fine here too
>>>>
>>>>
>>>>
>>>> ----- Original Message -----
>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
>>>> Cc:
>>>> Sent: Tuesday, July 2, 2013 11:22 AM
>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
>>>> for download
>>>>
>>>> Yup:
>>>>
>>>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>>>>
>>>> Have you looked at the log to see on what error it fails?
>>>>
>>>> J-D
>>>>
>>>> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
>>>> <je...@spaggiari.org> wrote:
>>>>> JD, does TestRegionObserverScannerOpenHook work for you?
>>>>>
>>>>> I will retry to run it again on 3 different computers to see.
>>>>>
>>>>> JM
>>>>>
>>>>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>>>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>>>>
>>>>>> -- Lars
>>>>>>
>>>>>>
>>>>>>
>>>>>> ________________________________
>>>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>>>>> Sent: Monday, July 1, 2013 10:35 AM
>>>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>>>>
>>>>>>
>>>>>> I ran some PE single node tests on both tars, looked at the web UIs
>>>>>> and logs. I'm +1 on this RC.
>>>>>>
>>>>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>>>>> are not backup masters is kinda ugly.
>>>>>>
>>>>>> J-D
>>>>>>
>>>>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>>>>> Signed with my code signing key: C7CFE328
>>>>>>>
>>>>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>>>>
>>>>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>>>>
>>>>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>>>>
>>>>>>> The release testing spreadsheet is available here:
>>>>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>>>>
>>>>>>> Thanks.
>>>>>>>
>>>>>>> -- Lars
>>>>>>>
>>>>>>> ps. I will likely be without access to the Internet for the next five days
>>>>
>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Thanks for doing all this work!
I did find a pretty high variance between the runs, which may be at issue here.
Maybe there are effects that only show on certain setups (disk drives, ram, jvm version, etc).
Maybe we can compare setups offline.
-- Lars
----- Original Message -----
From: Jean-Marc Spaggiari <je...@spaggiari.org>
To: dev@hbase.apache.org
Cc:
Sent: Thursday, July 4, 2013 9:25 AM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Ok. I get similar performances between 0.94.7 and 0.94.9 for the randomRead
0.94.7 => 1124179.9ms
0.94.9 => 1110489.3ms
I will re-run the tests one by one for all the 0.94.x versions and
update my charts...
2013/7/3 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Ok. Test pass if I run it alone:
>
> mvn clean test -P runSmallTests -Djava.net.preferIPv4Stack=true
> -Dtest=org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>
> -------------------------------------------------------
> T E S T S
> -------------------------------------------------------
> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.642 sec
>
> Results :
>
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
>
>
>
> And finally passed on another one:
> Results :
>
> Tests run: 1359, Failures: 0, Errors: 0, Skipped: 13
>
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 1:33:34.925s
> [INFO] Finished at: Tue Jul 02 16:37:59 EDT 2013
> [INFO] Final Memory: 44M/594M
> [INFO] ------------------------------------------------------------------------
>
>
> So it's all +1 for me.
>
> JM
>
> 2013/7/2 Elliott Clark <ec...@apache.org>:
>> +1
>>
>> untared.
>> Checked the sig.
>> Ran Ycsb.
>> Ran PE.
>> upgraded from 94.8.
>>
>> On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
>>> passes fine here too
>>>
>>>
>>>
>>> ----- Original Message -----
>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
>>> Cc:
>>> Sent: Tuesday, July 2, 2013 11:22 AM
>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
>>> for download
>>>
>>> Yup:
>>>
>>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>>>
>>> Have you looked at the log to see on what error it fails?
>>>
>>> J-D
>>>
>>> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
>>> <je...@spaggiari.org> wrote:
>>>> JD, does TestRegionObserverScannerOpenHook work for you?
>>>>
>>>> I will retry to run it again on 3 different computers to see.
>>>>
>>>> JM
>>>>
>>>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>>>
>>>>> -- Lars
>>>>>
>>>>>
>>>>>
>>>>> ________________________________
>>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>>>> Sent: Monday, July 1, 2013 10:35 AM
>>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>>>
>>>>>
>>>>> I ran some PE single node tests on both tars, looked at the web UIs
>>>>> and logs. I'm +1 on this RC.
>>>>>
>>>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>>>> are not backup masters is kinda ugly.
>>>>>
>>>>> J-D
>>>>>
>>>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>>>> Signed with my code signing key: C7CFE328
>>>>>>
>>>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>>>
>>>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>>>
>>>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>>>
>>>>>> The release testing spreadsheet is available here:
>>>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> -- Lars
>>>>>>
>>>>>> ps. I will likely be without access to the Internet for the next five days
>>>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Ok. I get similar performances between 0.94.7 and 0.94.9 for the randomRead
0.94.7 => 1124179.9ms
0.94.9 => 1110489.3ms
I will re-run the tests one by one for all the 0.94.x versions and
update my charts...
2013/7/3 Jean-Marc Spaggiari <je...@spaggiari.org>:
> Ok. Test pass if I run it alone:
>
> mvn clean test -P runSmallTests -Djava.net.preferIPv4Stack=true
> -Dtest=org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>
> -------------------------------------------------------
> T E S T S
> -------------------------------------------------------
> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.642 sec
>
> Results :
>
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
>
>
>
> And finally passed on another one:
> Results :
>
> Tests run: 1359, Failures: 0, Errors: 0, Skipped: 13
>
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 1:33:34.925s
> [INFO] Finished at: Tue Jul 02 16:37:59 EDT 2013
> [INFO] Final Memory: 44M/594M
> [INFO] ------------------------------------------------------------------------
>
>
> So it's all +1 for me.
>
> JM
>
> 2013/7/2 Elliott Clark <ec...@apache.org>:
>> +1
>>
>> untared.
>> Checked the sig.
>> Ran Ycsb.
>> Ran PE.
>> upgraded from 94.8.
>>
>> On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
>>> passes fine here too
>>>
>>>
>>>
>>> ----- Original Message -----
>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
>>> Cc:
>>> Sent: Tuesday, July 2, 2013 11:22 AM
>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
>>> for download
>>>
>>> Yup:
>>>
>>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>>>
>>> Have you looked at the log to see on what error it fails?
>>>
>>> J-D
>>>
>>> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
>>> <je...@spaggiari.org> wrote:
>>>> JD, does TestRegionObserverScannerOpenHook work for you?
>>>>
>>>> I will retry to run it again on 3 different computers to see.
>>>>
>>>> JM
>>>>
>>>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>>>
>>>>> -- Lars
>>>>>
>>>>>
>>>>>
>>>>> ________________________________
>>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>>>> Sent: Monday, July 1, 2013 10:35 AM
>>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>>>
>>>>>
>>>>> I ran some PE single node tests on both tars, looked at the web UIs
>>>>> and logs. I'm +1 on this RC.
>>>>>
>>>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>>>> are not backup masters is kinda ugly.
>>>>>
>>>>> J-D
>>>>>
>>>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>>>> Signed with my code signing key: C7CFE328
>>>>>>
>>>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>>>
>>>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>>>
>>>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>>>
>>>>>> The release testing spreadsheet is available here:
>>>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> -- Lars
>>>>>>
>>>>>> ps. I will likely be without access to the Internet for the next five days
>>>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Ok. Test pass if I run it alone:
mvn clean test -P runSmallTests -Djava.net.preferIPv4Stack=true
-Dtest=org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
-------------------------------------------------------
T E S T S
-------------------------------------------------------
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.642 sec
Results :
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0
And finally passed on another one:
Results :
Tests run: 1359, Failures: 0, Errors: 0, Skipped: 13
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:33:34.925s
[INFO] Finished at: Tue Jul 02 16:37:59 EDT 2013
[INFO] Final Memory: 44M/594M
[INFO] ------------------------------------------------------------------------
So it's all +1 for me.
JM
2013/7/2 Elliott Clark <ec...@apache.org>:
> +1
>
> untared.
> Checked the sig.
> Ran Ycsb.
> Ran PE.
> upgraded from 94.8.
>
> On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
>> passes fine here too
>>
>>
>>
>> ----- Original Message -----
>> From: Jean-Daniel Cryans <jd...@apache.org>
>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
>> Cc:
>> Sent: Tuesday, July 2, 2013 11:22 AM
>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
>> for download
>>
>> Yup:
>>
>> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>>
>> Have you looked at the log to see on what error it fails?
>>
>> J-D
>>
>> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
>> <je...@spaggiari.org> wrote:
>>> JD, does TestRegionObserverScannerOpenHook work for you?
>>>
>>> I will retry to run it again on 3 different computers to see.
>>>
>>> JM
>>>
>>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>>
>>>> -- Lars
>>>>
>>>>
>>>>
>>>> ________________________________
>>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>>> Sent: Monday, July 1, 2013 10:35 AM
>>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>>
>>>>
>>>> I ran some PE single node tests on both tars, looked at the web UIs
>>>> and logs. I'm +1 on this RC.
>>>>
>>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>>> are not backup masters is kinda ugly.
>>>>
>>>> J-D
>>>>
>>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>>> Signed with my code signing key: C7CFE328
>>>>>
>>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>>
>>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>>
>>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>>
>>>>> The release testing spreadsheet is available here:
>>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>>
>>>>> Thanks.
>>>>>
>>>>> -- Lars
>>>>>
>>>>> ps. I will likely be without access to the Internet for the next five days
>>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Thanks Elliott, J-D, and JM.
I will release 0.94.9 later today.
-- Lars
----- Original Message -----
From: Elliott Clark <ec...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Cc:
Sent: Tuesday, July 2, 2013 12:48 PM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
+1
untared.
Checked the sig.
Ran Ycsb.
Ran PE.
upgraded from 94.8.
On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
> passes fine here too
>
>
>
> ----- Original Message -----
> From: Jean-Daniel Cryans <jd...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc:
> Sent: Tuesday, July 2, 2013 11:22 AM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
> for download
>
> Yup:
>
> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>
> Have you looked at the log to see on what error it fails?
>
> J-D
>
> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
> <je...@spaggiari.org> wrote:
>> JD, does TestRegionObserverScannerOpenHook work for you?
>>
>> I will retry to run it again on 3 different computers to see.
>>
>> JM
>>
>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>
>>> -- Lars
>>>
>>>
>>>
>>> ________________________________
>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>> Sent: Monday, July 1, 2013 10:35 AM
>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>
>>>
>>> I ran some PE single node tests on both tars, looked at the web UIs
>>> and logs. I'm +1 on this RC.
>>>
>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>> are not backup masters is kinda ugly.
>>>
>>> J-D
>>>
>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>> Signed with my code signing key: C7CFE328
>>>>
>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>
>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>
>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>
>>>> The release testing spreadsheet is available here:
>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>
>>>> Thanks.
>>>>
>>>> -- Lars
>>>>
>>>> ps. I will likely be without access to the Internet for the next five days
>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Elliott Clark <ec...@apache.org>.
+1
untared.
Checked the sig.
Ran Ycsb.
Ran PE.
upgraded from 94.8.
On Tue, Jul 2, 2013 at 11:32 AM, lars hofhansl <la...@apache.org> wrote:
> passes fine here too
>
>
>
> ----- Original Message -----
> From: Jean-Daniel Cryans <jd...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>
> Cc:
> Sent: Tuesday, July 2, 2013 11:22 AM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
> for download
>
> Yup:
>
> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
>
> Have you looked at the log to see on what error it fails?
>
> J-D
>
> On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
> <je...@spaggiari.org> wrote:
>> JD, does TestRegionObserverScannerOpenHook work for you?
>>
>> I will retry to run it again on 3 different computers to see.
>>
>> JM
>>
>> 2013/7/1 lars hofhansl <la...@apache.org>:
>>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>>
>>> -- Lars
>>>
>>>
>>>
>>> ________________________________
>>> From: Jean-Daniel Cryans <jd...@apache.org>
>>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>>> Sent: Monday, July 1, 2013 10:35 AM
>>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>>
>>>
>>> I ran some PE single node tests on both tars, looked at the web UIs
>>> and logs. I'm +1 on this RC.
>>>
>>> My only nit is the way that HBASE-5083 leaves an empty table if there
>>> are not backup masters is kinda ugly.
>>>
>>> J-D
>>>
>>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>>> Signed with my code signing key: C7CFE328
>>>>
>>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>>> [HBASE-8702] - Make WALEditCodec pluggable
>>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>>
>>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>>
>>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>>
>>>> The release testing spreadsheet is available here:
>>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>>
>>>> Thanks.
>>>>
>>>> -- Lars
>>>>
>>>> ps. I will likely be without access to the Internet for the next five days
>
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
passes fine here too
----- Original Message -----
From: Jean-Daniel Cryans <jd...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>
Cc:
Sent: Tuesday, July 2, 2013 11:22 AM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Yup:
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
Have you looked at the log to see on what error it fails?
J-D
On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:
> JD, does TestRegionObserverScannerOpenHook work for you?
>
> I will retry to run it again on 3 different computers to see.
>
> JM
>
> 2013/7/1 lars hofhansl <la...@apache.org>:
>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>> From: Jean-Daniel Cryans <jd...@apache.org>
>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>> Sent: Monday, July 1, 2013 10:35 AM
>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>
>>
>> I ran some PE single node tests on both tars, looked at the web UIs
>> and logs. I'm +1 on this RC.
>>
>> My only nit is the way that HBASE-5083 leaves an empty table if there
>> are not backup masters is kinda ugly.
>>
>> J-D
>>
>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>> Signed with my code signing key: C7CFE328
>>>
>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>> [HBASE-8702] - Make WALEditCodec pluggable
>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>
>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>
>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>
>>> The release testing spreadsheet is available here:
>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>
>>> Thanks.
>>>
>>> -- Lars
>>>
>>> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Yup:
Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.756 sec
Have you looked at the log to see on what error it fails?
J-D
On Tue, Jul 2, 2013 at 11:08 AM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:
> JD, does TestRegionObserverScannerOpenHook work for you?
>
> I will retry to run it again on 3 different computers to see.
>
> JM
>
> 2013/7/1 lars hofhansl <la...@apache.org>:
>> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>>
>> -- Lars
>>
>>
>>
>> ________________________________
>> From: Jean-Daniel Cryans <jd...@apache.org>
>> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
>> Sent: Monday, July 1, 2013 10:35 AM
>> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>>
>>
>> I ran some PE single node tests on both tars, looked at the web UIs
>> and logs. I'm +1 on this RC.
>>
>> My only nit is the way that HBASE-5083 leaves an empty table if there
>> are not backup masters is kinda ugly.
>>
>> J-D
>>
>> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>>> Signed with my code signing key: C7CFE328
>>>
>>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>>> [HBASE-8683] - Add major compaction support in CompactionTool
>>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>>> [HBASE-8702] - Make WALEditCodec pluggable
>>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>>
>>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>>
>>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>>
>>> The release testing spreadsheet is available here:
>>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>>
>>> Thanks.
>>>
>>> -- Lars
>>>
>>> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
JD, does TestRegionObserverScannerOpenHook work for you?
I will retry to run it again on 3 different computers to see.
JM
2013/7/1 lars hofhansl <la...@apache.org>:
> Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
>
> -- Lars
>
>
>
> ________________________________
> From: Jean-Daniel Cryans <jd...@apache.org>
> To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
> Sent: Monday, July 1, 2013 10:35 AM
> Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
>
>
> I ran some PE single node tests on both tars, looked at the web UIs
> and logs. I'm +1 on this RC.
>
> My only nit is the way that HBASE-5083 leaves an empty table if there
> are not backup masters is kinda ugly.
>
> J-D
>
> On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
>> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
>> Signed with my code signing key: C7CFE328
>>
>> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
>> [HBASE-8453] - TestImportExport failing again due to configuration issues
>> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
>> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
>> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
>> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
>> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
>> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
>> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
>> [HBASE-8656] - Rpc call may not be notified in SecureClient
>> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
>> [HBASE-8684] - Table Coprocessor can't access external HTable by default
>> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
>> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
>> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
>> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
>> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
>> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
>> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
>> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
>> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
>> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
>> [HBASE-8683] - Add major compaction support in CompactionTool
>> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
>> [HBASE-8702] - Make WALEditCodec pluggable
>> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
>> [HBASE-8603] - Backport HBASE-6921 to 0.94
>>
>> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>>
>> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>>
>> The release testing spreadsheet is available here:
>> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
>> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>>
>> Thanks.
>>
>> -- Lars
>>
>> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
Posted by lars hofhansl <la...@apache.org>.
Hah. I let Cody answer here. I didn't like the empty table either, but he preferred it.
-- Lars
________________________________
From: Jean-Daniel Cryans <jd...@apache.org>
To: "dev@hbase.apache.org" <de...@hbase.apache.org>; lars hofhansl <la...@apache.org>
Sent: Monday, July 1, 2013 10:35 AM
Subject: Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available for download
I ran some PE single node tests on both tars, looked at the web UIs
and logs. I'm +1 on this RC.
My only nit is the way that HBASE-5083 leaves an empty table if there
are not backup masters is kinda ugly.
J-D
On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
> [HBASE-8453] - TestImportExport failing again due to configuration issues
> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
> [HBASE-8656] - Rpc call may not be notified in SecureClient
> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
> [HBASE-8684] - Table Coprocessor can't access external HTable by default
> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
> [HBASE-8683] - Add major compaction support in CompactionTool
> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
> [HBASE-8702] - Make WALEditCodec pluggable
> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
> [HBASE-8603] - Backport HBASE-6921 to 0.94
>
> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>
> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>
> The release testing spreadsheet is available here:
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>
> Thanks.
>
> -- Lars
>
> ps. I will likely be without access to the Internet for the next five days
Re: [ANNOUNCE] The 1st hbase 0.94.9 release candidate is available
for download
Posted by Jean-Daniel Cryans <jd...@apache.org>.
I ran some PE single node tests on both tars, looked at the web UIs
and logs. I'm +1 on this RC.
My only nit is the way that HBASE-5083 leaves an empty table if there
are not backup masters is kinda ugly.
J-D
On Mon, Jun 24, 2013 at 3:51 PM, lars hofhansl <la...@apache.org> wrote:
> The 1st 0.94.9 RC is available for download at http://people.apache.org/~larsh/hbase-0.94.9-rc0/
> Signed with my code signing key: C7CFE328
>
> Like the previous point releases, 0.94.9 is a primarily a bug fix release. This RC is comparatively small with 26 issues resolved against it:
> [HBASE-8453] - TestImportExport failing again due to configuration issues
> [HBASE-8494] - TestRemoteAdmin#testClusterStatus should not assume 'requests' does not change
> [HBASE-8522] - Archived hfiles and old hlogs may be deleted immediately by HFileCleaner, LogCleaner in HMaster
> [HBASE-8555] - FilterList correctness may be affected by random ordering of sub-filter(list)
> [HBASE-8590] - [0.94] BlockingMetaScannerVisitor should check for parent meta entry while waiting for split daughter
> [HBASE-8639] - Poor performance of htable#getscanner in multithreaded environment due to DNS.getDefaultHost() being called in ScannerCallable#prepare()
> [HBASE-8640] - ServerName in master may not initialize with the configured ipc address of hbase.master.ipc.address
> [HBASE-8655] - Backport to 94 - HBASE-8346(Prefetching .META. rows in case only when useCache is set to true)
> [HBASE-8656] - Rpc call may not be notified in SecureClient
> [HBASE-8671] - Per-region WAL breaks CP backwards compatibility in 0.94 for non-enabled case
> [HBASE-8684] - Table Coprocessor can't access external HTable by default
> [HBASE-8700] - IntegrationTestBigLinkedList can fail due to random number collision
> [HBASE-8724] - [0.94] ExportSnapshot should not use hbase.tmp.dir as a staging dir on hdfs
> [HBASE-8742] - HTableDescriptor Properties not preserved when cloning
> [HBASE-8743] - upgrade hadoop-23 version to 0.23.7
> [HBASE-8749] - Potential race condition between FSUtils.renameAndSetModifyTime() and HFile/LogCleaner
> [HBASE-8762] - Performance/operational penalty when calling HTable.get with a list of one Get
> [HBASE-8783] - RSSnapshotManager.ZKProcedureMemberRpcs may be initialized with the wrong server name
> [HBASE-5083] - Backup HMaster should have http infoport open with link to the active master
> [HBASE-8609] - Make the CopyTable support startRow, stopRow options
> [HBASE-8636] - Backport KeyValue Codec to 0.94 (HBASE-7413)
> [HBASE-8683] - Add major compaction support in CompactionTool
> [HBASE-8692] - [AccessController] Restrict HTableDescriptor enumeration
> [HBASE-8702] - Make WALEditCodec pluggable
> [HBASE-8504] - HTable.getRegionsInRange() should provide a non-cached API
> [HBASE-8603] - Backport HBASE-6921 to 0.94
>
> The full list of changes is also available here: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12324431
>
> Please try out the RC, check out the doc, take it for a spin, etc, and vote +1/-1 by July 2nd on whether we should release this as 0.94.9.
>
> The release testing spreadsheet is available here:
> https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdGFHaktDR0FqLWdtQWZwdncyVzE3Z2c#gid=0
> (if you test this release, please add your test to this spreadsheet, so that we can gauge the coverage)
>
> Thanks.
>
> -- Lars
>
> ps. I will likely be without access to the Internet for the next five days