You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by stack <st...@duboce.net> on 2009/08/18 07:52:48 UTC

ANN: hbase 0.20.0 Release Candidate 2 available for download

The second hbase 0.20.0 release candidate is available for download:

http://people.apache.org/~stack/hbase-0.20.0-candidate-2/

Near to 450 issues have been addressed since the 0.19 branch.  Release notes
are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.

HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x including
configuration fundamentals.  Be sure to read the 'Getting Started'
documentation in 0.20.0 available here: http://su.pr/8YQjHO

If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will need
to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
First read the overview and then go to the section, 'From 0.19.x to 0.20.x'.

Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
Wednesday, August 25th.

Yours,
The HBasistas

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Ryan Rawson <ry...@gmail.com>.

Sounds like standard .META. data loss, an expected scenario until
either of HDFS-200 or HDFS-265 are resolved in a favourable manner.

Stack, I dont think its a blocker, we can count this as a '0' or a '+1'.

On Mon, Aug 24, 2009 at 9:40 PM, Schubert Zhang<zs...@gmail.com> wrote:
> The .META. table is not flushed.
>
> But then, I killed -9 all RS and master, then re-start hbase. Everything
> become ok.
>
> On Tue, Aug 25, 2009 at 12:35 PM, Ryan Rawson <ry...@gmail.com> wrote:
>
>> Did you flush .META. table as well?
>>
>> -ryan
>>
>> On Mon, Aug 24, 2009 at 9:26 PM, Schubert Zhang<zs...@gmail.com> wrote:
>> > -1
>> >
>> > I tested reliability of RegionServer crash, and found following problem:
>> >
>> > Test:
>> > (1) A table, inserted millions of rows. the I use hbase shell commant to
>> > flush a memstores to disk, there are 25 regions.
>> > (2) Kill a RS (no ROOT and META region), then scan the whole table,
>> success.
>> > (3) Kill another RS (with META region), then scan the whole table, fail.
>> > Maybe meta and data mismatch.
>> >    (strangely there are 28 regions now, why? and following is the err
>> log!)
>> >
>> >
>> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
>> > contact region server 10.24.1.16:60020 for region
>> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
>> > 10 attempts.
>> > Exceptions:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> >
>> >        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> >        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> >
>> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
>> > contact region server 10.24.1.16:60020 for region
>> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
>> > 10 attempts.
>> > Exceptions:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> >
>> >        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> >        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> >
>> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
>> > contact region server 10.24.1.16:60020 for region
>> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
>> > 10 attempts.
>> > Exceptions:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> >
>> >        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> >        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Wed, Aug 19, 2009 at 3:39 AM, Schubert Zhang <zs...@gmail.com>
>> wrote:
>> >
>> >> +1
>> >>
>> >> I have done our test, it is fine to release.
>> >>
>> >>   On Wed, Aug 19, 2009 at 1:13 AM, stack <st...@duboce.net> wrote:
>> >>
>> >>> Update your binaries.  Take down the cluster en masse and update all or
>> do
>> >>> it via a rolling restart:
>> >>> http://wiki.apache.org/hadoop/Hbase/RollingRestart
>> >>> .
>> >>>
>> >>> Regards whats been fixed since RC1, see http://su.pr/1QTH7L.
>> >>>
>> >>> St.Ack
>> >>>
>> >>> On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com>
>> wrote:
>> >>>
>> >>> > Now I use candidate-1 version, To fix these bugs, how and what should
>> I
>> >>> do
>> >>> > ?
>> >>> >
>> >>> > On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com>
>> >>> wrote:
>> >>> >
>> >>> > > A few bugs were fixed, seemingly minor but critical.
>> >>> > >
>> >>> > > enjoy!
>> >>> > > -ryan
>> >>> > >
>> >>> > > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com>
>> >>> wrote:
>> >>> > > > What is the difference between the two candidate version?
>> >>> > > >
>> >>> > > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
>> >>> > > >
>> >>> > > >> The second hbase 0.20.0 release candidate is available for
>> >>> download:
>> >>> > > >>
>> >>> > > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<
>> >>> http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/<http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
>> <http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
>>  >>> >
>> >>>  > > >>
>> >>> > > >> Near to 450 issues have been addressed since the 0.19 branch.
>> >>>  Release
>> >>> > > >> notes
>> >>> > > >> are available here: http://su.pr/18zcEO <
>> http://tinyurl.com/8xmyx9
>> >>> >.
>> >>> > > >>
>> >>> > > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since
>> 0.19.x
>> >>> > > >> including
>> >>> > > >> configuration fundamentals.  Be sure to read the 'Getting
>> Started'
>> >>> > > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>> >>> > > >>
>> >>> > > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0,
>> you
>> >>> > will
>> >>> > > >> need
>> >>> > > >> to run a migration.  See
>> >>> > > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>> >>> > > >> First read the overview and then go to the section, 'From 0.19.x
>> to
>> >>> > > >> 0.20.x'.
>> >>> > > >>
>> >>> > > >> Should we release this candidate as hbase 0.20.0?  Please vote
>> >>> +1/-1
>> >>> > by
>> >>> > > >> Wednesday, August 25th.
>> >>> > > >>
>> >>> > > >> Yours,
>> >>> > > >> The HBasistas
>> >>> > > >>
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> >>
>> >>
>> >
>>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Schubert Zhang <zs...@gmail.com>.

Hi stack,

Yes, you are right, 0.20.0 shoud be released asap to let more people to use
and test it.

+1

We will continue to test it.
Schubert
On Tue, Aug 25, 2009 at 12:40 PM, Schubert Zhang <zs...@gmail.com> wrote:

> The .META. table is not flushed.
>
> But then, I killed -9 all RS and master, then re-start hbase. Everything
> become ok.
>
>   On Tue, Aug 25, 2009 at 12:35 PM, Ryan Rawson <ry...@gmail.com>wrote:
>
>> Did you flush .META. table as well?
>>
>> -ryan
>>
>> On Mon, Aug 24, 2009 at 9:26 PM, Schubert Zhang<zs...@gmail.com> wrote:
>> > -1
>> >
>> > I tested reliability of RegionServer crash, and found following problem:
>> >
>> > Test:
>> > (1) A table, inserted millions of rows. the I use hbase shell commant to
>> > flush a memstores to disk, there are 25 regions.
>> > (2) Kill a RS (no ROOT and META region), then scan the whole table,
>> success.
>> > (3) Kill another RS (with META region), then scan the whole table, fail.
>> > Maybe meta and data mismatch.
>> >    (strangely there are 28 regions now, why? and following is the err
>> log!)
>> >
>> >
>> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
>> > contact region server 10.24.1.16:60020 for region
>> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
>> > 10 attempts.
>> > Exceptions:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> >
>> >        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> >        at
>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> >
>> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
>> > contact region server 10.24.1.16:60020 for region
>> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
>> > 10 attempts.
>> > Exceptions:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> >
>> >        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> >        at
>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> >
>> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
>> > contact region server 10.24.1.16:60020 for region
>> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
>> > 10 attempts.
>> > Exceptions:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > org.apache.hadoop.hbase.NotServingRegionException:
>> > TestTable,0001698618,1251172170797
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>> >        at
>> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>> >        at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> >        at java.lang.reflect.Method.invoke(Method.java:597)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>> >        at
>> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>> >
>> >
>> >        at
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>> >        at
>> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>> >        at
>> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>> >        at
>> org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>> >
>> >
>> >
>> >
>> >
>> >
>> > On Wed, Aug 19, 2009 at 3:39 AM, Schubert Zhang <zs...@gmail.com>
>> wrote:
>> >
>> >> +1
>> >>
>> >> I have done our test, it is fine to release.
>> >>
>> >>   On Wed, Aug 19, 2009 at 1:13 AM, stack <st...@duboce.net> wrote:
>> >>
>> >>> Update your binaries.  Take down the cluster en masse and update all
>> or do
>> >>> it via a rolling restart:
>> >>> http://wiki.apache.org/hadoop/Hbase/RollingRestart
>> >>> .
>> >>>
>> >>> Regards whats been fixed since RC1, see http://su.pr/1QTH7L.
>> >>>
>> >>> St.Ack
>> >>>
>> >>> On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com>
>> wrote:
>> >>>
>> >>> > Now I use candidate-1 version, To fix these bugs, how and what
>> should I
>> >>> do
>> >>> > ?
>> >>> >
>> >>> > On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com>
>> >>> wrote:
>> >>> >
>> >>> > > A few bugs were fixed, seemingly minor but critical.
>> >>> > >
>> >>> > > enjoy!
>> >>> > > -ryan
>> >>> > >
>> >>> > > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com>
>> >>> wrote:
>> >>> > > > What is the difference between the two candidate version?
>> >>> > > >
>> >>> > > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net>
>> wrote:
>> >>> > > >
>> >>> > > >> The second hbase 0.20.0 release candidate is available for
>> >>> download:
>> >>> > > >>
>> >>> > > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<
>> >>> http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/<http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
>> <http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
>>  >>> >
>> >>>  > > >>
>> >>> > > >> Near to 450 issues have been addressed since the 0.19 branch.
>> >>>  Release
>> >>> > > >> notes
>> >>> > > >> are available here: http://su.pr/18zcEO <
>> http://tinyurl.com/8xmyx9
>> >>> >.
>> >>> > > >>
>> >>> > > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since
>> 0.19.x
>> >>> > > >> including
>> >>> > > >> configuration fundamentals.  Be sure to read the 'Getting
>> Started'
>> >>> > > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>> >>> > > >>
>> >>> > > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0,
>> you
>> >>> > will
>> >>> > > >> need
>> >>> > > >> to run a migration.  See
>> >>> > > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>> >>> > > >> First read the overview and then go to the section, 'From
>> 0.19.x to
>> >>> > > >> 0.20.x'.
>> >>> > > >>
>> >>> > > >> Should we release this candidate as hbase 0.20.0?  Please vote
>> >>> +1/-1
>> >>> > by
>> >>> > > >> Wednesday, August 25th.
>> >>> > > >>
>> >>> > > >> Yours,
>> >>> > > >> The HBasistas
>> >>> > > >>
>> >>> > > >
>> >>> > >
>> >>> >
>> >>>
>> >>
>> >>
>> >
>>
>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Schubert Zhang <zs...@gmail.com>.

The .META. table is not flushed.

But then, I killed -9 all RS and master, then re-start hbase. Everything
become ok.

On Tue, Aug 25, 2009 at 12:35 PM, Ryan Rawson <ry...@gmail.com> wrote:

> Did you flush .META. table as well?
>
> -ryan
>
> On Mon, Aug 24, 2009 at 9:26 PM, Schubert Zhang<zs...@gmail.com> wrote:
> > -1
> >
> > I tested reliability of RegionServer crash, and found following problem:
> >
> > Test:
> > (1) A table, inserted millions of rows. the I use hbase shell commant to
> > flush a memstores to disk, there are 25 regions.
> > (2) Kill a RS (no ROOT and META region), then scan the whole table,
> success.
> > (3) Kill another RS (with META region), then scan the whole table, fail.
> > Maybe meta and data mismatch.
> >    (strangely there are 28 regions now, why? and following is the err
> log!)
> >
> >
> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> > contact region server 10.24.1.16:60020 for region
> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
> > 10 attempts.
> > Exceptions:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> >
> >        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
> >        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
> >        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
> >
> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> > contact region server 10.24.1.16:60020 for region
> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
> > 10 attempts.
> > Exceptions:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> >
> >        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
> >        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
> >        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
> >
> > org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> > contact region server 10.24.1.16:60020 for region
> > TestTable,0001698618,1251172170797, row '0001698618', but failed after
> > 10 attempts.
> > Exceptions:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> > org.apache.hadoop.hbase.NotServingRegionException:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > TestTable,0001698618,1251172170797
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
> >        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
> >        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
> >        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >        at java.lang.reflect.Method.invoke(Method.java:597)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
> >        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
> >
> >
> >        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
> >        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
> >        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
> >        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
> >        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
> >        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
> >        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
> >        at org.apache.hadoop.mapred.Child.main(Child.java:170)
> >
> >
> >
> >
> >
> >
> > On Wed, Aug 19, 2009 at 3:39 AM, Schubert Zhang <zs...@gmail.com>
> wrote:
> >
> >> +1
> >>
> >> I have done our test, it is fine to release.
> >>
> >>   On Wed, Aug 19, 2009 at 1:13 AM, stack <st...@duboce.net> wrote:
> >>
> >>> Update your binaries.  Take down the cluster en masse and update all or
> do
> >>> it via a rolling restart:
> >>> http://wiki.apache.org/hadoop/Hbase/RollingRestart
> >>> .
> >>>
> >>> Regards whats been fixed since RC1, see http://su.pr/1QTH7L.
> >>>
> >>> St.Ack
> >>>
> >>> On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com>
> wrote:
> >>>
> >>> > Now I use candidate-1 version, To fix these bugs, how and what should
> I
> >>> do
> >>> > ?
> >>> >
> >>> > On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com>
> >>> wrote:
> >>> >
> >>> > > A few bugs were fixed, seemingly minor but critical.
> >>> > >
> >>> > > enjoy!
> >>> > > -ryan
> >>> > >
> >>> > > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com>
> >>> wrote:
> >>> > > > What is the difference between the two candidate version?
> >>> > > >
> >>> > > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
> >>> > > >
> >>> > > >> The second hbase 0.20.0 release candidate is available for
> >>> download:
> >>> > > >>
> >>> > > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<
> >>> http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/<http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
> <http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
>  >>> >
> >>>  > > >>
> >>> > > >> Near to 450 issues have been addressed since the 0.19 branch.
> >>>  Release
> >>> > > >> notes
> >>> > > >> are available here: http://su.pr/18zcEO <
> http://tinyurl.com/8xmyx9
> >>> >.
> >>> > > >>
> >>> > > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since
> 0.19.x
> >>> > > >> including
> >>> > > >> configuration fundamentals.  Be sure to read the 'Getting
> Started'
> >>> > > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
> >>> > > >>
> >>> > > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0,
> you
> >>> > will
> >>> > > >> need
> >>> > > >> to run a migration.  See
> >>> > > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> >>> > > >> First read the overview and then go to the section, 'From 0.19.x
> to
> >>> > > >> 0.20.x'.
> >>> > > >>
> >>> > > >> Should we release this candidate as hbase 0.20.0?  Please vote
> >>> +1/-1
> >>> > by
> >>> > > >> Wednesday, August 25th.
> >>> > > >>
> >>> > > >> Yours,
> >>> > > >> The HBasistas
> >>> > > >>
> >>> > > >
> >>> > >
> >>> >
> >>>
> >>
> >>
> >
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Ryan Rawson <ry...@gmail.com>.

Did you flush .META. table as well?

-ryan

On Mon, Aug 24, 2009 at 9:26 PM, Schubert Zhang<zs...@gmail.com> wrote:
> -1
>
> I tested reliability of RegionServer crash, and found following problem:
>
> Test:
> (1) A table, inserted millions of rows. the I use hbase shell commant to
> flush a memstores to disk, there are 25 regions.
> (2) Kill a RS (no ROOT and META region), then scan the whole table, success.
> (3) Kill another RS (with META region), then scan the whole table, fail.
> Maybe meta and data mismatch.
>    (strangely there are 28 regions now, why? and following is the err log!)
>
>
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.24.1.16:60020 for region
> TestTable,0001698618,1251172170797, row '0001698618', but failed after
> 10 attempts.
> Exceptions:
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
>
>        at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>        at org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>        at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>        at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.24.1.16:60020 for region
> TestTable,0001698618,1251172170797, row '0001698618', but failed after
> 10 attempts.
> Exceptions:
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
>
>        at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>        at org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>        at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>        at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.24.1.16:60020 for region
> TestTable,0001698618,1251172170797, row '0001698618', but failed after
> 10 attempts.
> Exceptions:
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
>
>        at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>        at org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>        at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>        at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>        at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
>
>
>
>
>
> On Wed, Aug 19, 2009 at 3:39 AM, Schubert Zhang <zs...@gmail.com> wrote:
>
>> +1
>>
>> I have done our test, it is fine to release.
>>
>>   On Wed, Aug 19, 2009 at 1:13 AM, stack <st...@duboce.net> wrote:
>>
>>> Update your binaries.  Take down the cluster en masse and update all or do
>>> it via a rolling restart:
>>> http://wiki.apache.org/hadoop/Hbase/RollingRestart
>>> .
>>>
>>> Regards whats been fixed since RC1, see http://su.pr/1QTH7L.
>>>
>>> St.Ack
>>>
>>> On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com> wrote:
>>>
>>> > Now I use candidate-1 version, To fix these bugs, how and what should I
>>> do
>>> > ?
>>> >
>>> > On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com>
>>> wrote:
>>> >
>>> > > A few bugs were fixed, seemingly minor but critical.
>>> > >
>>> > > enjoy!
>>> > > -ryan
>>> > >
>>> > > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com>
>>> wrote:
>>> > > > What is the difference between the two candidate version?
>>> > > >
>>> > > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
>>> > > >
>>> > > >> The second hbase 0.20.0 release candidate is available for
>>> download:
>>> > > >>
>>> > > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<
>>> http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/<http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
>>> >
>>>  > > >>
>>> > > >> Near to 450 issues have been addressed since the 0.19 branch.
>>>  Release
>>> > > >> notes
>>> > > >> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9
>>> >.
>>> > > >>
>>> > > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>>> > > >> including
>>> > > >> configuration fundamentals.  Be sure to read the 'Getting Started'
>>> > > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>> > > >>
>>> > > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you
>>> > will
>>> > > >> need
>>> > > >> to run a migration.  See
>>> > > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>>> > > >> First read the overview and then go to the section, 'From 0.19.x to
>>> > > >> 0.20.x'.
>>> > > >>
>>> > > >> Should we release this candidate as hbase 0.20.0?  Please vote
>>> +1/-1
>>> > by
>>> > > >> Wednesday, August 25th.
>>> > > >>
>>> > > >> Yours,
>>> > > >> The HBasistas
>>> > > >>
>>> > > >
>>> > >
>>> >
>>>
>>
>>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

Schubert:

Can I petition you change your vote?

The below seems like a serious issue that we need to fix.  My guess is that
its an issue that we've had a long while and that is probably present in
0.19.x only in a more dire way.  Would it be ok if we fixed the below in the
soon to follow 0.20.1 hbase?  0.20.0 has many bugs but it seems to basically
work for most folks, at least as well as 0.19.x.  It also has a ton of new
functionality that we'd like to get out into the world.  Its 7 months since
our last major release.  There are also a number of folks who won't/can't
touch the 0.20.x codebase until its been first released.

If you are amenable, change your vote up on the list and please file an
issue with the below detail.

Thanks Schubert,
St.Ack

On Mon, Aug 24, 2009 at 9:26 PM, Schubert Zhang <zs...@gmail.com> wrote:

> -1
>
> I tested reliability of RegionServer crash, and found following problem:
>
> Test:
> (1) A table, inserted millions of rows. the I use hbase shell commant to
> flush a memstores to disk, there are 25 regions.
> (2) Kill a RS (no ROOT and META region), then scan the whole table,
> success.
> (3) Kill another RS (with META region), then scan the whole table, fail.
> Maybe meta and data mismatch.
>    (strangely there are 28 regions now, why? and following is the err log!)
>
>
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.24.1.16:60020 for region
> TestTable,0001698618,1251172170797, row '0001698618', but failed after
> 10 attempts.
> Exceptions:
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
>
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.24.1.16:60020 for region
> TestTable,0001698618,1251172170797, row '0001698618', but failed after
> 10 attempts.
> Exceptions:
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
>
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
> contact region server 10.24.1.16:60020 for region
> TestTable,0001698618,1251172170797, row '0001698618', but failed after
> 10 attempts.
> Exceptions:
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
> org.apache.hadoop.hbase.NotServingRegionException:
> org.apache.hadoop.hbase.NotServingRegionException:
> TestTable,0001698618,1251172170797
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
>        at
> org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
>        at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
>        at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>        at java.lang.reflect.Method.invoke(Method.java:597)
>        at
> org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
>        at
> org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)
>
>
>        at
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
>        at
> org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
>        at
> org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
>        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
>        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
>        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
>        at org.apache.hadoop.mapred.Child.main(Child.java:170)
>
>
>
>
>
>
> On Wed, Aug 19, 2009 at 3:39 AM, Schubert Zhang <zs...@gmail.com> wrote:
>
> > +1
> >
> > I have done our test, it is fine to release.
> >
> >   On Wed, Aug 19, 2009 at 1:13 AM, stack <st...@duboce.net> wrote:
> >
> >> Update your binaries.  Take down the cluster en masse and update all or
> do
> >> it via a rolling restart:
> >> http://wiki.apache.org/hadoop/Hbase/RollingRestart
> >> .
> >>
> >> Regards whats been fixed since RC1, see http://su.pr/1QTH7L.
> >>
> >> St.Ack
> >>
> >> On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com>
> wrote:
> >>
> >> > Now I use candidate-1 version, To fix these bugs, how and what should
> I
> >> do
> >> > ?
> >> >
> >> > On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com>
> >> wrote:
> >> >
> >> > > A few bugs were fixed, seemingly minor but critical.
> >> > >
> >> > > enjoy!
> >> > > -ryan
> >> > >
> >> > > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com>
> >> wrote:
> >> > > > What is the difference between the two candidate version?
> >> > > >
> >> > > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
> >> > > >
> >> > > >> The second hbase 0.20.0 release candidate is available for
> >> download:
> >> > > >>
> >> > > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
> <
> >> http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/<
> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
> >
> >> >
> >>  > > >>
> >> > > >> Near to 450 issues have been addressed since the 0.19 branch.
> >>  Release
> >> > > >> notes
> >> > > >> are available here: http://su.pr/18zcEO <
> http://tinyurl.com/8xmyx9
> >> >.
> >> > > >>
> >> > > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since
> 0.19.x
> >> > > >> including
> >> > > >> configuration fundamentals.  Be sure to read the 'Getting
> Started'
> >> > > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
> >> > > >>
> >> > > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0,
> you
> >> > will
> >> > > >> need
> >> > > >> to run a migration.  See
> >> > > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> >> > > >> First read the overview and then go to the section, 'From 0.19.x
> to
> >> > > >> 0.20.x'.
> >> > > >>
> >> > > >> Should we release this candidate as hbase 0.20.0?  Please vote
> >> +1/-1
> >> > by
> >> > > >> Wednesday, August 25th.
> >> > > >>
> >> > > >> Yours,
> >> > > >> The HBasistas
> >> > > >>
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Schubert Zhang <zs...@gmail.com>.

-1

I tested reliability of RegionServer crash, and found following problem:

Test:
(1) A table, inserted millions of rows. the I use hbase shell commant to
flush a memstores to disk, there are 25 regions.
(2) Kill a RS (no ROOT and META region), then scan the whole table, success.
(3) Kill another RS (with META region), then scan the whole table, fail.
Maybe meta and data mismatch.
    (strangely there are 28 regions now, why? and following is the err log!)


org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
contact region server 10.24.1.16:60020 for region
TestTable,0001698618,1251172170797, row '0001698618', but failed after
10 attempts.
Exceptions:
org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)


	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
	at org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
	at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
	at org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
	at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
	at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)

org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
contact region server 10.24.1.16:60020 for region
TestTable,0001698618,1251172170797, row '0001698618', but failed after
10 attempts.
Exceptions:
org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)


	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
	at org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
	at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
	at org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
	at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
	at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)

org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to
contact region server 10.24.1.16:60020 for region
TestTable,0001698618,1251172170797, row '0001698618', but failed after
10 attempts.
Exceptions:
org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)

org.apache.hadoop.hbase.NotServingRegionException:
org.apache.hadoop.hbase.NotServingRegionException:
TestTable,0001698618,1251172170797
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion(HRegionServer.java:2261)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openScanner(HRegionServer.java:1877)
	at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:650)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:915)


	at org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937)
	at org.apache.hadoop.hbase.client.HTable$ClientScanner.nextScanner(HTable.java:1878)
	at org.apache.hadoop.hbase.client.HTable$ClientScanner.next(HTable.java:1984)
	at org.apache.hadoop.hbase.PerformanceEvaluation$ScanTest.testRow(PerformanceEvaluation.java:716)
	at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:588)
	at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:815)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:369)
	at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:345)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:518)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:303)
	at org.apache.hadoop.mapred.Child.main(Child.java:170)






On Wed, Aug 19, 2009 at 3:39 AM, Schubert Zhang <zs...@gmail.com> wrote:

> +1
>
> I have done our test, it is fine to release.
>
>   On Wed, Aug 19, 2009 at 1:13 AM, stack <st...@duboce.net> wrote:
>
>> Update your binaries.  Take down the cluster en masse and update all or do
>> it via a rolling restart:
>> http://wiki.apache.org/hadoop/Hbase/RollingRestart
>> .
>>
>> Regards whats been fixed since RC1, see http://su.pr/1QTH7L.
>>
>> St.Ack
>>
>> On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com> wrote:
>>
>> > Now I use candidate-1 version, To fix these bugs, how and what should I
>> do
>> > ?
>> >
>> > On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com>
>> wrote:
>> >
>> > > A few bugs were fixed, seemingly minor but critical.
>> > >
>> > > enjoy!
>> > > -ryan
>> > >
>> > > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com>
>> wrote:
>> > > > What is the difference between the two candidate version?
>> > > >
>> > > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
>> > > >
>> > > >> The second hbase 0.20.0 release candidate is available for
>> download:
>> > > >>
>> > > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<
>> http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/<http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
>> >
>>  > > >>
>> > > >> Near to 450 issues have been addressed since the 0.19 branch.
>>  Release
>> > > >> notes
>> > > >> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9
>> >.
>> > > >>
>> > > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>> > > >> including
>> > > >> configuration fundamentals.  Be sure to read the 'Getting Started'
>> > > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>> > > >>
>> > > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you
>> > will
>> > > >> need
>> > > >> to run a migration.  See
>> > > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>> > > >> First read the overview and then go to the section, 'From 0.19.x to
>> > > >> 0.20.x'.
>> > > >>
>> > > >> Should we release this candidate as hbase 0.20.0?  Please vote
>> +1/-1
>> > by
>> > > >> Wednesday, August 25th.
>> > > >>
>> > > >> Yours,
>> > > >> The HBasistas
>> > > >>
>> > > >
>> > >
>> >
>>
>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Schubert Zhang <zs...@gmail.com>.

+1

I have done our test, it is fine to release.

On Wed, Aug 19, 2009 at 1:13 AM, stack <st...@duboce.net> wrote:

> Update your binaries.  Take down the cluster en masse and update all or do
> it via a rolling restart:
> http://wiki.apache.org/hadoop/Hbase/RollingRestart
> .
>
> Regards whats been fixed since RC1, see http://su.pr/1QTH7L.
>
> St.Ack
>
> On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com> wrote:
>
> > Now I use candidate-1 version, To fix these bugs, how and what should I
> do
> > ?
> >
> > On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com> wrote:
> >
> > > A few bugs were fixed, seemingly minor but critical.
> > >
> > > enjoy!
> > > -ryan
> > >
> > > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com>
> wrote:
> > > > What is the difference between the two candidate version?
> > > >
> > > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
> > > >
> > > >> The second hbase 0.20.0 release candidate is available for download:
> > > >>
> > > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<
> http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/<http://people.apache.org/~stack/hbase-0.20.0-candidate-2/>
> >
>  > > >>
> > > >> Near to 450 issues have been addressed since the 0.19 branch.
>  Release
> > > >> notes
> > > >> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9
> >.
> > > >>
> > > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
> > > >> including
> > > >> configuration fundamentals.  Be sure to read the 'Getting Started'
> > > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
> > > >>
> > > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you
> > will
> > > >> need
> > > >> to run a migration.  See
> > > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> > > >> First read the overview and then go to the section, 'From 0.19.x to
> > > >> 0.20.x'.
> > > >>
> > > >> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1
> > by
> > > >> Wednesday, August 25th.
> > > >>
> > > >> Yours,
> > > >> The HBasistas
> > > >>
> > > >
> > >
> >
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

Update your binaries.  Take down the cluster en masse and update all or do
it via a rolling restart: http://wiki.apache.org/hadoop/Hbase/RollingRestart
.

Regards whats been fixed since RC1, see http://su.pr/1QTH7L.

St.Ack

On Tue, Aug 18, 2009 at 12:04 AM, Rocks <nu...@gmail.com> wrote:

> Now I use candidate-1 version, To fix these bugs, how and what should I do
> ?
>
> On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com> wrote:
>
> > A few bugs were fixed, seemingly minor but critical.
> >
> > enjoy!
> > -ryan
> >
> > On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com> wrote:
> > > What is the difference between the two candidate version?
> > >
> > > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
> > >
> > >> The second hbase 0.20.0 release candidate is available for download:
> > >>
> > >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
> > >>
> > >> Near to 450 issues have been addressed since the 0.19 branch.  Release
> > >> notes
> > >> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
> > >>
> > >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
> > >> including
> > >> configuration fundamentals.  Be sure to read the 'Getting Started'
> > >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
> > >>
> > >> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you
> will
> > >> need
> > >> to run a migration.  See
> > http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> > >> First read the overview and then go to the section, 'From 0.19.x to
> > >> 0.20.x'.
> > >>
> > >> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1
> by
> > >> Wednesday, August 25th.
> > >>
> > >> Yours,
> > >> The HBasistas
> > >>
> > >
> >
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Rocks <nu...@gmail.com>.

Now I use candidate-1 version, To fix these bugs, how and what should I do ?

On Tue, Aug 18, 2009 at 2:20 PM, Ryan Rawson <ry...@gmail.com> wrote:

> A few bugs were fixed, seemingly minor but critical.
>
> enjoy!
> -ryan
>
> On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com> wrote:
> > What is the difference between the two candidate version?
> >
> > On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
> >
> >> The second hbase 0.20.0 release candidate is available for download:
> >>
> >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
> >>
> >> Near to 450 issues have been addressed since the 0.19 branch.  Release
> >> notes
> >> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
> >>
> >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
> >> including
> >> configuration fundamentals.  Be sure to read the 'Getting Started'
> >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
> >>
> >> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
> >> need
> >> to run a migration.  See
> http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> >> First read the overview and then go to the section, 'From 0.19.x to
> >> 0.20.x'.
> >>
> >> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
> >> Wednesday, August 25th.
> >>
> >> Yours,
> >> The HBasistas
> >>
> >
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Ryan Rawson <ry...@gmail.com>.

A few bugs were fixed, seemingly minor but critical.

enjoy!
-ryan

On Mon, Aug 17, 2009 at 11:16 PM, Rocks<nu...@gmail.com> wrote:
> What is the difference between the two candidate version?
>
> On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:
>
>> The second hbase 0.20.0 release candidate is available for download:
>>
>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>>
>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>> notes
>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>
>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>> including
>> configuration fundamentals.  Be sure to read the 'Getting Started'
>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>
>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>> need
>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>> First read the overview and then go to the section, 'From 0.19.x to
>> 0.20.x'.
>>
>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>> Wednesday, August 25th.
>>
>> Yours,
>> The HBasistas
>>
>

Re: Public HBase data store?

Posted by Jonathan Gray <jl...@streamy.com>.

Tim,

We do things like that.  Both out of search indexes as well as to 
perform simple "joins" where one table might have an ordered list of ids 
in a family together, we grab a "page", and then perform a join by 
grabbing a set of columns from a different table, one row per id.

Yes joins can be a dirty word but in the cases where we do simple joins 
like this, the data is duplicated so many times that denormalization is 
not feasible.  And in your case, actually storing the data fields in 
Lucene is extremely expensive, so it can certainly make sense.

One thing... If you are going to have a number of "get by key" calls for 
a single query/page, running them in parallel can significantly improve 
total time.  This is especially the case if the keys you need to query 
for are well dispersed across the table (so you can hit multiple 
regionservers).

JG

tim robertson wrote:
> Hi Ryan,
> 
> What kind of random row lookup throughput do you get (e.g. rows per
> second) on the 10b store on the 20 machine cluster (assuming client
> isn't saturating)?
> 
> I'm pondering indexing hbase rows in various ways with Lucene with
> only the row key stored.  Then page over search results and stream out
> response (transforming to preferred response format on the fly - RDF,
> CSV, XML etc) by doing sequential "get by key" calls.  Maybe stupid
> idea, but not sure what else can index so well.
> 
> I'm just curious...
> 
> Thanks,
> Tim
> 
> 
> 
> 
> On Tue, Aug 18, 2009 at 10:07 PM, Ryan Rawson<ry...@gmail.com> wrote:
>> I run real machines, they aren't too expensive and are substantially
>> more performant than the virtualized servers EC2 offers. I have 10b
>> rows loaded on 20 machines, but you could probably do that on 10 or
>> so. Don't forget that 10b rows would require a $40000 machine to use
>> on mysql, so why not spend $40000 on a cluster?
>>
>> On Tue, Aug 18, 2009 at 12:20 PM, Jonathan Gray<jl...@streamy.com> wrote:
>>> I have a little util I created called HBench.  You can customize the
>>> different parameters to generate data of varying sizes/patterns/etc.
>>>
>>> https://issues.apache.org/jira/browse/HBASE-1501
>>>
>>> JG
>>>
>>> Andrew Purtell wrote:
>>>> Most that I am aware of set up transient test environments up on EC2.
>>>>
>>>> You can use one instance to create an EBS volume containing all software
>>>> and config you need, then snapshot it, then clone volumes based on the
>>>> snapshot to attach to any number of instances you need. Use X-Large
>>>> instances, at least 4. Give HBase regionservers 2GB heap. Then try your
>>>> 10 billion row test case.
>>>>
>>>>   - Andy
>>>>
>>>>
>>>>
>>>>
>>>> ________________________________
>>>> From: Greg Cottman <gr...@quest.com>
>>>> To: "hbase-user@hadoop.apache.org" <hb...@hadoop.apache.org>
>>>> Sent: Tuesday, August 18, 2009 4:13:23 PM
>>>> Subject: Public HBase data store?
>>>>
>>>> Hi all,
>>>>
>>>> I need to do some scalability testing of an HBase query tool.  We have
>>>> just started using HBase and sadly do not have an existing database against
>>>> which to test.  Things we are interested in exploring is the difference
>>>> between using an index table strategy versus map/reduce queries without
>>>> indexes.
>>>>
>>>> I realise this is a long shot and that queries are very data-dependent,
>>>> but...  Are there any publicly accessible HBase stores or reference sites
>>>> against which you can run test queries?
>>>>
>>>> Or does everyone just create a 10 billion row test environment on their
>>>> local development box?  :-)
>>>>
>>>> Cheers,
>>>> Greg.
>>>>
>>>>
>>>>
>>>>
>

Re: Public HBase data store?

Posted by tim robertson <ti...@gmail.com>.

Hi Ryan,

What kind of random row lookup throughput do you get (e.g. rows per
second) on the 10b store on the 20 machine cluster (assuming client
isn't saturating)?

I'm pondering indexing hbase rows in various ways with Lucene with
only the row key stored.  Then page over search results and stream out
response (transforming to preferred response format on the fly - RDF,
CSV, XML etc) by doing sequential "get by key" calls.  Maybe stupid
idea, but not sure what else can index so well.

I'm just curious...

Thanks,
Tim




On Tue, Aug 18, 2009 at 10:07 PM, Ryan Rawson<ry...@gmail.com> wrote:
> I run real machines, they aren't too expensive and are substantially
> more performant than the virtualized servers EC2 offers. I have 10b
> rows loaded on 20 machines, but you could probably do that on 10 or
> so. Don't forget that 10b rows would require a $40000 machine to use
> on mysql, so why not spend $40000 on a cluster?
>
> On Tue, Aug 18, 2009 at 12:20 PM, Jonathan Gray<jl...@streamy.com> wrote:
>> I have a little util I created called HBench.  You can customize the
>> different parameters to generate data of varying sizes/patterns/etc.
>>
>> https://issues.apache.org/jira/browse/HBASE-1501
>>
>> JG
>>
>> Andrew Purtell wrote:
>>>
>>> Most that I am aware of set up transient test environments up on EC2.
>>>
>>> You can use one instance to create an EBS volume containing all software
>>> and config you need, then snapshot it, then clone volumes based on the
>>> snapshot to attach to any number of instances you need. Use X-Large
>>> instances, at least 4. Give HBase regionservers 2GB heap. Then try your
>>> 10 billion row test case.
>>>
>>>   - Andy
>>>
>>>
>>>
>>>
>>> ________________________________
>>> From: Greg Cottman <gr...@quest.com>
>>> To: "hbase-user@hadoop.apache.org" <hb...@hadoop.apache.org>
>>> Sent: Tuesday, August 18, 2009 4:13:23 PM
>>> Subject: Public HBase data store?
>>>
>>> Hi all,
>>>
>>> I need to do some scalability testing of an HBase query tool.  We have
>>> just started using HBase and sadly do not have an existing database against
>>> which to test.  Things we are interested in exploring is the difference
>>> between using an index table strategy versus map/reduce queries without
>>> indexes.
>>>
>>> I realise this is a long shot and that queries are very data-dependent,
>>> but...  Are there any publicly accessible HBase stores or reference sites
>>> against which you can run test queries?
>>>
>>> Or does everyone just create a 10 billion row test environment on their
>>> local development box?  :-)
>>>
>>> Cheers,
>>> Greg.
>>>
>>>
>>>
>>>
>>
>

Re: Public HBase data store?

Posted by Ryan Rawson <ry...@gmail.com>.

I run real machines, they aren't too expensive and are substantially
more performant than the virtualized servers EC2 offers. I have 10b
rows loaded on 20 machines, but you could probably do that on 10 or
so. Don't forget that 10b rows would require a $40000 machine to use
on mysql, so why not spend $40000 on a cluster?

On Tue, Aug 18, 2009 at 12:20 PM, Jonathan Gray<jl...@streamy.com> wrote:
> I have a little util I created called HBench.  You can customize the
> different parameters to generate data of varying sizes/patterns/etc.
>
> https://issues.apache.org/jira/browse/HBASE-1501
>
> JG
>
> Andrew Purtell wrote:
>>
>> Most that I am aware of set up transient test environments up on EC2.
>>
>> You can use one instance to create an EBS volume containing all software
>> and config you need, then snapshot it, then clone volumes based on the
>> snapshot to attach to any number of instances you need. Use X-Large
>> instances, at least 4. Give HBase regionservers 2GB heap. Then try your
>> 10 billion row test case.
>>
>>   - Andy
>>
>>
>>
>>
>> ________________________________
>> From: Greg Cottman <gr...@quest.com>
>> To: "hbase-user@hadoop.apache.org" <hb...@hadoop.apache.org>
>> Sent: Tuesday, August 18, 2009 4:13:23 PM
>> Subject: Public HBase data store?
>>
>> Hi all,
>>
>> I need to do some scalability testing of an HBase query tool.  We have
>> just started using HBase and sadly do not have an existing database against
>> which to test.  Things we are interested in exploring is the difference
>> between using an index table strategy versus map/reduce queries without
>> indexes.
>>
>> I realise this is a long shot and that queries are very data-dependent,
>> but...  Are there any publicly accessible HBase stores or reference sites
>> against which you can run test queries?
>>
>> Or does everyone just create a 10 billion row test environment on their
>> local development box?  :-)
>>
>> Cheers,
>> Greg.
>>
>>
>>
>>
>

Re: Public HBase data store?

Posted by Jonathan Gray <jl...@streamy.com>.

I have a little util I created called HBench.  You can customize the 
different parameters to generate data of varying sizes/patterns/etc.

https://issues.apache.org/jira/browse/HBASE-1501

JG

Andrew Purtell wrote:
> Most that I am aware of set up transient test environments up on EC2.
> 
> You can use one instance to create an EBS volume containing all software
> and config you need, then snapshot it, then clone volumes based on the
> snapshot to attach to any number of instances you need. Use X-Large 
> instances, at least 4. Give HBase regionservers 2GB heap. Then try your
> 10 billion row test case.
> 
>    - Andy
> 
> 
> 
> 
> ________________________________
> From: Greg Cottman <gr...@quest.com>
> To: "hbase-user@hadoop.apache.org" <hb...@hadoop.apache.org>
> Sent: Tuesday, August 18, 2009 4:13:23 PM
> Subject: Public HBase data store?
> 
> Hi all,
> 
> I need to do some scalability testing of an HBase query tool.  We have just started using HBase and sadly do not have an existing database against which to test.  Things we are interested in exploring is the difference between using an index table strategy versus map/reduce queries without indexes.
> 
> I realise this is a long shot and that queries are very data-dependent, but...  Are there any publicly accessible HBase stores or reference sites against which you can run test queries?
> 
> Or does everyone just create a 10 billion row test environment on their local development box?  :-)
> 
> Cheers,
> Greg.
> 
> 
> 
>

Re: Public HBase data store?

Posted by Andrew Purtell <ap...@apache.org>.

Most that I am aware of set up transient test environments up on EC2.

You can use one instance to create an EBS volume containing all software
and config you need, then snapshot it, then clone volumes based on the
snapshot to attach to any number of instances you need. Use X-Large 
instances, at least 4. Give HBase regionservers 2GB heap. Then try your
10 billion row test case.

   - Andy




________________________________
From: Greg Cottman <gr...@quest.com>
To: "hbase-user@hadoop.apache.org" <hb...@hadoop.apache.org>
Sent: Tuesday, August 18, 2009 4:13:23 PM
Subject: Public HBase data store?

Hi all,

I need to do some scalability testing of an HBase query tool.  We have just started using HBase and sadly do not have an existing database against which to test.  Things we are interested in exploring is the difference between using an index table strategy versus map/reduce queries without indexes.

I realise this is a long shot and that queries are very data-dependent, but...  Are there any publicly accessible HBase stores or reference sites against which you can run test queries?

Or does everyone just create a 10 billion row test environment on their local development box?  :-)

Cheers,
Greg.

Public HBase data store?

Posted by Greg Cottman <gr...@quest.com>.

Hi all,

I need to do some scalability testing of an HBase query tool.  We have just started using HBase and sadly do not have an existing database against which to test.  Things we are interested in exploring is the difference between using an index table strategy versus map/reduce queries without indexes.

I realise this is a long shot and that queries are very data-dependent, but...  Are there any publicly accessible HBase stores or reference sites against which you can run test queries?

Or does everyone just create a 10 billion row test environment on their local development box?  :-)

Cheers,
Greg.

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Rocks <nu...@gmail.com>.

What is the difference between the two candidate version?

On Tue, Aug 18, 2009 at 1:52 PM, stack <st...@duboce.net> wrote:

> The second hbase 0.20.0 release candidate is available for download:
>
> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>
> Near to 450 issues have been addressed since the 0.19 branch.  Release
> notes
> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>
> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
> including
> configuration fundamentals.  Be sure to read the 'Getting Started'
> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>
> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
> need
> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> First read the overview and then go to the section, 'From 0.19.x to
> 0.20.x'.
>
> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
> Wednesday, August 25th.
>
> Yours,
> The HBasistas
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by Andrew Purtell <ap...@apache.org>.

Oh for fucks sake that was my fault. Sorry. I'll never complain again when/if someone else does that.


   - Andy




________________________________
From: Jean-Daniel Cryans <jd...@apache.org>
To: hbase-dev@hadoop.apache.org
Sent: Tuesday, August 18, 2009 11:56:02 PM
Subject: Re: hbase 0.20.0 Release Candidate 2 available for download

It seems HBASE-1758 commit is missing HTableInterface.

J-D

On Tue, Aug 18, 2009 at 11:43 AM, Billy
Pearson<bi...@sbcglobal.net> wrote:
>
>
> are you guys aware that trunk will not build?
>
>   [javac] Note: Some input files use or override a deprecated API.
>   [javac] Note: Recompile with -Xlint:deprecation for details.
>   [javac] Note: Some input files use unchecked or unsafe operations.
>   [javac] Note: Recompile with -Xlint:unchecked for details.
>   [javac] 14 errors
>
> Billy
>
>
>
> ----- Original Message ----- From: "stack"
> <st...@public.gmane.org>
> Newsgroups:
> gmane.comp.java.hadoop.hbase.devel,gmane.comp.java.hadoop.hbase.user
> To: <hb...@public.gmane.org>;
> <hb...@public.gmane.org>
> Sent: Tuesday, August 18, 2009 12:52 AM
> Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download
>
>
>> The second hbase 0.20.0 release candidate is available for download:
>>
>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>>
>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>> notes
>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>
>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>> including
>> configuration fundamentals.  Be sure to read the 'Getting Started'
>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>
>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>> need
>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>> First read the overview and then go to the section, 'From 0.19.x to
>> 0.20.x'.
>>
>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>> Wednesday, August 25th.
>>
>> Yours,
>> The HBasistas
>>
>
>
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

I added the missing files to TRUNK.  Try now Billy.
St.Ack

On Tue, Aug 18, 2009 at 8:56 AM, Jean-Daniel Cryans <jd...@apache.org>wrote:

> It seems HBASE-1758 commit is missing HTableInterface.
>
> J-D
>
> On Tue, Aug 18, 2009 at 11:43 AM, Billy
> Pearson<bi...@sbcglobal.net> wrote:
> >
> >
> > are you guys aware that trunk will not build?
> >
> >   [javac] Note: Some input files use or override a deprecated API.
> >   [javac] Note: Recompile with -Xlint:deprecation for details.
> >   [javac] Note: Some input files use unchecked or unsafe operations.
> >   [javac] Note: Recompile with -Xlint:unchecked for details.
> >   [javac] 14 errors
> >
> > Billy
> >
> >
> >
> > ----- Original Message ----- From: "stack"
> > <st...@public.gmane.org>
> >
> > Newsgroups:
> > gmane.comp.java.hadoop.hbase.devel,gmane.comp.java.hadoop.hbase.user
> > To: <hb...@public.gmane.org>;
> > <hb...@public.gmane.org>
> > Sent: Tuesday, August 18, 2009 12:52 AM
> > Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download
> >
> >
> >> The second hbase 0.20.0 release candidate is available for download:
> >>
> >> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
> >>
> >> Near to 450 issues have been addressed since the 0.19 branch.  Release
> >> notes
> >> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
> >>
> >> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
> >> including
> >> configuration fundamentals.  Be sure to read the 'Getting Started'
> >> documentation in 0.20.0 available here: http://su.pr/8YQjHO
> >>
> >> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
> >> need
> >> to run a migration.  See
> http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> >> First read the overview and then go to the section, 'From 0.19.x to
> >> 0.20.x'.
> >>
> >> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
> >> Wednesday, August 25th.
> >>
> >> Yours,
> >> The HBasistas
> >>
> >
> >
> >
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by Jean-Daniel Cryans <jd...@apache.org>.

It seems HBASE-1758 commit is missing HTableInterface.

J-D

On Tue, Aug 18, 2009 at 11:43 AM, Billy
Pearson<bi...@sbcglobal.net> wrote:
>
>
> are you guys aware that trunk will not build?
>
>   [javac] Note: Some input files use or override a deprecated API.
>   [javac] Note: Recompile with -Xlint:deprecation for details.
>   [javac] Note: Some input files use unchecked or unsafe operations.
>   [javac] Note: Recompile with -Xlint:unchecked for details.
>   [javac] 14 errors
>
> Billy
>
>
>
> ----- Original Message ----- From: "stack"
> <st...@public.gmane.org>
> Newsgroups:
> gmane.comp.java.hadoop.hbase.devel,gmane.comp.java.hadoop.hbase.user
> To: <hb...@public.gmane.org>;
> <hb...@public.gmane.org>
> Sent: Tuesday, August 18, 2009 12:52 AM
> Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download
>
>
>> The second hbase 0.20.0 release candidate is available for download:
>>
>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>>
>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>> notes
>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>
>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>> including
>> configuration fundamentals.  Be sure to read the 'Getting Started'
>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>
>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>> need
>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>> First read the overview and then go to the section, 'From 0.19.x to
>> 0.20.x'.
>>
>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>> Wednesday, August 25th.
>>
>> Yours,
>> The HBasistas
>>
>
>
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by Billy Pearson <bi...@sbcglobal.net>.


are you guys aware that trunk will not build?

    [javac] Note: Some input files use or override a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] Note: Some input files use unchecked or unsafe operations.
    [javac] Note: Recompile with -Xlint:unchecked for details.
    [javac] 14 errors

Billy



----- Original Message ----- 
From: "stack" <st...@public.gmane.org>
Newsgroups: 
gmane.comp.java.hadoop.hbase.devel,gmane.comp.java.hadoop.hbase.user
To: <hb...@public.gmane.org>; 
<hb...@public.gmane.org>
Sent: Tuesday, August 18, 2009 12:52 AM
Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download


> The second hbase 0.20.0 release candidate is available for download:
>
> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>
> Near to 450 issues have been addressed since the 0.19 branch.  Release 
> notes
> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>
> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x 
> including
> configuration fundamentals.  Be sure to read the 'Getting Started'
> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>
> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will 
> need
> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> First read the overview and then go to the section, 'From 0.19.x to 
> 0.20.x'.
>
> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
> Wednesday, August 25th.
>
> Yours,
> The HBasistas
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by Billy Pearson <bi...@sbcglobal.net>.


Will file in 0.20.1 once I finish debugging the problem looks like its the 
column not the key causing the problem

Billy

----- Original Message ----- 
From: "stack" <st...@public.gmane.org>
Newsgroups: 
gmane.comp.java.hadoop.hbase.devel,gmane.comp.java.hadoop.hbase.user
To: <hb...@public.gmane.org>
Cc: <hb...@public.gmane.org>
Sent: Tuesday, August 18, 2009 1:46 PM
Subject: Re: hbase 0.20.0 Release Candidate 2 available for download


> Please file a bug Billy.
>
> IMO this is not a critical issue since its easy enough making a 
> workaround.
>
> Thanks,
> St.Ack
>
> On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
> <sa...@public.gmane.org>wrote:
>
>> testing RC2
>>
>> found
>> 2009-08-18 12:54:16,572 FATAL
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
>> required. Forcing server shutdown
>> org.apache.hadoop.hbase.DroppedSnapshotException: region:
>> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
>> Caused by: java.io.IOException: Key length 183108 > 65536
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
>>       ... 3 more
>>
>>
>> looks like from a mr job we allow keys larger then 65536 to be processed
>> but when the memcache flush happends we kill the server should the client
>> not fail before the long key gets in to memory?
>>
>> Billy
>>
>>
>>
>> "stack" <st...@public.gmane.org> wrote in message
>> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32-JsoAwUIsXouq+1Nelnf3ueG/Ez6ZCGd0@public.gmane.org
>>
>>> The second hbase 0.20.0 release candidate is available for download:
>>>
>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>>
>>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>>> notes
>>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>>
>>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>>> including
>>> configuration fundamentals.  Be sure to read the 'Getting Started'
>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>>
>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>>> need
>>> to run a migration.  See 
>>> http://wiki.apache.org/hadoop/Hbase/HowToMigrate
>>> .
>>> First read the overview and then go to the section, 'From 0.19.x to
>>> 0.20.x'.
>>>
>>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>>> Wednesday, August 25th.
>>>
>>> Yours,
>>> The HBasistas
>>>
>>>
>>
>>
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

Thats a good one Billy.  IMO, we can wait till 0.20.1 for a fix.
St.Ack

On Tue, Aug 18, 2009 at 12:12 PM, Billy Pearson
<sa...@pearsonwholesale.com>wrote:

> take a look at
> HBASE-1777
> not sure but It might need to be addressed in 0.20.0
>
> This cause my whole cluster to go down because each server reloads the bad
> column from hlog replays and the next server goes down on the next memstore
> flush for that region.
>
> Billy
>
>
>
>
> "stack" <st...@duboce.net> wrote in message
> news:7c962aed0908181146q28a9a788la3fe8c3756fbe6c@mail.gmail.com...
>
>> Please file a bug Billy.
>>
>> IMO this is not a critical issue since its easy enough making a
>> workaround.
>>
>> Thanks,
>> St.Ack
>>
>> On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
>> <sa...@pearsonwholesale.com>wrote:
>>
>>  testing RC2
>>>
>>> found
>>> 2009-08-18 12:54:16,572 FATAL
>>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
>>> required. Forcing server shutdown
>>> org.apache.hadoop.hbase.DroppedSnapshotException: region:
>>> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
>>>      at
>>>
>>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
>>>      at
>>> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
>>>      at
>>>
>>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
>>>      at
>>>
>>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
>>> Caused by: java.io.IOException: Key length 183108 > 65536
>>>      at
>>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
>>>      at
>>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
>>>      at
>>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
>>>      at
>>>
>>> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
>>>      at
>>> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
>>>      at
>>>
>>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
>>>      ... 3 more
>>>
>>>
>>> looks like from a mr job we allow keys larger then 65536 to be processed
>>> but when the memcache flush happends we kill the server should the client
>>> not fail before the long key gets in to memory?
>>>
>>> Billy
>>>
>>>
>>>
>>> "stack" <st...@duboce.net> wrote in message
>>> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com...
>>>
>>>  The second hbase 0.20.0 release candidate is available for download:
>>>>
>>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>>> <http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>>>
>>>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>>>> notes
>>>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>>>
>>>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>>>> including
>>>> configuration fundamentals.  Be sure to read the 'Getting Started'
>>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>>>
>>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>>>> need
>>>> to run a migration.  See
>>>> http://wiki.apache.org/hadoop/Hbase/HowToMigrate
>>>> .
>>>> First read the overview and then go to the section, 'From 0.19.x to
>>>> 0.20.x'.
>>>>
>>>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>>>> Wednesday, August 25th.
>>>>
>>>> Yours,
>>>> The HBasistas
>>>>
>>>>
>>>>
>>>
>>>
>>
>
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by Billy Pearson <sa...@pearsonwholesale.com>.

take a look at
HBASE-1777
not sure but It might need to be addressed in 0.20.0

This cause my whole cluster to go down because each server reloads the bad 
column from hlog replays and the next server goes down on the next memstore 
flush for that region.

Billy




"stack" <st...@duboce.net> wrote in message 
news:7c962aed0908181146q28a9a788la3fe8c3756fbe6c@mail.gmail.com...
> Please file a bug Billy.
>
> IMO this is not a critical issue since its easy enough making a 
> workaround.
>
> Thanks,
> St.Ack
>
> On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
> <sa...@pearsonwholesale.com>wrote:
>
>> testing RC2
>>
>> found
>> 2009-08-18 12:54:16,572 FATAL
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
>> required. Forcing server shutdown
>> org.apache.hadoop.hbase.DroppedSnapshotException: region:
>> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
>>       at
>> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
>> Caused by: java.io.IOException: Key length 183108 > 65536
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
>>       at
>> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
>>       at
>> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
>>       at
>> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
>>       ... 3 more
>>
>>
>> looks like from a mr job we allow keys larger then 65536 to be processed
>> but when the memcache flush happends we kill the server should the client
>> not fail before the long key gets in to memory?
>>
>> Billy
>>
>>
>>
>> "stack" <st...@duboce.net> wrote in message
>> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com...
>>
>>> The second hbase 0.20.0 release candidate is available for download:
>>>
>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>>
>>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>>> notes
>>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>>
>>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>>> including
>>> configuration fundamentals.  Be sure to read the 'Getting Started'
>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>>
>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>>> need
>>> to run a migration.  See 
>>> http://wiki.apache.org/hadoop/Hbase/HowToMigrate
>>> .
>>> First read the overview and then go to the section, 'From 0.19.x to
>>> 0.20.x'.
>>>
>>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>>> Wednesday, August 25th.
>>>
>>> Yours,
>>> The HBasistas
>>>
>>>
>>
>>
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

Please file a bug Billy.

IMO this is not a critical issue since its easy enough making a workaround.

Thanks,
St.Ack

On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
<sa...@pearsonwholesale.com>wrote:

> testing RC2
>
> found
> 2009-08-18 12:54:16,572 FATAL
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
> required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
>       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
>       at
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
>       at
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
>       at
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
> Caused by: java.io.IOException: Key length 183108 > 65536
>       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
>       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
>       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
>       at
> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
>       at
> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
>       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
>       ... 3 more
>
>
> looks like from a mr job we allow keys larger then 65536 to be processed
> but when the memcache flush happends we kill the server should the client
> not fail before the long key gets in to memory?
>
> Billy
>
>
>
> "stack" <st...@duboce.net> wrote in message
> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com...
>
>> The second hbase 0.20.0 release candidate is available for download:
>>
>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>
>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>> notes
>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>
>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>> including
>> configuration fundamentals.  Be sure to read the 'Getting Started'
>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>
>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>> need
>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate
>> .
>> First read the overview and then go to the section, 'From 0.19.x to
>> 0.20.x'.
>>
>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>> Wednesday, August 25th.
>>
>> Yours,
>> The HBasistas
>>
>>
>
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

Please file a bug Billy.

IMO this is not a critical issue since its easy enough making a workaround.

Thanks,
St.Ack

On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
<sa...@pearsonwholesale.com>wrote:

> testing RC2
>
> found
> 2009-08-18 12:54:16,572 FATAL
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
> required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
>       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
>       at
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
>       at
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
>       at
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
> Caused by: java.io.IOException: Key length 183108 > 65536
>       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
>       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
>       at
> org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
>       at
> org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
>       at
> org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
>       at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
>       ... 3 more
>
>
> looks like from a mr job we allow keys larger then 65536 to be processed
> but when the memcache flush happends we kill the server should the client
> not fail before the long key gets in to memory?
>
> Billy
>
>
>
> "stack" <st...@duboce.net> wrote in message
> news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com...
>
>> The second hbase 0.20.0 release candidate is available for download:
>>
>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
>>
>> Near to 450 issues have been addressed since the 0.19 branch.  Release
>> notes
>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>
>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x
>> including
>> configuration fundamentals.  Be sure to read the 'Getting Started'
>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>
>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
>> need
>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate
>> .
>> First read the overview and then go to the section, 'From 0.19.x to
>> 0.20.x'.
>>
>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>> Wednesday, August 25th.
>>
>> Yours,
>> The HBasistas
>>
>>
>
>

Re: hbase 0.20.0 Release Candidate 2 available for download

Posted by Billy Pearson <sa...@pearsonwholesale.com>.

testing RC2

found
2009-08-18 12:54:16,572 FATAL 
org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog 
required. Forcing server shutdown
org.apache.hadoop.hbase.DroppedSnapshotException: region: 
webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
        at 
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
        at 
org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
        at 
org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
        at 
org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
Caused by: java.io.IOException: Key length 183108 > 65536
        at 
org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
        at 
org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
        at 
org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
        at 
org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
        at 
org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
        at 
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
        ... 3 more


looks like from a mr job we allow keys larger then 65536 to be processed but 
when the memcache flush happends we kill the server should the client not 
fail before the long key gets in to memory?

Billy



"stack" <st...@duboce.net> wrote in message 
news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32@mail.gmail.com...
> The second hbase 0.20.0 release candidate is available for download:
>
> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>
> Near to 450 issues have been addressed since the 0.19 branch.  Release 
> notes
> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>
> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x 
> including
> configuration fundamentals.  Be sure to read the 'Getting Started'
> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>
> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will 
> need
> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> First read the overview and then go to the section, 'From 0.19.x to 
> 0.20.x'.
>
> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
> Wednesday, August 25th.
>
> Yours,
> The HBasistas
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

Just to say that RC3 is taking a little while waiting on fixes for two
issues: http://su.pr/22vilt
Yours,
St.Ack

On Thu, Aug 27, 2009 at 9:42 AM, stack <st...@duboce.net> wrote:

> Fair enough.
>
> Lets try and do a fast turnaround on RC3.  There are two issues outstanding
> after jdcryans fixes for regressions and the jgray fix for balancer, as I
> see it.  I've marked them as 0.20.0 (you are on one of them):
> http://su.pr/22vilt.
>
> If there are others, speak up folks.
>
> Hopefully new RC3 by morning.
>
> St.Ack
>
>
>
>
> On Thu, Aug 27, 2009 at 12:24 AM, Andrew Purtell <ap...@apache.org>wrote:
>
>> I understand your reasoning Stack. However, this project is gathering a
>> lot of interest and is being considered in several (many?) places. Some
>> noobs will find bugs (???) and make embarrassing and very public keynotes at
>> some major conference. Some RD teams at companies considering HBase/Bigtable
>> as appropriate architecture might have insufficient confidence or be
>> actually burned into opting for something totally sub par but "stable" such
>> as RDBMS sharding. Perfection is not required, but a known issue affecting
>> stability as according to JGs analysis of the balancing issue, or which
>> causes data loss as 1780 and 1784, must be fixed. I agree the rest can be
>> pushed to a point release.
>>
>>   - Andy
>>
>>
>>
>>
>> ________________________________
>> From: stack <st...@duboce.net>
>> To: hbase-dev@hadoop.apache.org
>> Sent: Wednesday, August 26, 2009 7:44:57 PM
>> Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download
>>
>> My reasoning is that RC2 has enough 'right' about it.  Its radically
>> better
>> than our 0.19 offering, as is.
>>
>> The benefit is that we have a week or two less of 0.19.x and that those
>> who
>> only work with released software will get the new hbase earlier.
>>
>> I'm anxious to get us over this 0.20.0 hump -- yes, it will have known
>> defects but every release we've made has had known defects? -- and to get
>> the latest documentation up on our site so noobs and those whose only
>> interaction with the project is via hbase.org -- the marjority? -- are
>> using, finding bugs, and asking questions about the new rather than the
>> old.  I'd also like to get the 0.21 hbase focus started.
>>
>> HBASE-1794 is amusing but for a fact, replay has been broken for many
>> releases now.
>> HBASE-1780 is a problem in 0.19.x
>> HBASE-1784 is an issue, yeah, but looks like the hadoop install is missing
>> hadoop-4681?
>>
>> St.Ack
>>
>>
>>
>>
>>
>>
>>
>> On Wed, Aug 26, 2009 at 8:19 AM, Andrew Purtell <ap...@apache.org>
>> wrote:
>>
>> > There is a lot riding on getting this release right. There have been
>> some
>> > serious bugs unearthed since 0.20.0 RC1. This makes me nervous. I'm not
>> sure
>> > I understand the rationale for releasing 0.20.0 now and then 0.20.1 in
>> one
>> > week, as opposed to taking the same amount of time to run another RC
>> cycle
>> > to produce a 0.20.0 without bad known defects. What is the benefit?
>> >
>> >    HBASE-1794: Recovered data still seems missing until compaction,
>> which
>> > might not happen for 24 hours. Seems like a fix is already known?
>> >    HBASE-1780: Data loss, known fix.
>> >    HBASE-1784: Data loss.
>> >
>> > I'll try to put up a patch/band-aid against at least one of these
>> tonight.
>> >
>> > HBASE-1784 is really troubling. We should roll back a failed compaction,
>> > not vaporize data. -1 on those grounds alone.
>> >
>> >    - Andy
>> >
>> >
>> >
>> >
>> > ________________________________
>> > From: stack <st...@duboce.net>
>> > To: hbase-dev@hadoop.apache.org
>> > Sent: Wednesday, August 26, 2009 4:21:33 PM
>> > Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for
>> download
>> >
>> > It will take a week or so to roll a new RC and to test and vote on it.
>> >
>> > Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?
>> >
>> > The balancing issue happens when you new node online only.  Usually
>> > balancing ain't bad.
>> >
>> > The Mathias issue is bad but still being investigated.
>> >
>> > Andrew?
>> >
>> > St.Ack
>> >
>> >
>> > On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
>> > mathias.herberts@gmail.com> wrote:
>> >
>> > > On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jdcryans@apache.org
>> >
>> > > wrote:
>> > > > +1 I ran it without any problem for a while. I asked Mathias if 1784
>> > > > should kill it and he thinks no since it is not deterministic.
>> > >
>> > > Given the latest run I did and the associated logs/investigation which
>> > > clearly show that the missing rows is related to failed compactions I
>> > > change my mind and now think 1784 should kill this RC.
>> > >
>> > > so -1 for rc2.
>> > >
>> > > Mathias.
>> > >
>> >
>> >
>> >
>> >
>> >
>>
>>
>>
>>
>>
>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

Fair enough.

Lets try and do a fast turnaround on RC3.  There are two issues outstanding
after jdcryans fixes for regressions and the jgray fix for balancer, as I
see it.  I've marked them as 0.20.0 (you are on one of them):
http://su.pr/22vilt.

If there are others, speak up folks.

Hopefully new RC3 by morning.

St.Ack



On Thu, Aug 27, 2009 at 12:24 AM, Andrew Purtell <ap...@apache.org>wrote:

> I understand your reasoning Stack. However, this project is gathering a lot
> of interest and is being considered in several (many?) places. Some noobs
> will find bugs (???) and make embarrassing and very public keynotes at some
> major conference. Some RD teams at companies considering HBase/Bigtable as
> appropriate architecture might have insufficient confidence or be actually
> burned into opting for something totally sub par but "stable" such as RDBMS
> sharding. Perfection is not required, but a known issue affecting stability
> as according to JGs analysis of the balancing issue, or which causes data
> loss as 1780 and 1784, must be fixed. I agree the rest can be pushed to a
> point release.
>
>   - Andy
>
>
>
>
> ________________________________
> From: stack <st...@duboce.net>
> To: hbase-dev@hadoop.apache.org
> Sent: Wednesday, August 26, 2009 7:44:57 PM
> Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download
>
> My reasoning is that RC2 has enough 'right' about it.  Its radically better
> than our 0.19 offering, as is.
>
> The benefit is that we have a week or two less of 0.19.x and that those who
> only work with released software will get the new hbase earlier.
>
> I'm anxious to get us over this 0.20.0 hump -- yes, it will have known
> defects but every release we've made has had known defects? -- and to get
> the latest documentation up on our site so noobs and those whose only
> interaction with the project is via hbase.org -- the marjority? -- are
> using, finding bugs, and asking questions about the new rather than the
> old.  I'd also like to get the 0.21 hbase focus started.
>
> HBASE-1794 is amusing but for a fact, replay has been broken for many
> releases now.
> HBASE-1780 is a problem in 0.19.x
> HBASE-1784 is an issue, yeah, but looks like the hadoop install is missing
> hadoop-4681?
>
> St.Ack
>
>
>
>
>
>
>
> On Wed, Aug 26, 2009 at 8:19 AM, Andrew Purtell <ap...@apache.org>
> wrote:
>
> > There is a lot riding on getting this release right. There have been some
> > serious bugs unearthed since 0.20.0 RC1. This makes me nervous. I'm not
> sure
> > I understand the rationale for releasing 0.20.0 now and then 0.20.1 in
> one
> > week, as opposed to taking the same amount of time to run another RC
> cycle
> > to produce a 0.20.0 without bad known defects. What is the benefit?
> >
> >    HBASE-1794: Recovered data still seems missing until compaction, which
> > might not happen for 24 hours. Seems like a fix is already known?
> >    HBASE-1780: Data loss, known fix.
> >    HBASE-1784: Data loss.
> >
> > I'll try to put up a patch/band-aid against at least one of these
> tonight.
> >
> > HBASE-1784 is really troubling. We should roll back a failed compaction,
> > not vaporize data. -1 on those grounds alone.
> >
> >    - Andy
> >
> >
> >
> >
> > ________________________________
> > From: stack <st...@duboce.net>
> > To: hbase-dev@hadoop.apache.org
> > Sent: Wednesday, August 26, 2009 4:21:33 PM
> > Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download
> >
> > It will take a week or so to roll a new RC and to test and vote on it.
> >
> > Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?
> >
> > The balancing issue happens when you new node online only.  Usually
> > balancing ain't bad.
> >
> > The Mathias issue is bad but still being investigated.
> >
> > Andrew?
> >
> > St.Ack
> >
> >
> > On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
> > mathias.herberts@gmail.com> wrote:
> >
> > > On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org>
> > > wrote:
> > > > +1 I ran it without any problem for a while. I asked Mathias if 1784
> > > > should kill it and he thinks no since it is not deterministic.
> > >
> > > Given the latest run I did and the associated logs/investigation which
> > > clearly show that the missing rows is related to failed compactions I
> > > change my mind and now think 1784 should kill this RC.
> > >
> > > so -1 for rc2.
> > >
> > > Mathias.
> > >
> >
> >
> >
> >
> >
>
>
>
>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Andrew Purtell <ap...@apache.org>.

I understand your reasoning Stack. However, this project is gathering a lot of interest and is being considered in several (many?) places. Some noobs will find bugs (???) and make embarrassing and very public keynotes at some major conference. Some RD teams at companies considering HBase/Bigtable as appropriate architecture might have insufficient confidence or be actually burned into opting for something totally sub par but "stable" such as RDBMS sharding. Perfection is not required, but a known issue affecting stability as according to JGs analysis of the balancing issue, or which causes data loss as 1780 and 1784, must be fixed. I agree the rest can be pushed to a point release.

   - Andy

________________________________
From: stack <st...@duboce.net>
To: hbase-dev@hadoop.apache.org
Sent: Wednesday, August 26, 2009 7:44:57 PM
Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

My reasoning is that RC2 has enough 'right' about it.  Its radically better
than our 0.19 offering, as is.

The benefit is that we have a week or two less of 0.19.x and that those who
only work with released software will get the new hbase earlier.

I'm anxious to get us over this 0.20.0 hump -- yes, it will have known
defects but every release we've made has had known defects? -- and to get
the latest documentation up on our site so noobs and those whose only
interaction with the project is via hbase.org -- the marjority? -- are
using, finding bugs, and asking questions about the new rather than the
old.  I'd also like to get the 0.21 hbase focus started.

HBASE-1794 is amusing but for a fact, replay has been broken for many
releases now.
HBASE-1780 is a problem in 0.19.x
HBASE-1784 is an issue, yeah, but looks like the hadoop install is missing
hadoop-4681?

St.Ack

On Wed, Aug 26, 2009 at 8:19 AM, Andrew Purtell <ap...@apache.org> wrote:

> There is a lot riding on getting this release right. There have been some
> serious bugs unearthed since 0.20.0 RC1. This makes me nervous. I'm not sure
> I understand the rationale for releasing 0.20.0 now and then 0.20.1 in one
> week, as opposed to taking the same amount of time to run another RC cycle
> to produce a 0.20.0 without bad known defects. What is the benefit?
>
>    HBASE-1794: Recovered data still seems missing until compaction, which
> might not happen for 24 hours. Seems like a fix is already known?
>    HBASE-1780: Data loss, known fix.
>    HBASE-1784: Data loss.
>
> I'll try to put up a patch/band-aid against at least one of these tonight.
>
> HBASE-1784 is really troubling. We should roll back a failed compaction,
> not vaporize data. -1 on those grounds alone.
>
>    - Andy
>
>
>
>
> ________________________________
> From: stack <st...@duboce.net>
> To: hbase-dev@hadoop.apache.org
> Sent: Wednesday, August 26, 2009 4:21:33 PM
> Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download
>
> It will take a week or so to roll a new RC and to test and vote on it.
>
> Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?
>
> The balancing issue happens when you new node online only.  Usually
> balancing ain't bad.
>
> The Mathias issue is bad but still being investigated.
>
> Andrew?
>
> St.Ack
>
>
> On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
> mathias.herberts@gmail.com> wrote:
>
> > On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org>
> > wrote:
> > > +1 I ran it without any problem for a while. I asked Mathias if 1784
> > > should kill it and he thinks no since it is not deterministic.
> >
> > Given the latest run I did and the associated logs/investigation which
> > clearly show that the missing rows is related to failed compactions I
> > change my mind and now think 1784 should kill this RC.
> >
> > so -1 for rc2.
> >
> > Mathias.
> >
>
>
>
>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

My reasoning is that RC2 has enough 'right' about it.  Its radically better
than our 0.19 offering, as is.

The benefit is that we have a week or two less of 0.19.x and that those who
only work with released software will get the new hbase earlier.

I'm anxious to get us over this 0.20.0 hump -- yes, it will have known
defects but every release we've made has had known defects? -- and to get
the latest documentation up on our site so noobs and those whose only
interaction with the project is via hbase.org -- the marjority? -- are
using, finding bugs, and asking questions about the new rather than the
old.  I'd also like to get the 0.21 hbase focus started.

HBASE-1794 is amusing but for a fact, replay has been broken for many
releases now.
HBASE-1780 is a problem in 0.19.x
HBASE-1784 is an issue, yeah, but looks like the hadoop install is missing
hadoop-4681?

St.Ack

On Wed, Aug 26, 2009 at 8:19 AM, Andrew Purtell <ap...@apache.org> wrote:

> There is a lot riding on getting this release right. There have been some
> serious bugs unearthed since 0.20.0 RC1. This makes me nervous. I'm not sure
> I understand the rationale for releasing 0.20.0 now and then 0.20.1 in one
> week, as opposed to taking the same amount of time to run another RC cycle
> to produce a 0.20.0 without bad known defects. What is the benefit?
>
>    HBASE-1794: Recovered data still seems missing until compaction, which
> might not happen for 24 hours. Seems like a fix is already known?
>    HBASE-1780: Data loss, known fix.
>    HBASE-1784: Data loss.
>
> I'll try to put up a patch/band-aid against at least one of these tonight.
>
> HBASE-1784 is really troubling. We should roll back a failed compaction,
> not vaporize data. -1 on those grounds alone.
>
>    - Andy
>
>
>
>
> ________________________________
> From: stack <st...@duboce.net>
> To: hbase-dev@hadoop.apache.org
> Sent: Wednesday, August 26, 2009 4:21:33 PM
> Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download
>
> It will take a week or so to roll a new RC and to test and vote on it.
>
> Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?
>
> The balancing issue happens when you new node online only.  Usually
> balancing ain't bad.
>
> The Mathias issue is bad but still being investigated.
>
> Andrew?
>
> St.Ack
>
>
> On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
> mathias.herberts@gmail.com> wrote:
>
> > On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org>
> > wrote:
> > > +1 I ran it without any problem for a while. I asked Mathias if 1784
> > > should kill it and he thinks no since it is not deterministic.
> >
> > Given the latest run I did and the associated logs/investigation which
> > clearly show that the missing rows is related to failed compactions I
> > change my mind and now think 1784 should kill this RC.
> >
> > so -1 for rc2.
> >
> > Mathias.
> >
>
>
>
>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Andrew Purtell <ap...@apache.org>.

We're not looking for perfection, no. But let's not damage confidence in the project unnecessarily.

________________________________
From: Ryan Rawson <ry...@gmail.com>
To: hbase-dev@hadoop.apache.org
Sent: Wednesday, August 26, 2009 8:57:57 PM
Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

I am +1 on rc2 becoming 0.20.0.

Guys, focus, its septemeber. When will 0.21 ship? Janurary?

On Aug 26, 2009 11:01 AM, "stack" <st...@duboce.net> wrote:

OK.  Lets sink the RC.  Its gotten too many -1s.  HBASE-1792/3 are bad too.

For the record, I'm +1 on RC2 becoming release.  Its been running here at
pset on 110 nodes for last week or so.  I downloaded it and checked out its
documentation and started it up locally.

St.Ack

On Wed, Aug 26, 2009 at 9:04 AM, Jonathan Gray <jl...@streamy.com> wrote: >
I'm with Andrew. -1 ...

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Jonathan Gray <jl...@streamy.com>.

I would vote for an RC3 first thing Monday, and votes due by Friday.  Or 
even shorter.  Let's get in anything small and important and accelerate 
the approval.

All other issues aside, for me personally, as long as HBASE-1737 is not 
in the release, then there is core functionality that does not work (and 
this is a regression) and I would not recommend people putting it into 
production as such.

I would consider being +1 on release RC2 w/ addition of HBASE-1737.  I 
agree that log replay is not 0.20 focus and issues have existed for a 
long time.

Ryan Rawson wrote:
> I am +1 on rc2 becoming 0.20.0.
> 
> Guys, focus, its septemeber. When will 0.21 ship? Janurary?
> 
> On Aug 26, 2009 11:01 AM, "stack" <st...@duboce.net> wrote:
> 
> OK.  Lets sink the RC.  Its gotten too many -1s.  HBASE-1792/3 are bad too.
> 
> For the record, I'm +1 on RC2 becoming release.  Its been running here at
> pset on 110 nodes for last week or so.  I downloaded it and checked out its
> documentation and started it up locally.
> 
> St.Ack
> 
> On Wed, Aug 26, 2009 at 9:04 AM, Jonathan Gray <jl...@streamy.com> wrote: >
> I'm with Andrew. -1 ...
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Ryan Rawson <ry...@gmail.com>.

I am +1 on rc2 becoming 0.20.0.

Guys, focus, its septemeber. When will 0.21 ship? Janurary?

On Aug 26, 2009 11:01 AM, "stack" <st...@duboce.net> wrote:

OK.  Lets sink the RC.  Its gotten too many -1s.  HBASE-1792/3 are bad too.

For the record, I'm +1 on RC2 becoming release.  Its been running here at
pset on 110 nodes for last week or so.  I downloaded it and checked out its
documentation and started it up locally.

St.Ack

On Wed, Aug 26, 2009 at 9:04 AM, Jonathan Gray <jl...@streamy.com> wrote: >
I'm with Andrew. -1 ...

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

OK.  Lets sink the RC.  Its gotten too many -1s.  HBASE-1792/3 are bad too.

For the record, I'm +1 on RC2 becoming release.  Its been running here at
pset on 110 nodes for last week or so.  I downloaded it and checked out its
documentation and started it up locally.

St.Ack


On Wed, Aug 26, 2009 at 9:04 AM, Jonathan Gray <jl...@streamy.com> wrote:

> I'm with Andrew.  -1 on RC2.
>
> I don't see the value in putting 0.20.0 into the wild when there are known
> defects.  Just to release 0.20.1 shortly thereafter saying, this fixes
> important issues so please upgrade immediately.  It's completely acceptable
> to say, lots of people are using RC2 in production and it's fine to move
> forward with... and upgrade to the release when it is available.  Following
> release of 0.20.0, we should all be on a PR kick; blogging, tweeting,
> emailing, reaching out, and talking to everyone we can about the awesome new
> release.  So the initial release itself should be solid.
>


>
> The balancing issue is a serious issue as it means if you lose a node and
> it comes back online, or if you add a new node, your cluster will suffer
> some serious reliability and performance issues.  I don't think we should
> consider this rare or fringe, in fact it means you can't do rolling restarts
> properly.
>
> I experienced this in our running production system and eventually I had to
> keep running the cluster w/o two of my nodes.  If you have a node with a far
> fewer regions than the others, then all new regions go to that
> regionserver... load becomes horribly unbalanced if you have a
> recent-data-bias, with a majority of reads and writes going to a single
> node.  This led to that RS being swamped w/ long GC pauses and generally bad
> cluster stability.  It's a release blocker alone, IMO.  JSharp ran into this
> yesterday which is how we realized it had been uncommitted.
>
> I *might* be okay with a release of 0.20.0 w/o a fix for HBASE-1784 because
> it is very rare... however failed compactions leading to data loss is pretty
> nasty and we should really try to fix it for release if we squash RC2
> anyways.  This is at least worth putting some effort into over the next few
> days to see if we can reproduce the issue and fix it (by rolling back failed
> compactions properly).  It's better that regions grow to huge sizes because
> compactions fail, thus no splits, rather than complete data loss.
>
> HBASE-1780 should be fixed and should not be too difficult, but maybe not a
> release blocker.
>
> HBASE-1794 we'll have to hear from Ryan what the status is of it.
>
> No one wants to delay release any longer, but the most important thing we
> can do is make sure the release is solid... We can't say that we these open
> issue.
>
> Also, HDFS-200 testing by Ryan is turning up some great stuff and he has
> had success (creating a table, kill -9ing the RS and DN, and META recovers
> fully and the table still exists... magic!).  If we wait until Monday or so
> to cut RC3 (hopefully with fixes for much of above), then perhaps by the
> time we're ready for release we can also have "official" but experimental
> support for HDFS-200.
>
> Ryan mentioned if it works sufficiently well he'd like to put it into
> production at supr... and I feel the same here at streamy.  If it generally
> works, we'll want to put it into production as the current data loss story
> is really the only frightening thing left :)
>
> JG
>
>
>
> Andrew Purtell wrote:
>
>> There is a lot riding on getting this release right. There have been some
>> serious bugs unearthed since 0.20.0 RC1. This makes me nervous. I'm not sure
>> I understand the rationale for releasing 0.20.0 now and then 0.20.1 in one
>> week, as opposed to taking the same amount of time to run another RC cycle
>> to produce a 0.20.0 without bad known defects. What is the benefit?
>>    HBASE-1794: Recovered data still seems missing until compaction, which
>> might not happen for 24 hours. Seems like a fix is already known?
>>    HBASE-1780: Data loss, known fix.
>>    HBASE-1784: Data loss.
>>
>> I'll try to put up a patch/band-aid against at least one of these tonight.
>>
>> HBASE-1784 is really troubling. We should roll back a failed compaction,
>> not vaporize data. -1 on those grounds alone.
>>
>>    - Andy
>>
>>
>>
>>
>> ________________________________
>> From: stack <st...@duboce.net>
>> To: hbase-dev@hadoop.apache.org
>> Sent: Wednesday, August 26, 2009 4:21:33 PM
>> Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download
>>
>> It will take a week or so to roll a new RC and to test and vote on it.
>>
>> Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?
>>
>> The balancing issue happens when you new node online only.  Usually
>> balancing ain't bad.
>>
>> The Mathias issue is bad but still being investigated.
>>
>> Andrew?
>>
>> St.Ack
>>
>>
>> On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
>> mathias.herberts@gmail.com> wrote:
>>
>>  On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org>
>>> wrote:
>>>
>>>> +1 I ran it without any problem for a while. I asked Mathias if 1784
>>>> should kill it and he thinks no since it is not deterministic.
>>>>
>>> Given the latest run I did and the associated logs/investigation which
>>> clearly show that the missing rows is related to failed compactions I
>>> change my mind and now think 1784 should kill this RC.
>>>
>>> so -1 for rc2.
>>>
>>> Mathias.
>>>
>>>
>>
>>
>>
>>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Jonathan Gray <jl...@streamy.com>.

I'm with Andrew.  -1 on RC2.

I don't see the value in putting 0.20.0 into the wild when there are 
known defects.  Just to release 0.20.1 shortly thereafter saying, this 
fixes important issues so please upgrade immediately.  It's completely 
acceptable to say, lots of people are using RC2 in production and it's 
fine to move forward with... and upgrade to the release when it is 
available.  Following release of 0.20.0, we should all be on a PR kick; 
blogging, tweeting, emailing, reaching out, and talking to everyone we 
can about the awesome new release.  So the initial release itself should 
be solid.

The balancing issue is a serious issue as it means if you lose a node 
and it comes back online, or if you add a new node, your cluster will 
suffer some serious reliability and performance issues.  I don't think 
we should consider this rare or fringe, in fact it means you can't do 
rolling restarts properly.

I experienced this in our running production system and eventually I had 
to keep running the cluster w/o two of my nodes.  If you have a node 
with a far fewer regions than the others, then all new regions go to 
that regionserver... load becomes horribly unbalanced if you have a 
recent-data-bias, with a majority of reads and writes going to a single 
node.  This led to that RS being swamped w/ long GC pauses and generally 
bad cluster stability.  It's a release blocker alone, IMO.  JSharp ran 
into this yesterday which is how we realized it had been uncommitted.

I *might* be okay with a release of 0.20.0 w/o a fix for HBASE-1784 
because it is very rare... however failed compactions leading to data 
loss is pretty nasty and we should really try to fix it for release if 
we squash RC2 anyways.  This is at least worth putting some effort into 
over the next few days to see if we can reproduce the issue and fix it 
(by rolling back failed compactions properly).  It's better that regions 
grow to huge sizes because compactions fail, thus no splits, rather than 
complete data loss.

HBASE-1780 should be fixed and should not be too difficult, but maybe 
not a release blocker.

HBASE-1794 we'll have to hear from Ryan what the status is of it.

No one wants to delay release any longer, but the most important thing 
we can do is make sure the release is solid... We can't say that we 
these open issue.

Also, HDFS-200 testing by Ryan is turning up some great stuff and he has 
had success (creating a table, kill -9ing the RS and DN, and META 
recovers fully and the table still exists... magic!).  If we wait until 
Monday or so to cut RC3 (hopefully with fixes for much of above), then 
perhaps by the time we're ready for release we can also have "official" 
but experimental support for HDFS-200.

Ryan mentioned if it works sufficiently well he'd like to put it into 
production at supr... and I feel the same here at streamy.  If it 
generally works, we'll want to put it into production as the current 
data loss story is really the only frightening thing left :)

JG

Andrew Purtell wrote:
> There is a lot riding on getting this release right. There have been some serious bugs unearthed since 0.20.0 RC1. This makes me nervous. I'm not sure I understand the rationale for releasing 0.20.0 now and then 0.20.1 in one week, as opposed to taking the same amount of time to run another RC cycle to produce a 0.20.0 without bad known defects. What is the benefit? 
> 
>     HBASE-1794: Recovered data still seems missing until compaction, which might not happen for 24 hours. Seems like a fix is already known?
>     HBASE-1780: Data loss, known fix.
>     HBASE-1784: Data loss.
> 
> I'll try to put up a patch/band-aid against at least one of these tonight. 
> 
> HBASE-1784 is really troubling. We should roll back a failed compaction, not vaporize data. -1 on those grounds alone.
> 
>     - Andy
> 
> 
> 
> 
> ________________________________
> From: stack <st...@duboce.net>
> To: hbase-dev@hadoop.apache.org
> Sent: Wednesday, August 26, 2009 4:21:33 PM
> Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download
> 
> It will take a week or so to roll a new RC and to test and vote on it.
> 
> Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?
> 
> The balancing issue happens when you new node online only.  Usually
> balancing ain't bad.
> 
> The Mathias issue is bad but still being investigated.
> 
> Andrew?
> 
> St.Ack
> 
> 
> On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
> mathias.herberts@gmail.com> wrote:
> 
>> On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org>
>> wrote:
>>> +1 I ran it without any problem for a while. I asked Mathias if 1784
>>> should kill it and he thinks no since it is not deterministic.
>> Given the latest run I did and the associated logs/investigation which
>> clearly show that the missing rows is related to failed compactions I
>> change my mind and now think 1784 should kill this RC.
>>
>> so -1 for rc2.
>>
>> Mathias.
>>
> 
> 
> 
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Andrew Purtell <ap...@apache.org>.

There is a lot riding on getting this release right. There have been some serious bugs unearthed since 0.20.0 RC1. This makes me nervous. I'm not sure I understand the rationale for releasing 0.20.0 now and then 0.20.1 in one week, as opposed to taking the same amount of time to run another RC cycle to produce a 0.20.0 without bad known defects. What is the benefit? 

    HBASE-1794: Recovered data still seems missing until compaction, which might not happen for 24 hours. Seems like a fix is already known?
    HBASE-1780: Data loss, known fix.
    HBASE-1784: Data loss.

I'll try to put up a patch/band-aid against at least one of these tonight. 

HBASE-1784 is really troubling. We should roll back a failed compaction, not vaporize data. -1 on those grounds alone.

    - Andy

________________________________
From: stack <st...@duboce.net>
To: hbase-dev@hadoop.apache.org
Sent: Wednesday, August 26, 2009 4:21:33 PM
Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

It will take a week or so to roll a new RC and to test and vote on it.

Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?

The balancing issue happens when you new node online only.  Usually
balancing ain't bad.

The Mathias issue is bad but still being investigated.

Andrew?

St.Ack

On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
mathias.herberts@gmail.com> wrote:

> On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org>
> wrote:
> > +1 I ran it without any problem for a while. I asked Mathias if 1784
> > should kill it and he thinks no since it is not deterministic.
>
> Given the latest run I did and the associated logs/investigation which
> clearly show that the missing rows is related to failed compactions I
> change my mind and now think 1784 should kill this RC.
>
> so -1 for rc2.
>
> Mathias.
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by stack <st...@duboce.net>.

It will take a week or so to roll a new RC and to test and vote on it.

Why not let out RC2 as 0.20.0 and do 0.20.1 within the next week or so?

The balancing issue happens when you new node online only.  Usually
balancing ain't bad.

The Mathias issue is bad but still being investigated.

Andrew?

St.Ack

On Wed, Aug 26, 2009 at 1:04 AM, Mathias Herberts <
mathias.herberts@gmail.com> wrote:

> On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org>
> wrote:
> > +1 I ran it without any problem for a while. I asked Mathias if 1784
> > should kill it and he thinks no since it is not deterministic.
>
> Given the latest run I did and the associated logs/investigation which
> clearly show that the missing rows is related to failed compactions I
> change my mind and now think 1784 should kill this RC.
>
> so -1 for rc2.
>
> Mathias.
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Mathias Herberts <ma...@gmail.com>.

On Mon, Aug 24, 2009 at 16:51, Jean-Daniel Cryans<jd...@apache.org> wrote:
> +1 I ran it without any problem for a while. I asked Mathias if 1784
> should kill it and he thinks no since it is not deterministic.

Given the latest run I did and the associated logs/investigation which
clearly show that the missing rows is related to failed compactions I
change my mind and now think 1784 should kill this RC.

so -1 for rc2.

Mathias.

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Andrew Purtell <ap...@apache.org>.

There are enough issues to sink this RC.

  -1




________________________________
From: Jonathan Gray <jl...@streamy.com>
To: hbase-dev@hadoop.apache.org
Sent: Wednesday, August 26, 2009 1:19:42 AM
Subject: Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

-1

Have been running solid with it for quite some time, unfortunately an 
important issue, HBASE-1737, dealing with load balancing on newly added 
servers, was accidentally undone by commit of HBASE-1743.

It has been re-applied to branch and trunk now.

JG

Jean-Daniel Cryans wrote:
> +1 I ran it without any problem for a while. I asked Mathias if 1784
> should kill it and he thinks no since it is not deterministic.
> 
> J-D
> 
> On Mon, Aug 24, 2009 at 4:10 AM, Tim Sell<tr...@gmail.com> wrote:
>> +1
>>
>> Running smoothly.
>> ~Tim.
>>
>> 2009/8/19 Andrew Purtell <ap...@apache.org>:
>>> +1
>>>
>>> Survived days of pounding with no observable performance regression.
>>>
>>>   - Andy
>>>
>>>
>>>
>>>
>>> ________________________________
>>> From: stack <st...@duboce.net>
>>> To: hbase-dev@hadoop.apache.org; hbase-user@hadoop.apache.org
>>> Sent: Tuesday, August 18, 2009 1:52:48 PM
>>> Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download
>>>
>>> The second hbase 0.20.0 release candidate is available for download:
>>>
>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>>>
>>> Near to 450 issues have been addressed since the 0.19 branch.  Release notes
>>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>>
>>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x including
>>> configuration fundamentals.  Be sure to read the 'Getting Started'
>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>>
>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will need
>>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>>> First read the overview and then go to the section, 'From 0.19.x to 0.20.x'.
>>>
>>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>>> Wednesday, August 25th.
>>>
>>> Yours,
>>> The HBasistas
>>>
>>>
>>>
>>>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Jonathan Gray <jl...@streamy.com>.

-1

Have been running solid with it for quite some time, unfortunately an 
important issue, HBASE-1737, dealing with load balancing on newly added 
servers, was accidentally undone by commit of HBASE-1743.

It has been re-applied to branch and trunk now.

JG

Jean-Daniel Cryans wrote:
> +1 I ran it without any problem for a while. I asked Mathias if 1784
> should kill it and he thinks no since it is not deterministic.
> 
> J-D
> 
> On Mon, Aug 24, 2009 at 4:10 AM, Tim Sell<tr...@gmail.com> wrote:
>> +1
>>
>> Running smoothly.
>> ~Tim.
>>
>> 2009/8/19 Andrew Purtell <ap...@apache.org>:
>>> +1
>>>
>>> Survived days of pounding with no observable performance regression.
>>>
>>>   - Andy
>>>
>>>
>>>
>>>
>>> ________________________________
>>> From: stack <st...@duboce.net>
>>> To: hbase-dev@hadoop.apache.org; hbase-user@hadoop.apache.org
>>> Sent: Tuesday, August 18, 2009 1:52:48 PM
>>> Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download
>>>
>>> The second hbase 0.20.0 release candidate is available for download:
>>>
>>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>>>
>>> Near to 450 issues have been addressed since the 0.19 branch.  Release notes
>>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>>
>>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x including
>>> configuration fundamentals.  Be sure to read the 'Getting Started'
>>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>>
>>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will need
>>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>>> First read the overview and then go to the section, 'From 0.19.x to 0.20.x'.
>>>
>>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>>> Wednesday, August 25th.
>>>
>>> Yours,
>>> The HBasistas
>>>
>>>
>>>
>>>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Jean-Daniel Cryans <jd...@apache.org>.

+1 I ran it without any problem for a while. I asked Mathias if 1784
should kill it and he thinks no since it is not deterministic.

J-D

On Mon, Aug 24, 2009 at 4:10 AM, Tim Sell<tr...@gmail.com> wrote:
> +1
>
> Running smoothly.
> ~Tim.
>
> 2009/8/19 Andrew Purtell <ap...@apache.org>:
>> +1
>>
>> Survived days of pounding with no observable performance regression.
>>
>>   - Andy
>>
>>
>>
>>
>> ________________________________
>> From: stack <st...@duboce.net>
>> To: hbase-dev@hadoop.apache.org; hbase-user@hadoop.apache.org
>> Sent: Tuesday, August 18, 2009 1:52:48 PM
>> Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download
>>
>> The second hbase 0.20.0 release candidate is available for download:
>>
>> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>>
>> Near to 450 issues have been addressed since the 0.19 branch.  Release notes
>> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>>
>> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x including
>> configuration fundamentals.  Be sure to read the 'Getting Started'
>> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>>
>> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will need
>> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
>> First read the overview and then go to the section, 'From 0.19.x to 0.20.x'.
>>
>> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
>> Wednesday, August 25th.
>>
>> Yours,
>> The HBasistas
>>
>>
>>
>>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Tim Sell <tr...@gmail.com>.

+1

Running smoothly.
~Tim.

2009/8/19 Andrew Purtell <ap...@apache.org>:
> +1
>
> Survived days of pounding with no observable performance regression.
>
>   - Andy
>
>
>
>
> ________________________________
> From: stack <st...@duboce.net>
> To: hbase-dev@hadoop.apache.org; hbase-user@hadoop.apache.org
> Sent: Tuesday, August 18, 2009 1:52:48 PM
> Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download
>
> The second hbase 0.20.0 release candidate is available for download:
>
> http://people.apache.org/~stack/hbase-0.20.0-candidate-2/
>
> Near to 450 issues have been addressed since the 0.19 branch.  Release notes
> are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
>
> HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x including
> configuration fundamentals.  Be sure to read the 'Getting Started'
> documentation in 0.20.0 available here: http://su.pr/8YQjHO
>
> If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will need
> to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
> First read the overview and then go to the section, 'From 0.19.x to 0.20.x'.
>
> Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
> Wednesday, August 25th.
>
> Yours,
> The HBasistas
>
>
>
>

Re: ANN: hbase 0.20.0 Release Candidate 2 available for download

Posted by Andrew Purtell <ap...@apache.org>.

+1 

Survived days of pounding with no observable performance regression.

   - Andy




________________________________
From: stack <st...@duboce.net>
To: hbase-dev@hadoop.apache.org; hbase-user@hadoop.apache.org
Sent: Tuesday, August 18, 2009 1:52:48 PM
Subject: ANN: hbase 0.20.0 Release Candidate 2 available for download

The second hbase 0.20.0 release candidate is available for download:

http://people.apache.org/~stack/hbase-0.20.0-candidate-2/

Near to 450 issues have been addressed since the 0.19 branch.  Release notes
are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.

HBase 0.20.0 runs on Hadoop 0.20.0.  Alot has changed since 0.19.x including
configuration fundamentals.  Be sure to read the 'Getting Started'
documentation in 0.20.0 available here: http://su.pr/8YQjHO

If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will need
to run a migration.  See http://wiki.apache.org/hadoop/Hbase/HowToMigrate.
First read the overview and then go to the section, 'From 0.19.x to 0.20.x'.

Should we release this candidate as hbase 0.20.0?  Please vote +1/-1 by
Wednesday, August 25th.

Yours,
The HBasistas