You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Michaela Buergle <Mi...@neofonie.de> on 2008/05/07 13:36:04 UTC
TableNotDisabledException - is it HBASE-478?
Hi all,
I am performing the following simple steps:
- create an HBase table
- add a column family
- put some content in that column (only 100 rows/1 col for testing)
Roughly once every 5 tries, I don't succeed - I get a
"TableNotDisabledException" when I try to add the column family. It
seems that immediately before the problem occurs, regions are reassigned
because one server is loaded above the average value.
Can that be connected to HBASE-487?
I use the TRUNK version (from 1 or 2 days ago) with 2 nodes. I've
attached parts of the master's and concerned regionserver's logs:
Three tables are created (hbase-master.log: test1 l.160, test2 l.264,
test3 l.370). After create table for "test3", the load balancing occurs.
There is some waiting to disable the test3 region, in l.478 the
information that test3 has been disabled and in l.507 the
TableNotDisabledException thrown by addColumn.
micha
Re: TableNotDisabledException - is it HBASE-478?
Posted by stack <st...@duboce.net>.
Stick the below into a JIRA. You might add some description of your
tables schemas, how many tables you have, and how loaded they are so we
can replicate. Sounds like TRUNK still needs work. Reliable onlining
and offlining of tables so schemas can be altered or tables dropped is a
critical admin tool. Mark its state as so -- i.e. critical -- and we'll
have a look at it.
Thanks Michaela.
St.Ack
Michaela Buergle wrote:
> I still see the same behaviour in the patched 0.2.0 (though not in the
> 0.1.2 release), so I guess it wasn't 478.
>
> Short summary of the problem:
> - create table: everything ok
> - admin.disableTable - admin.addColumn - admin.enableTable
> (where admin is an HBaseAdmin): disableTable doesn't always succeed.
>
> I've taken a look at HBaseAdmin.disableTable().
> First thing I notice is that after trying "numRetries" times to wait for
> the first region to be disabled, I leave the loop and proceed as if
> everything was alright - and in the log I get
> "INFO org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table xy".
> That's quite misleading.
>
> Second, the created scanner returns all "region:regioninfo" Cells for
> all row keys (in this case the table name, right?) starting with the
> requested table. Therefore the boolean "disabled" turns true if a table
> after the intended one is disabled and again I leave the loop. If I
> disable, say, table4 and then call disableTable() for table24, I
> immediately get the message "Disabled table24" and then (not
> surprisingly) the TableNotDisabledException. This is confusing - am I
> using the method in a wrong way?
>
> These issues aside, the question remains why sometimes a table cannot be
> disabled. @Bryan: if I create the table along with the column family, I
> don't get a problem - but I don't call disableTable() in that case. And
> you're right about the oscillation. It's not unusual to watch a few
> regions being deassigned from and reassigned again to the same node a
> few times in a row. As I mentioned: I currently have only two nodes,
> which admittedly might not be a typical setting. But still it should be
> possible to work with.
>
> Anyway, it seems that the table in question is often?/usually? being
> reassigned to another RegionServer around the time that I want to add
> the column. But maybe that's just coincidence.
> I've tried upping hbase.client.retries.number to 20 (the "numRetries")
> just to make sure to give the process enough time, but the problem remains.
> Can you give me any pointer on where to start digging?
>
> micha
>
> P.S.@stack: No short term need for stability guarantees, just checking
> HBase out - I figured that TRUNK is for the adventurous-minded :)
>
>
> Jim Kellerman wrote:
>
>> Most likely it is 478. A patch is available for trunk, but has not been committed yet because it is waiting for review.
>>
>
>
>>> It seems to me like it could be a case of HBASE-478. Usually it takes
>>> a bigger table to cause issues though. If you create the table with
>>> the column family to start with instead of adding after the table is
>>> created, do you still have this problem?
>>>
>>> Another possible issue here is HBASE-615. It's unlikely that the
>>> oscillation Jim saw is only during startup, so perhaps with the right
>>> arrangement of number of nodes and number of regions, you're also
>>> seeing oscillation.
>>>
>>> -Bryan
>>>
Re: TableNotDisabledException - is it HBASE-478?
Posted by Michaela Buergle <Mi...@neofonie.de>.
I still see the same behaviour in the patched 0.2.0 (though not in the
0.1.2 release), so I guess it wasn't 478.
Short summary of the problem:
- create table: everything ok
- admin.disableTable - admin.addColumn - admin.enableTable
(where admin is an HBaseAdmin): disableTable doesn't always succeed.
I've taken a look at HBaseAdmin.disableTable().
First thing I notice is that after trying "numRetries" times to wait for
the first region to be disabled, I leave the loop and proceed as if
everything was alright - and in the log I get
"INFO org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table xy".
That's quite misleading.
Second, the created scanner returns all "region:regioninfo" Cells for
all row keys (in this case the table name, right?) starting with the
requested table. Therefore the boolean "disabled" turns true if a table
after the intended one is disabled and again I leave the loop. If I
disable, say, table4 and then call disableTable() for table24, I
immediately get the message "Disabled table24" and then (not
surprisingly) the TableNotDisabledException. This is confusing - am I
using the method in a wrong way?
These issues aside, the question remains why sometimes a table cannot be
disabled. @Bryan: if I create the table along with the column family, I
don't get a problem - but I don't call disableTable() in that case. And
you're right about the oscillation. It's not unusual to watch a few
regions being deassigned from and reassigned again to the same node a
few times in a row. As I mentioned: I currently have only two nodes,
which admittedly might not be a typical setting. But still it should be
possible to work with.
Anyway, it seems that the table in question is often?/usually? being
reassigned to another RegionServer around the time that I want to add
the column. But maybe that's just coincidence.
I've tried upping hbase.client.retries.number to 20 (the "numRetries")
just to make sure to give the process enough time, but the problem remains.
Can you give me any pointer on where to start digging?
micha
P.S.@stack: No short term need for stability guarantees, just checking
HBase out - I figured that TRUNK is for the adventurous-minded :)
Jim Kellerman wrote:
> Most likely it is 478. A patch is available for trunk, but has not been committed yet because it is waiting for review.
>> It seems to me like it could be a case of HBASE-478. Usually it takes
>> a bigger table to cause issues though. If you create the table with
>> the column family to start with instead of adding after the table is
>> created, do you still have this problem?
>>
>> Another possible issue here is HBASE-615. It's unlikely that the
>> oscillation Jim saw is only during startup, so perhaps with the right
>> arrangement of number of nodes and number of regions, you're also
>> seeing oscillation.
>>
>> -Bryan
RE: TableNotDisabledException - is it HBASE-478?
Posted by Jim Kellerman <ji...@powerset.com>.
Most likely it is 478. A patch is available for trunk, but has not been committed yet because it is waiting for review.
---
Jim Kellerman, Senior Engineer; Powerset
> -----Original Message-----
> From: Bryan Duxbury [mailto:bryan@rapleaf.com]
> Sent: Wednesday, May 07, 2008 7:17 AM
> To: hbase-user@hadoop.apache.org
> Subject: Re: TableNotDisabledException - is it HBASE-478?
>
> It seems to me like it could be a case of HBASE-478. Usually it takes
> a bigger table to cause issues though. If you create the table with
> the column family to start with instead of adding after the table is
> created, do you still have this problem?
>
> Another possible issue here is HBASE-615. It's unlikely that the
> oscillation Jim saw is only during startup, so perhaps with the right
> arrangement of number of nodes and number of regions, you're also
> seeing oscillation.
>
> -Bryan
>
> On May 7, 2008, at 4:36 AM, Michaela Buergle wrote:
>
> > Hi all,
> > I am performing the following simple steps:
> > - create an HBase table
> > - add a column family
> > - put some content in that column (only 100 rows/1 col for testing)
> >
> > Roughly once every 5 tries, I don't succeed - I get a
> > "TableNotDisabledException" when I try to add the column family. It
> > seems that immediately before the problem occurs, regions are
> > reassigned
> > because one server is loaded above the average value.
> >
> > Can that be connected to HBASE-487?
> >
> > I use the TRUNK version (from 1 or 2 days ago) with 2 nodes. I've
> > attached parts of the master's and concerned regionserver's logs:
> > Three tables are created (hbase-master.log: test1 l.160,
> test2 l.264,
> > test3 l.370). After create table for "test3", the load balancing
> > occurs.
> > There is some waiting to disable the test3 region, in l.478 the
> > information that test3 has been disabled and in l.507 the
> > TableNotDisabledException thrown by addColumn.
> >
> > micha
> > 2008-05-07 10:24:14,123 INFO
> > org.apache.hadoop.hbase.master.HMaster: Root region dir: hdfs://
> > nantes:54321/hbase/-ROOT-/70236052
> > 2008-05-07 10:24:14,355 INFO
> > org.apache.hadoop.hbase.master.HMaster: bootstrap: creating ROOT
> > and first META regions
> > 2008-05-07 10:24:14,415 INFO
> > org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> > at /hbase/-ROOT-/70236052/log/hlog.dat.1210148654388
> > 2008-05-07 10:24:14,416 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region -
> > ROOT-,,0/70236052
> > 2008-05-07 10:24:14,471 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> > hstore 70236052/info, max sequence id -1
> > 2008-05-07 10:24:14,473 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region -ROOT-,,0 is 0
> > 2008-05-07 10:24:14,475 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region -ROOT-,,
> > 0/70236052 available
> > 2008-05-07 10:24:14,529 INFO
> > org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> > at /hbase/.META./1028785192/log/hlog.dat.1210148654512
> > 2008-05-07 10:24:14,530 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening
> > region .META.,,1/1028785192
> > 2008-05-07 10:24:14,671 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> > hstore 1028785192/info, max sequence id -1
> > 2008-05-07 10:24:14,673 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region .META.,,1 is 0
> > 2008-05-07 10:24:14,681 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region .META.,,
> > 1/1028785192 available
> > 2008-05-07 10:24:14,686 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region -ROOT-,,0
> > 2008-05-07 10:24:14,686 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region -ROOT-,,0 disabled
> > 2008-05-07 10:24:14,686 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region -ROOT-,,0
> > 2008-05-07 10:24:14,686 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region -ROOT-,,0
> > 2008-05-07 10:24:14,687 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region -ROOT-,,0. Current region memcache size 93,0
> > 2008-05-07 10:24:14,739 INFO
> > org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop
> > library
> > 2008-05-07 10:24:14,740 INFO
> > org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded
> > & initialized native-zlib library
> > 2008-05-07 10:24:14,963 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Added /hbase/-ROOT-/
> > 70236052/info/mapfiles/5787712489651860883 with 1 entries, sequence
> > id 1, data size 93,0, file size 217,0
> > 2008-05-07 10:24:14,963 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region -ROOT-,,0 in 277ms, sequence id=1
> > 2008-05-07 10:24:14,964 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: closed 70236052/info
> > 2008-05-07 10:24:14,964 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed -ROOT-,,0
> > 2008-05-07 10:24:14,964 DEBUG
> > org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> > hdfs://nantes:54321/hbase/-ROOT-/70236052/log
> > 2008-05-07 10:24:15,027 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region .META.,,1
> > 2008-05-07 10:24:15,027 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region .META.,,1 disabled
> > 2008-05-07 10:24:15,027 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region .META.,,1
> > 2008-05-07 10:24:15,027 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region .META.,,1
> > 2008-05-07 10:24:15,027 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region .META.,,1. Current region memcache size 0,0
> > 2008-05-07 10:24:15,027 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region .META.,,1 in 0ms, sequence id=0
> > 2008-05-07 10:24:15,027 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: closed 1028785192/info
> > 2008-05-07 10:24:15,028 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed .META.,,1
> > 2008-05-07 10:24:15,028 DEBUG
> > org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> > hdfs://nantes:54321/hbase/.META./1028785192/log
> > 2008-05-07 10:24:15,113 INFO
> > org.apache.hadoop.ipc.metrics.RpcMetrics: Initializing RPC Metrics
> > with hostName=60000, port=60000
> > 2008-05-07 10:24:15,259 INFO
> > org.apache.hadoop.hbase.master.HMaster: HMaster initialized on
> > XXX.XX.40.36:60000
> > 2008-05-07 10:24:15,453 INFO org.mortbay.http.HttpServer: Version
> > Jetty/5.1.4
> > 2008-05-07 10:24:15,930 INFO org.mortbay.util.Credential: Checking
> > Resource aliases
> > 2008-05-07 10:24:15,949 INFO org.mortbay.util.Container: Started
> > org.mortbay.jetty.servlet.WebApplicationHandler@8691dee
> > 2008-05-07 10:24:15,974 INFO org.mortbay.util.Container: Started
> > WebApplicationContext[/,/]
> > 2008-05-07 10:24:16,433 INFO org.mortbay.util.Container: Started
> > org.mortbay.jetty.servlet.WebApplicationHandler@342798e7
> > 2008-05-07 10:24:16,434 INFO org.mortbay.util.Container: Started
> > WebApplicationContext[/api,rest]
> > 2008-05-07 10:24:16,434 INFO org.mortbay.util.Container: Started
> > HttpContext[/static,/static]
> > 2008-05-07 10:24:16,436 INFO org.mortbay.http.SocketListener:
> > Started SocketListener on 0.0.0.0:60010
> > 2008-05-07 10:24:16,436 INFO org.mortbay.util.Container: Started
> > org.mortbay.jetty.Server@7c65216
> > 2008-05-07 10:24:16,436 INFO org.apache.hadoop.ipc.Server: IPC
> > Server Responder: starting
> > 2008-05-07 10:24:16,437 INFO org.apache.hadoop.ipc.Server: IPC
> > Server listener on 60000: starting
> > 2008-05-07 10:24:16,445 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 0 on 60000: starting
> > 2008-05-07 10:24:16,448 INFO
> > org.apache.hadoop.hbase.master.ServerManager: received start
> > message from: XXX.XX.40.36:60020
> > 2008-05-07 10:24:16,477 INFO
> > org.apache.hadoop.hbase.master.ServerManager: received start
> > message from: XXX.XX.39.250:60020
> > 2008-05-07 10:24:16,478 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 1 on 60000: starting
> > 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 3 on 60000: starting
> > 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 4 on 60000: starting
> > 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 5 on 60000: starting
> > 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 6 on 60000: starting
> > 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 7 on 60000: starting
> > 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 8 on 60000: starting
> > 2008-05-07 10:24:16,479 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Started service threads
> > 2008-05-07 10:24:16,479 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Started service threads
> > 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 9 on 60000: starting
> > 2008-05-07 10:24:16,483 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 2 on 60000: starting
> > 2008-05-07 10:24:17,077 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region -
> > ROOT-,,0 to server XXX.XX.39.250:60020
> > 2008-05-07 10:24:17,450 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 0, Num
> > Servers: 2, Avg Load: 0.0
> > 2008-05-07 10:24:20,086 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : -ROOT-,,0 from XXX.XX.39.250:60020
> > 2008-05-07 10:24:20,086 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > serving -ROOT-,,0
> > 2008-05-07 10:24:20,086 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 1, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:24:20,087 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:24:20,146 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: ,
> startCode: 0
> > 2008-05-07 10:24:20,146 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner: Current assignment
> > of .META.,,1 is not valid: storedInfo: null, startCode: 0,
> > storedInfo.startCode: -1, unassignedRegions: false, pendingRegions:
> > false
> > 2008-05-07 10:24:20,148 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:24:20,456 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning
> > region .META.,,1 to server XXX.XX.40.36:60020
> > 2008-05-07 10:24:23,089 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 1, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:24:23,463 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : .META.,,1 from XXX.XX.40.36:60020
> > 2008-05-07 10:24:23,463 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.40.36:60020
> > serving .META.,,1
> > 2008-05-07 10:24:23,464 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:24:23,464 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.40.36:60020
> > 2008-05-07 10:24:23,465 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1:
> > regionname: .META.,,1, startKey: <>, endKey: <>, encodedName:
> > 1028785192, tableDesc: {name: .META., families: {info:={name: info,
> > max versions: 1, compression: NONE, in memory: false, block cache
> > enabled: false, max length: 2147483647, bloom filter: none}}} open
> > on XXX.XX.40.36:60020
> > 2008-05-07 10:24:23,466 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating
> > row .META.,,1 in table -ROOT-,,0 with startcode 1210148655841 and
> > server XXX.XX.40.36:60020
> > 2008-05-07 10:24:23,469 DEBUG
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: Adding to
> > onlineMetaRegions: {regionname: .META.,,1, startKey: <>, server:
> > XXX.XX.40.36:60020}
> > 2008-05-07 10:24:26,093 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > ...
> > 2008-05-07 10:25:14,191 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:25:14,570 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:25:15,265 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:25:15,277 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:25:15,277 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:25:17,196 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:25:17,577 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:25:20,153 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:25:20,169 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:25:20,171 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:25:20,204 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:25:20,584 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:25:23,211 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > ...
> > 2008-05-07 10:26:11,678 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:26:14,302 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:26:14,685 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:26:15,266 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:26:15,269 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:26:15,269 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:26:17,306 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:26:17,687 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:26:20,155 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:26:20,175 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:26:20,176 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:26:20,311 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:26:20,690 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:26:23,315 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > ...
> > 2008-05-07 10:27:11,787 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:27:14,416 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:27:14,792 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:27:15,270 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:27:15,272 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:27:15,272 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:27:17,421 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:27:17,799 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:27:20,158 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:27:20,174 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:27:20,175 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:27:20,428 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:27:20,802 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:27:23,433 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > ...
> > 2008-05-07 10:28:11,899 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:14,532 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:14,902 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:15,275 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:28:15,278 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:28:15,278 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:28:17,537 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:17,905 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:20,164 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:28:20,180 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:28:20,182 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:28:20,540 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:20,913 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:23,545 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:23,920 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:26,552 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:26,922 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:29,557 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:29,929 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:30,404 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> > encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> > {name: info, max versions: 1, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}
> > 2008-05-07 10:28:32,561 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:32,935 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:35,569 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:35,938 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:38,577 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:38,946 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:41,585 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:41,953 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:44,590 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:44,960 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:47,594 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:47,964 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:50,598 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:50,967 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:52,306 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:28:52,397 INFO
> > org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> > at /hbase/test1/1180168958/log/hlog.dat.1210148932380
> > 2008-05-07 10:28:52,397 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test1,,1210148932333/1180168958
> > 2008-05-07 10:28:52,398 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test1,,1210148932333 is 0
> > 2008-05-07 10:28:52,399 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test1,,1210148932333/1180168958 available
> > 2008-05-07 10:28:52,403 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test1,,1210148932333
> > 2008-05-07 10:28:52,403 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test1,,1210148932333 disabled
> > 2008-05-07 10:28:52,403 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test1,,1210148932333
> > 2008-05-07 10:28:52,403 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test1,,1210148932333
> > 2008-05-07 10:28:52,403 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test1,,1210148932333. Current region memcache size
> > 0,0
> > 2008-05-07 10:28:52,403 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test1,,1210148932333 in 0ms, sequence id=0
> > 2008-05-07 10:28:52,403 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test1,,1210148932333
> > 2008-05-07 10:28:52,403 DEBUG
> > org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> > hdfs://nantes:54321/hbase/test1/1180168958/log
> > 2008-05-07 10:28:52,446 INFO
> > org.apache.hadoop.hbase.master.HMaster: created table test1
> > 2008-05-07 10:28:52,448 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > reloading table servers because: No server address listed in .META.
> > for region test1,,1210148932333
> > 2008-05-07 10:28:52,448 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Removed .META.,,1 from cache because of test1,,999999999999999
> > 2008-05-07 10:28:52,450 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> > encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> > {name: info, max versions: 1, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}
> > 2008-05-07 10:28:56,610 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region
> > test1,,1210148932333 to server XXX.XX.39.250:60020
> > 2008-05-07 10:28:56,982 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:28:59,614 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_PROCESS_OPEN : test1,,1210148932333 from XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:28:59,614 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : test1,,1210148932333 from XXX.XX.39.250:60020
> > 2008-05-07 10:28:59,614 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > serving test1,,1210148932333
> > 2008-05-07 10:28:59,614 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.39.250:60020
> > 2008-05-07 10:28:59,614 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:28:59,614 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> > test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> > 1180168958, tableDesc: {name: test1, families: {}} open on XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:28:59,615 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:28:59,615 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> > test1,,1210148932333 in table .META.,,1 with startcode
> > 1210148655406 and server XXX.XX.39.250:60020
> > 2008-05-07 10:28:59,989 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:02,466 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName test1:
> > location server XXX.XX.39.250:60020, location region name
> > test1,,1210148932333
> > 2008-05-07 10:29:02,466 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:29:02,476 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing unserved
> > regions
> > 2008-05-07 10:29:02,478 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing regions
> > currently being served
> > 2008-05-07 10:29:02,478 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: adding region
> > test1,,1210148932333 to kill list
> > 2008-05-07 10:29:02,478 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: inserted local kill
> > list into kill list for server XXX.XX.39.250:60020
> > 2008-05-07 10:29:02,481 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> > region to be disabled from test1
> > 2008-05-07 10:29:02,622 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:02,992 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:05,627 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_CLOSE : test1,,1210148932333 from XXX.XX.39.250:60020
> > 2008-05-07 10:29:05,627 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > no longer serving regionname: test1,,1210148932333, startKey: <>,
> > endKey: <>, encodedName: 1180168958, tableDesc: {name: test1,
> > families: {}}
> > 2008-05-07 10:29:05,628 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:29:05,628 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > ProcessRegionClose of test1,,1210148932333, true, false
> > 2008-05-07 10:29:05,628 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionClose$1: region closed:
> > test1,,1210148932333
> > 2008-05-07 10:29:05,628 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:29:05,999 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:29:08,630 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:29:09,007 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:29:11,635 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:29:12,014 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:29:12,487 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> > region to be disabled from test1
> > 2008-05-07 10:29:12,489 INFO
> > org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table test1
> > 2008-05-07 10:29:12,494 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: updated columns in
> > row: test1,,1210148932333
> > 2008-05-07 10:29:12,498 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing unserved
> > regions
> > 2008-05-07 10:29:12,498 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: updating columns in
> > row: test1,,1210148932333
> > 2008-05-07 10:29:12,499 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: updated columns in
> > row: test1,,1210148932333
> > 2008-05-07 10:29:12,499 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing regions
> > currently being served
> > 2008-05-07 10:29:12,500 INFO
> > org.apache.hadoop.hbase.client.HBaseAdmin: Enabled table test1
> > 2008-05-07 10:29:12,511 DEBUG
> > org.apache.hadoop.hbase.client.HTable: reloading table servers
> > because: org.apache.hadoop.hbase.NotServingRegionException:
> > test1,,1210148932333
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1318)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1280)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> > (HRegionServer.java:1098)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke
> > (NativeMethodAccessorImpl.java:39)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke
> > (DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> > 413)
> > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> >
> > 2008-05-07 10:29:14,639 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region
> > test1,,1210148932333 to server XXX.XX.39.250:60020
> > 2008-05-07 10:29:15,020 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> > Servers: 2, Avg Load: 1.0
> > 2008-05-07 10:29:15,280 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:29:15,282 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> > 1180168958, tableDesc: {name: test1, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}}, server: , startCode: 0
> > 2008-05-07 10:29:15,283 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:29:15,283 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:29:17,643 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_PROCESS_OPEN : test1,,1210148932333 from XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:29:17,643 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : test1,,1210148932333 from XXX.XX.39.250:60020
> > 2008-05-07 10:29:17,643 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > serving test1,,1210148932333
> > 2008-05-07 10:29:17,644 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:17,644 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.39.250:60020
> > 2008-05-07 10:29:17,644 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> > test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> > 1180168958, tableDesc: {name: test1, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}} open on XXX.XX.39.250:60020
> > 2008-05-07 10:29:17,644 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:29:17,644 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> > test1,,1210148932333 in table .META.,,1 with startcode
> > 1210148655406 and server XXX.XX.39.250:60020
> > 2008-05-07 10:29:18,027 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:20,168 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:29:20,183 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:29:20,184 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:29:20,650 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:21,030 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:22,513 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Removed test1,,1210148932333 from cache because of 2000164.xml
> > 2008-05-07 10:29:23,656 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:24,036 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:26,664 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:26,680 INFO
> > org.apache.hadoop.hbase.demonstrator.LoadHandler: loadFile
> > finished, 100 files loaded into table test1
> > 2008-05-07 10:29:26,680 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:29:27,044 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:29,671 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:30,051 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:30,080 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:29:32,679 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:33,053 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:33,727 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:29:35,684 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:36,060 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:38,687 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:39,067 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:39,400 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:29:39,451 INFO
> > org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> > at /hbase/test2/949457082/log/hlog.dat.1210148979434
> > 2008-05-07 10:29:39,451 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test2,,1210148979403/949457082
> > 2008-05-07 10:29:39,452 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test2,,1210148979403 is 0
> > 2008-05-07 10:29:39,457 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test2,,1210148979403/949457082 available
> > 2008-05-07 10:29:39,458 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test2,,1210148979403
> > 2008-05-07 10:29:39,458 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test2,,1210148979403 disabled
> > 2008-05-07 10:29:39,458 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test2,,1210148979403
> > 2008-05-07 10:29:39,458 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test2,,1210148979403
> > 2008-05-07 10:29:39,458 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test2,,1210148979403. Current region memcache size
> > 0,0
> > 2008-05-07 10:29:39,458 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test2,,1210148979403 in 0ms, sequence id=0
> > 2008-05-07 10:29:39,458 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test2,,1210148979403
> > 2008-05-07 10:29:39,458 DEBUG
> > org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> > hdfs://nantes:54321/hbase/test2/949457082/log
> > 2008-05-07 10:29:39,501 INFO
> > org.apache.hadoop.hbase.master.HMaster: created table test2
> > 2008-05-07 10:29:39,502 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > reloading table servers because: No server address listed in .META.
> > for region test2,,1210148979403
> > 2008-05-07 10:29:39,502 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Removed .META.,,1 from cache because of test2,,999999999999999
> > 2008-05-07 10:29:39,504 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> > encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> > {name: info, max versions: 1, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}
> > 2008-05-07 10:29:44,696 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region
> > test2,,1210148979403 to server XXX.XX.39.250:60020
> > 2008-05-07 10:29:45,080 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:47,700 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_PROCESS_OPEN : test2,,1210148979403 from XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:29:47,700 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : test2,,1210148979403 from XXX.XX.39.250:60020
> > 2008-05-07 10:29:47,700 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > serving test2,,1210148979403
> > 2008-05-07 10:29:47,700 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.39.250:60020
> > 2008-05-07 10:29:47,700 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:47,701 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> > test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> > 949457082, tableDesc: {name: test2, families: {}} open on XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:29:47,701 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:29:47,701 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> > test2,,1210148979403 in table .META.,,1 with startcode
> > 1210148655406 and server XXX.XX.39.250:60020
> > 2008-05-07 10:29:48,082 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:49,518 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName test2:
> > location server XXX.XX.39.250:60020, location region name
> > test2,,1210148979403
> > 2008-05-07 10:29:49,518 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:29:49,523 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing unserved
> > regions
> > 2008-05-07 10:29:49,523 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing regions
> > currently being served
> > 2008-05-07 10:29:49,523 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: adding region
> > test2,,1210148979403 to kill list
> > 2008-05-07 10:29:49,523 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: inserted local kill
> > list into kill list for server XXX.XX.39.250:60020
> > 2008-05-07 10:29:49,524 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> > region to be disabled from test2
> > 2008-05-07 10:29:50,708 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:51,090 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:53,716 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_CLOSE : test2,,1210148979403 from XXX.XX.39.250:60020
> > 2008-05-07 10:29:53,716 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > no longer serving regionname: test2,,1210148979403, startKey: <>,
> > endKey: <>, encodedName: 949457082, tableDesc: {name: test2,
> > families: {}}
> > 2008-05-07 10:29:53,716 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > ProcessRegionClose of test2,,1210148979403, true, false
> > 2008-05-07 10:29:53,716 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:53,716 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionClose$1: region closed:
> > test2,,1210148979403
> > 2008-05-07 10:29:53,716 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:29:54,096 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:56,720 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:57,100 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:29:59,527 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> > region to be disabled from test2
> > 2008-05-07 10:29:59,529 INFO
> > org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table test2
> > 2008-05-07 10:29:59,532 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: updated columns in
> > row: test2,,1210148979403
> > 2008-05-07 10:29:59,536 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing unserved
> > regions
> > 2008-05-07 10:29:59,536 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: updating columns in
> > row: test2,,1210148979403
> > 2008-05-07 10:29:59,539 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: updated columns in
> > row: test2,,1210148979403
> > 2008-05-07 10:29:59,539 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing regions
> > currently being served
> > 2008-05-07 10:29:59,541 INFO
> > org.apache.hadoop.hbase.client.HBaseAdmin: Enabled table test2
> > 2008-05-07 10:29:59,547 DEBUG
> > org.apache.hadoop.hbase.client.HTable: reloading table servers
> > because: org.apache.hadoop.hbase.NotServingRegionException:
> > test2,,1210148979403
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1318)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1280)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> > (HRegionServer.java:1098)
> > at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke
> > (DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> > 413)
> > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> >
> > 2008-05-07 10:30:02,728 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region
> > test2,,1210148979403 to server XXX.XX.39.250:60020
> > 2008-05-07 10:30:03,112 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:05,733 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_PROCESS_OPEN : test2,,1210148979403 from XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:30:05,733 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : test2,,1210148979403 from XXX.XX.39.250:60020
> > 2008-05-07 10:30:05,733 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > serving test2,,1210148979403
> > 2008-05-07 10:30:05,733 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.39.250:60020
> > 2008-05-07 10:30:05,733 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:05,733 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> > test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> > 949457082, tableDesc: {name: test2, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}} open on XXX.XX.39.250:60020
> > 2008-05-07 10:30:05,733 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:30:05,733 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> > test2,,1210148979403 in table .META.,,1 with startcode
> > 1210148655406 and server XXX.XX.39.250:60020
> > 2008-05-07 10:30:06,116 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:08,736 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:09,119 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:09,553 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Removed test2,,1210148979403 from cache because of 2000164.xml
> > 2008-05-07 10:30:11,745 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:12,127 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:14,750 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:15,134 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:15,286 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:30:15,295 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> > 1180168958, tableDesc: {name: test1, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> > 2008-05-07 10:30:15,296 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> > 949457082, tableDesc: {name: test2, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> > 2008-05-07 10:30:15,297 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:30:15,297 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:30:17,753 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:18,142 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:20,176 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:30:20,207 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:30:20,213 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:30:20,758 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:21,147 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:21,598 INFO
> > org.apache.hadoop.hbase.demonstrator.LoadHandler: loadFile
> > finished, 100 files loaded into table test2
> > 2008-05-07 10:30:21,598 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:30:23,764 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:24,152 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:26,768 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:27,160 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:27,220 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:30:28,644 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:30:29,776 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:30,167 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:32,784 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:33,174 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:34,975 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:30:35,049 INFO
> > org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> > at /hbase/test3/1505113011/log/hlog.dat.1210149035032
> > 2008-05-07 10:30:35,049 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test3,,1210149034978/1505113011
> > 2008-05-07 10:30:35,050 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test3,,1210149034978 is 0
> > 2008-05-07 10:30:35,051 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test3,,1210149034978/1505113011 available
> > 2008-05-07 10:30:35,052 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test3,,1210149034978
> > 2008-05-07 10:30:35,052 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test3,,1210149034978 disabled
> > 2008-05-07 10:30:35,052 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test3,,1210149034978
> > 2008-05-07 10:30:35,052 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test3,,1210149034978
> > 2008-05-07 10:30:35,052 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test3,,1210149034978. Current region memcache size
> > 0,0
> > 2008-05-07 10:30:35,052 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test3,,1210149034978 in 0ms, sequence id=0
> > 2008-05-07 10:30:35,052 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test3,,1210149034978
> > 2008-05-07 10:30:35,052 DEBUG
> > org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> > hdfs://nantes:54321/hbase/test3/1505113011/log
> > 2008-05-07 10:30:35,090 INFO
> > org.apache.hadoop.hbase.master.HMaster: created table test3
> > 2008-05-07 10:30:35,091 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > reloading table servers because: No server address listed in .META.
> > for region test3,,1210149034978
> > 2008-05-07 10:30:35,091 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Removed .META.,,1 from cache because of test3,,999999999999999
> > 2008-05-07 10:30:35,093 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> > encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> > {name: info, max versions: 1, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}
> > 2008-05-07 10:30:38,797 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region
> > test3,,1210149034978 to server XXX.XX.39.250:60020
> > 2008-05-07 10:30:39,180 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:41,801 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_PROCESS_OPEN : test3,,1210149034978 from XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:30:41,801 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : test3,,1210149034978 from XXX.XX.39.250:60020
> > 2008-05-07 10:30:41,802 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > serving test3,,1210149034978
> > 2008-05-07 10:30:41,802 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.39.250:60020
> > 2008-05-07 10:30:41,802 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> > test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> > 1505113011, tableDesc: {name: test3, families: {}} open on XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:30:41,802 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:30:41,802 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> > test3,,1210149034978 in table .META.,,1 with startcode
> > 1210148655406 and server XXX.XX.39.250:60020
> > 2008-05-07 10:30:41,802 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:30:41,802 DEBUG
> > org.apache.hadoop.hbase.master.RegionManager: Server XXX.XX.
> > 39.250:60020 is overloaded. Server load: 4 avg: 3.0
> > 2008-05-07 10:30:41,802 DEBUG
> > org.apache.hadoop.hbase.master.RegionManager: Choosing to reassign
> > 1 regions. mostLoadedRegions has 4 regions in it.
> > 2008-05-07 10:30:41,803 DEBUG
> > org.apache.hadoop.hbase.master.RegionManager: Going to close region
> > test3,,1210149034978
> > 2008-05-07 10:30:42,188 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:30:44,809 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_CLOSE : test3,,1210149034978 from XXX.XX.39.250:60020
> > 2008-05-07 10:30:44,809 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > no longer serving regionname: test3,,1210149034978, startKey: <>,
> > endKey: <>, encodedName: 1505113011, tableDesc: {name: test3,
> > families: {}}
> > 2008-05-07 10:30:45,103 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName test3:
> > location server XXX.XX.39.250:60020, location region name
> > test3,,1210149034978
> > 2008-05-07 10:30:45,103 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:30:45,108 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing unserved
> > regions
> > 2008-05-07 10:30:45,108 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: processing regions
> > currently being served
> > 2008-05-07 10:30:45,108 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: adding region
> > test3,,1210149034978 to kill list
> > 2008-05-07 10:30:45,108 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation: inserted local kill
> > list into kill list for server XXX.XX.39.250:60020
> > 2008-05-07 10:30:45,110 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:30:47,813 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region
> > test3,,1210149034978 to server XXX.XX.39.250:60020
> > 2008-05-07 10:30:48,199 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:50,818 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_PROCESS_OPEN : test3,,1210149034978 from XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:30:50,818 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : test3,,1210149034978 from XXX.XX.39.250:60020
> > 2008-05-07 10:30:50,818 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > serving test3,,1210149034978
> > 2008-05-07 10:30:50,818 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.39.250:60020
> > 2008-05-07 10:30:50,818 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> > test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> > 1505113011, tableDesc: {name: test3, families: {}} open on XXX.XX.
> > 39.250:60020
> > 2008-05-07 10:30:50,818 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:30:50,818 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> > test3,,1210149034978 in table .META.,,1 with startcode
> > 1210148655406 and server XXX.XX.39.250:60020
> > 2008-05-07 10:30:50,819 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:30:50,819 DEBUG
> > org.apache.hadoop.hbase.master.RegionManager: Server XXX.XX.
> > 39.250:60020 is overloaded. Server load: 4 avg: 3.0
> > 2008-05-07 10:30:50,819 DEBUG
> > org.apache.hadoop.hbase.master.RegionManager: Choosing to reassign
> > 1 regions. mostLoadedRegions has 4 regions in it.
> > 2008-05-07 10:30:50,819 INFO
> > org.apache.hadoop.hbase.master.RegionManager: Skipping region
> > test3,,1210149034978 because it is already closing.
> > 2008-05-07 10:30:50,819 DEBUG
> > org.apache.hadoop.hbase.master.RegionManager: Going to close region
> > test2,,1210148979403
> > 2008-05-07 10:30:51,206 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:30:53,826 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_CLOSE : test2,,1210148979403 from XXX.XX.39.250:60020
> > 2008-05-07 10:30:53,826 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> > no longer serving regionname: test2,,1210148979403, startKey: <>,
> > endKey: <>, encodedName: 949457082, tableDesc: {name: test2,
> > families: {document:={name: document, max versions: 3, compression:
> > NONE, in memory: false, block cache enabled: false, max length:
> > 2147483647, bloom filter: none}}}
> > 2008-05-07 10:30:54,214 INFO
> > org.apache.hadoop.hbase.master.RegionManager: assigning region
> > test2,,1210148979403 to server XXX.XX.40.36:60020
> > 2008-05-07 10:30:55,114 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:30:55,116 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:30:56,829 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> > Servers: 2, Avg Load: 2.0
> > 2008-05-07 10:30:57,217 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_PROCESS_OPEN : test2,,1210148979403 from
> XXX.XX.40.36:60020
> > 2008-05-07 10:30:57,218 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Received
> > MSG_REPORT_OPEN : test2,,1210148979403 from XXX.XX.40.36:60020
> > 2008-05-07 10:30:57,218 INFO
> > org.apache.hadoop.hbase.master.ServerManager: XXX.XX.40.36:60020
> > serving test2,,1210148979403
> > 2008-05-07 10:30:57,218 DEBUG
> > org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> > PendingOpenOperation from XXX.XX.40.36:60020
> > 2008-05-07 10:30:57,218 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:30:57,218 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> > test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> > 949457082, tableDesc: {name: test2, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}} open on XXX.XX.40.36:60020
> > 2008-05-07 10:30:57,218 DEBUG
> > org.apache.hadoop.hbase.master.RegionServerOperation:
> > numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> > 2008-05-07 10:30:57,218 INFO
> > org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> > test2,,1210148979403 in table .META.,,1 with startcode
> > 1210148655841 and server XXX.XX.40.36:60020
> > 2008-05-07 10:30:59,834 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:00,225 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:02,838 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:03,240 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:05,124 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:31:05,126 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:31:05,843 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:06,246 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:08,846 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:09,250 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:11,850 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:12,254 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:14,858 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:15,132 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:31:15,135 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:31:15,258 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:15,289 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:31:15,291 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> > 1180168958, tableDesc: {name: test1, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> > 2008-05-07 10:31:15,292 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> > 949457082, tableDesc: {name: test2, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}}, server: XXX.XX.40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:31:15,292 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> > 1505113011, tableDesc: {name: test3, families: {}}}, server: XXX.XX.
> > 39.250:60020, startCode: 1210148655406
> > 2008-05-07 10:31:15,293 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:31:15,293 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:31:17,862 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:18,265 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:20,177 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:31:20,192 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:31:20,194 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:31:20,867 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:21,272 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:23,872 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:24,275 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:25,138 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:31:25,140 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:31:26,878 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:27,282 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:29,892 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:30,289 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:32,899 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:33,296 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:35,145 DEBUG
> > org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> > region to be disabled from test3
> > 2008-05-07 10:31:35,145 INFO
> > org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table test3
> > 2008-05-07 10:31:35,904 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:36,299 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:38,912 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:39,306 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:41,916 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:42,313 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:44,920 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:45,316 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:47,924 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:48,319 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:50,936 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:51,327 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:53,940 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:54,334 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:56,946 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:57,337 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:31:59,954 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:00,340 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:02,957 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:03,346 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:05,965 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:06,353 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:08,973 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:09,360 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:11,977 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:12,367 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:14,997 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:15,178 DEBUG
> > org.apache.hadoop.hbase.master.TableOperation
> > $ProcessTableOperation: Trying to contact region server for
> > regionName '.META.,,1', but failed after 5 attempts.
> > Exception 1:
> > org.apache.hadoop.hbase.TableNotDisabledException: test3Exception 1:
> > org.apache.hadoop.hbase.TableNotDisabledException: test3Exception 1:
> > org.apache.hadoop.hbase.TableNotDisabledException: test3Exception 1:
> > org.apache.hadoop.hbase.TableNotDisabledException: test3
> > 2008-05-07 10:32:15,180 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 9 on 60000, call addColumn(test3, {name: document,
> > max versions: 3, compression: NONE, in memory: false, block cache
> > enabled: false, max length: 2147483647, bloom filter: none}) from
> > XXX.XX.40.36:33086: error:
> > org.apache.hadoop.hbase.TableNotDisabledException: test3
> > org.apache.hadoop.hbase.TableNotDisabledException: test3
> > at
> org.apache.hadoop.hbase.master.ColumnOperation.processScanItem
> > (ColumnOperation.java:43)
> > at org.apache.hadoop.hbase.master.TableOperation
> > $ProcessTableOperation.call(TableOperation.java:120)
> > at org.apache.hadoop.hbase.master.TableOperation
> > $ProcessTableOperation.call(TableOperation.java:84)
> > at
> > org.apache.hadoop.hbase.master.RetryableMetaOperation.doWithRetries
> > (RetryableMetaOperation.java:59)
> > at org.apache.hadoop.hbase.master.TableOperation.process
> > (TableOperation.java:158)
> > at
> org.apache.hadoop.hbase.master.HMaster.addColumn(HMaster.java:650)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke
> > (NativeMethodAccessorImpl.java:39)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke
> > (DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:585)
> > at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> > 413)
> > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> >
> > 2008-05-07 10:32:15,181 DEBUG
> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> > Cache hit in table locations for row <> and tableName .META.:
> > location server XXX.XX.40.36:60020, location region name .META.,,1
> > 2008-05-07 10:32:15,296 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scanning meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020}
> > 2008-05-07 10:32:15,298 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> > 1180168958, tableDesc: {name: test1, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> > 2008-05-07 10:32:15,300 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> > 949457082, tableDesc: {name: test2, families: {document:={name:
> > document, max versions: 3, compression: NONE, in memory: false,
> > block cache enabled: false, max length: 2147483647, bloom filter:
> > none}}}}, server: XXX.XX.40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:32:15,301 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner regioninfo: {regionname:
> > test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> > 1505113011, tableDesc: {name: test3, families: {}}}, server: XXX.XX.
> > 39.250:60020, startCode: 1210148655406
> > 2008-05-07 10:32:15,302 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.metaScanner scan of meta region {regionname: .META.,,
> > 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> > 2008-05-07 10:32:15,302 INFO
> > org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> > 2008-05-07 10:32:15,373 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:18,003 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:18,380 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:20,180 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020}
> > 2008-05-07 10:32:20,195 DEBUG
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> > startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> > {name: .META., families: {info:={name: info, max versions: 1,
> > compression: NONE, in memory: false, block cache enabled: false,
> > max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> > 40.36:60020, startCode: 1210148655841
> > 2008-05-07 10:32:20,196 INFO
> > org.apache.hadoop.hbase.master.BaseScanner:
> > RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> > 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> > 2008-05-07 10:32:21,005 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > 2008-05-07 10:32:21,387 DEBUG
> > org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> > Servers: 2, Avg Load: 3.0
> > ...2008-05-07 10:24:15,357 INFO
> > org.apache.hadoop.ipc.metrics.RpcMetrics: Initializing RPC Metrics
> > with hostName=60020, port=60020
> > 2008-05-07 10:24:15,410 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Telling master
> > at nantes:60000 that we are up
> > 2008-05-07 10:24:16,550 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Done telling
> > master we are up
> > 2008-05-07 10:24:16,550 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Config from
> > master: fs.default.name=hdfs://nantes:54321/hbase
> > 2008-05-07 10:24:16,550 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Config from
> > master: hbase.rootdir=hdfs://nantes:54321/hbase
> > 2008-05-07 10:24:16,647 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegionServer: Log dir hdfs://
> > nantes:54321/hbase/log_XXX.XX.39.250_1210148655406_60020
> > 2008-05-07 10:24:16,744 INFO
> > org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> > at
> /hbase/log_XXX.XX.39.250_1210148655406_60020/hlog.dat.1210148656697
> > 2008-05-07 10:24:16,821 INFO org.mortbay.http.HttpServer: Version
> > Jetty/5.1.4
> > 2008-05-07 10:24:16,822 INFO org.mortbay.util.Container: Started
> > HttpContext[/static,/static]
> > 2008-05-07 10:24:17,095 INFO org.mortbay.util.Credential: Checking
> > Resource aliases
> > 2008-05-07 10:24:17,112 INFO org.mortbay.util.Container: Started
> > org.mortbay.jetty.servlet.WebApplicationHandler@794e113b
> > 2008-05-07 10:24:17,139 INFO org.mortbay.util.Container: Started
> > WebApplicationContext[/,/]
> > 2008-05-07 10:24:17,141 INFO org.mortbay.http.SocketListener:
> > Started SocketListener on 0.0.0.0:60030
> > 2008-05-07 10:24:17,141 INFO org.mortbay.util.Container: Started
> > org.mortbay.jetty.Server@421fbfd6
> > 2008-05-07 10:24:17,141 INFO org.apache.hadoop.ipc.Server: IPC
> > Server Responder: starting
> > 2008-05-07 10:24:17,142 INFO org.apache.hadoop.ipc.Server: IPC
> > Server listener on 60020: starting
> > 2008-05-07 10:24:17,142 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 0 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 1 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 2 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 3 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 4 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 5 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 6 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 7 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 8 on 60020: starting
> > 2008-05-07 10:24:17,143 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer: HRegionServer
> > started at: XXX.XX.39.250:60020
> > 2008-05-07 10:24:17,145 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 9 on 60020: starting
> > 2008-05-07 10:24:17,151 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : -ROOT-,,0
> > 2008-05-07 10:24:17,158 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region -
> > ROOT-,,0/70236052
> > 2008-05-07 10:24:17,226 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: loaded /hbase/-ROOT-/
> > 70236052/info/info/5787712489651860883, isReference=false, sequence
> > id=1
> > 2008-05-07 10:24:17,241 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Loaded 1 file(s) in
> > hstore 70236052/info, max sequence id 1
> > 2008-05-07 10:24:17,278 INFO
> > org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop
> > library
> > 2008-05-07 10:24:17,279 INFO
> > org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded
> > & initialized native-zlib library
> > 2008-05-07 10:24:17,290 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region -ROOT-,,0 is 2
> > 2008-05-07 10:24:17,297 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region -ROOT-,,
> > 0/70236052 available
> > 2008-05-07 10:24:17,297 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: -ROOT-,,0
> > 2008-05-07 10:24:17,297 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region -ROOT-,,0
> > 2008-05-07 10:24:17,297 DEBUG
> > org.apache.hadoop.hbase.regionserver.HLog: changing sequence number
> > from 0 to 2
> > 2008-05-07 10:24:17,300 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region -ROOT-,,0 in 0sec
> > 2008-05-07 10:28:56,680 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test1,,1210148932333
> > 2008-05-07 10:28:56,681 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test1,,1210148932333/1180168958
> > 2008-05-07 10:28:56,683 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test1,,1210148932333 is 0
> > 2008-05-07 10:28:56,690 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test1,,1210148932333/1180168958 available
> > 2008-05-07 10:28:56,690 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test1,,1210148932333
> > 2008-05-07 10:28:56,690 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test1,,1210148932333
> > 2008-05-07 10:28:56,693 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test1,,1210148932333 in 0sec
> > 2008-05-07 10:29:02,692 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_CLOSE : test1,,1210148932333
> > 2008-05-07 10:29:02,692 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test1,,1210148932333
> > 2008-05-07 10:29:02,693 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test1,,1210148932333 disabled
> > 2008-05-07 10:29:02,693 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test1,,1210148932333
> > 2008-05-07 10:29:02,693 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test1,,1210148932333
> > 2008-05-07 10:29:02,693 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test1,,1210148932333. Current region memcache size
> > 0,0
> > 2008-05-07 10:29:02,693 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test1,,1210148932333 in 0ms, sequence id=4
> > 2008-05-07 10:29:02,693 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test1,,1210148932333
> > 2008-05-07 10:29:12,578 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 9 on 60020, call batchUpdate(test1,,1210148932333,
> > org.apache.hadoop.hbase.io.BatchUpdate@756f70a4) from XXX.XX.
> > 40.36:58851: error:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > test1,,1210148932333
> > org.apache.hadoop.hbase.NotServingRegionException:
> > test1,,1210148932333
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1318)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1280)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> > (HRegionServer.java:1098)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke
> > (NativeMethodAccessorImpl.java:39)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke
> > (DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> > 413)
> > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> > 2008-05-07 10:29:14,708 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test1,,1210148932333
> > 2008-05-07 10:29:14,709 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test1,,1210148932333/1180168958
> > 2008-05-07 10:29:14,763 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> > hstore 1180168958/document, max sequence id -1
> > 2008-05-07 10:29:14,764 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test1,,1210148932333 is 0
> > 2008-05-07 10:29:14,767 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test1,,1210148932333/1180168958 available
> > 2008-05-07 10:29:14,767 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test1,,1210148932333
> > 2008-05-07 10:29:14,767 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test1,,1210148932333
> > 2008-05-07 10:29:14,769 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test1,,1210148932333 in 0sec
> > 2008-05-07 10:29:44,764 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test2,,1210148979403
> > 2008-05-07 10:29:44,765 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test2,,1210148979403/949457082
> > 2008-05-07 10:29:44,767 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test2,,1210148979403 is 0
> > 2008-05-07 10:29:44,769 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test2,,1210148979403/949457082 available
> > 2008-05-07 10:29:44,770 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test2,,1210148979403
> > 2008-05-07 10:29:44,770 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test2,,1210148979403
> > 2008-05-07 10:29:44,772 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test2,,1210148979403 in 0sec
> > 2008-05-07 10:29:50,776 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_CLOSE : test2,,1210148979403
> > 2008-05-07 10:29:50,776 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test2,,1210148979403
> > 2008-05-07 10:29:50,776 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test2,,1210148979403 disabled
> > 2008-05-07 10:29:50,776 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test2,,1210148979403
> > 2008-05-07 10:29:50,776 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test2,,1210148979403
> > 2008-05-07 10:29:50,776 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test2,,1210148979403. Current region memcache size
> > 0,0
> > 2008-05-07 10:29:50,777 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test2,,1210148979403 in 1ms, sequence id=105
> > 2008-05-07 10:29:50,777 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test2,,1210148979403
> > 2008-05-07 10:29:59,614 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 8 on 60020, call batchUpdate(test2,,1210148979403,
> > org.apache.hadoop.hbase.io.BatchUpdate@7d5dc37d) from XXX.XX.
> > 40.36:58907: error:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > test2,,1210148979403
> > org.apache.hadoop.hbase.NotServingRegionException:
> > test2,,1210148979403
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1318)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1280)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> > (HRegionServer.java:1098)
> > at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke
> > (DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> > 413)
> > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> > 2008-05-07 10:30:02,796 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test2,,1210148979403
> > 2008-05-07 10:30:02,797 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test2,,1210148979403/949457082
> > 2008-05-07 10:30:02,844 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> > hstore 949457082/document, max sequence id -1
> > 2008-05-07 10:30:02,846 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test2,,1210148979403 is 0
> > 2008-05-07 10:30:02,848 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test2,,1210148979403/949457082 available
> > 2008-05-07 10:30:02,848 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test2,,1210148979403
> > 2008-05-07 10:30:02,848 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test2,,1210148979403
> > 2008-05-07 10:30:02,850 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test2,,1210148979403 in 0sec
> > 2008-05-07 10:30:38,864 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test3,,1210149034978
> > 2008-05-07 10:30:38,865 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test3,,1210149034978/1505113011
> > 2008-05-07 10:30:38,867 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test3,,1210149034978 is 0
> > 2008-05-07 10:30:38,869 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test3,,1210149034978/1505113011 available
> > 2008-05-07 10:30:38,869 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test3,,1210149034978
> > 2008-05-07 10:30:38,869 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test3,,1210149034978
> > 2008-05-07 10:30:38,871 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test3,,1210149034978 in 0sec
> > 2008-05-07 10:30:41,870 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_CLOSE : test3,,1210149034978
> > 2008-05-07 10:30:41,870 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test3,,1210149034978
> > 2008-05-07 10:30:41,870 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test3,,1210149034978 disabled
> > 2008-05-07 10:30:41,870 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test3,,1210149034978
> > 2008-05-07 10:30:41,870 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test3,,1210149034978
> > 2008-05-07 10:30:41,870 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test3,,1210149034978. Current region memcache size
> > 0,0
> > 2008-05-07 10:30:41,870 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test3,,1210149034978 in 0ms, sequence id=206
> > 2008-05-07 10:30:41,870 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test3,,1210149034978
> > 2008-05-07 10:30:47,880 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_CLOSE : test3,,1210149034978
> > 2008-05-07 10:30:47,880 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test3,,1210149034978
> > 2008-05-07 10:30:47,881 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test3,,1210149034978/1505113011
> > 2008-05-07 10:30:47,883 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test3,,1210149034978 is 0
> > 2008-05-07 10:30:47,885 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test3,,1210149034978/1505113011 available
> > 2008-05-07 10:30:47,885 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test3,,1210149034978
> > 2008-05-07 10:30:47,885 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test3,,1210149034978
> > 2008-05-07 10:30:47,887 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test3,,1210149034978 in 0sec
> > 2008-05-07 10:30:50,886 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_CLOSE : test2,,1210148979403
> > 2008-05-07 10:30:50,886 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test2,,1210148979403
> > 2008-05-07 10:30:50,886 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test2,,1210148979403 disabled
> > 2008-05-07 10:30:50,886 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test2,,1210148979403
> > 2008-05-07 10:30:50,886 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test2,,1210148979403
> > 2008-05-07 10:30:50,886 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test2,,1210148979403. Current region memcache size
> > 1,5m
> > 2008-05-07 10:30:51,109 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Added /hbase/
> > test2/949457082/document/mapfiles/4703355206274213543 with 100
> > entries, sequence id 207, data size 1,5m, file size 1,5m
> > 2008-05-07 10:30:51,109 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test2,,1210148979403 in 223ms, sequence id=207
> > 2008-05-07 10:30:51,110 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: closed
> 949457082/document
> > 2008-05-07 10:30:51,110 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test2,,1210148979403
> > 2008-05-07 10:32:54,130 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test4,,1210149169246
> > 2008-05-07 10:32:54,130 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test4,,1210149169246/1639067551
> > 2008-05-07 10:32:54,133 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test4,,1210149169246 is 0
> > 2008-05-07 10:32:54,135 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test4,,1210149169246/1639067551 available
> > 2008-05-07 10:32:54,135 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test4,,1210149169246
> > 2008-05-07 10:32:54,135 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test4,,1210149169246
> > 2008-05-07 10:32:54,137 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test4,,1210149169246 in 0sec
> > 2008-05-07 10:32:57,137 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_CLOSE : test4,,1210149169246
> > 2008-05-07 10:32:57,137 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> > flushes disabled for region test4,,1210149169246
> > 2008-05-07 10:32:57,137 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> > for region test4,,1210149169246 disabled
> > 2008-05-07 10:32:57,137 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more active
> > scanners for region test4,,1210149169246
> > 2008-05-07 10:32:57,137 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> > outstanding on region test4,,1210149169246
> > 2008-05-07 10:32:57,137 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> > flush for region test4,,1210149169246. Current region memcache size
> > 0,0
> > 2008-05-07 10:32:57,137 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> > flush for region test4,,1210149169246 in 0ms, sequence id=208
> > 2008-05-07 10:32:57,138 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: closed
> > test4,,1210149169246
> > 2008-05-07 10:33:00,147 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_CLOSE : test4,,1210149169246
> > 2008-05-07 10:33:09,467 INFO org.apache.hadoop.ipc.Server: IPC
> > Server handler 5 on 60020, call batchUpdate(test4,,1210149169246,
> > org.apache.hadoop.hbase.io.BatchUpdate@20dccfab) from XXX.XX.
> > 40.36:43007: error:
> > org.apache.hadoop.hbase.NotServingRegionException:
> > test4,,1210149169246
> > org.apache.hadoop.hbase.NotServingRegionException:
> > test4,,1210149169246
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1318)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> > (HRegionServer.java:1280)
> > at
> org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> > (HRegionServer.java:1098)
> > at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke
> > (DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> > 413)
> > at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> > 2008-05-07 10:33:12,168 INFO
> > org.apache.hadoop.hbase.regionserver.HRegionServer:
> > MSG_REGION_OPEN : test4,,1210149169246
> > 2008-05-07 10:33:12,168 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> > test4,,1210149169246/1639067551
> > 2008-05-07 10:33:12,218 DEBUG
> > org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> > hstore 1639067551/document, max sequence id -1
> > 2008-05-07 10:33:12,220 DEBUG
> > org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> > region test4,,1210149169246 is 0
> > 2008-05-07 10:33:12,222 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: region
> > test4,,1210149169246/1639067551 available
> > 2008-05-07 10:33:12,222 DEBUG
> > org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> > requested for region: test4,,1210149169246
> > 2008-05-07 10:33:12,222 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> > on region test4,,1210149169246
> > 2008-05-07 10:33:12,224 INFO
> > org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> > on region test4,,1210149169246 in 0sec
> > ...
>
>
> No virus found in this incoming message.
> Checked by AVG.
> Version: 7.5.524 / Virus Database: 269.23.9/1419 - Release
> Date: 5/7/2008 7:46 AM
>
>
No virus found in this outgoing message.
Checked by AVG.
Version: 7.5.524 / Virus Database: 269.23.9/1419 - Release Date: 5/7/2008 7:46 AM
Re: TableNotDisabledException - is it HBASE-478?
Posted by Bryan Duxbury <br...@rapleaf.com>.
It seems to me like it could be a case of HBASE-478. Usually it takes
a bigger table to cause issues though. If you create the table with
the column family to start with instead of adding after the table is
created, do you still have this problem?
Another possible issue here is HBASE-615. It's unlikely that the
oscillation Jim saw is only during startup, so perhaps with the right
arrangement of number of nodes and number of regions, you're also
seeing oscillation.
-Bryan
On May 7, 2008, at 4:36 AM, Michaela Buergle wrote:
> Hi all,
> I am performing the following simple steps:
> - create an HBase table
> - add a column family
> - put some content in that column (only 100 rows/1 col for testing)
>
> Roughly once every 5 tries, I don't succeed - I get a
> "TableNotDisabledException" when I try to add the column family. It
> seems that immediately before the problem occurs, regions are
> reassigned
> because one server is loaded above the average value.
>
> Can that be connected to HBASE-487?
>
> I use the TRUNK version (from 1 or 2 days ago) with 2 nodes. I've
> attached parts of the master's and concerned regionserver's logs:
> Three tables are created (hbase-master.log: test1 l.160, test2 l.264,
> test3 l.370). After create table for "test3", the load balancing
> occurs.
> There is some waiting to disable the test3 region, in l.478 the
> information that test3 has been disabled and in l.507 the
> TableNotDisabledException thrown by addColumn.
>
> micha
> 2008-05-07 10:24:14,123 INFO
> org.apache.hadoop.hbase.master.HMaster: Root region dir: hdfs://
> nantes:54321/hbase/-ROOT-/70236052
> 2008-05-07 10:24:14,355 INFO
> org.apache.hadoop.hbase.master.HMaster: bootstrap: creating ROOT
> and first META regions
> 2008-05-07 10:24:14,415 INFO
> org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> at /hbase/-ROOT-/70236052/log/hlog.dat.1210148654388
> 2008-05-07 10:24:14,416 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region -
> ROOT-,,0/70236052
> 2008-05-07 10:24:14,471 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> hstore 70236052/info, max sequence id -1
> 2008-05-07 10:24:14,473 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region -ROOT-,,0 is 0
> 2008-05-07 10:24:14,475 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region -ROOT-,,
> 0/70236052 available
> 2008-05-07 10:24:14,529 INFO
> org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> at /hbase/.META./1028785192/log/hlog.dat.1210148654512
> 2008-05-07 10:24:14,530 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening
> region .META.,,1/1028785192
> 2008-05-07 10:24:14,671 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> hstore 1028785192/info, max sequence id -1
> 2008-05-07 10:24:14,673 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region .META.,,1 is 0
> 2008-05-07 10:24:14,681 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region .META.,,
> 1/1028785192 available
> 2008-05-07 10:24:14,686 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region -ROOT-,,0
> 2008-05-07 10:24:14,686 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region -ROOT-,,0 disabled
> 2008-05-07 10:24:14,686 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region -ROOT-,,0
> 2008-05-07 10:24:14,686 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region -ROOT-,,0
> 2008-05-07 10:24:14,687 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region -ROOT-,,0. Current region memcache size 93,0
> 2008-05-07 10:24:14,739 INFO
> org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop
> library
> 2008-05-07 10:24:14,740 INFO
> org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded
> & initialized native-zlib library
> 2008-05-07 10:24:14,963 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Added /hbase/-ROOT-/
> 70236052/info/mapfiles/5787712489651860883 with 1 entries, sequence
> id 1, data size 93,0, file size 217,0
> 2008-05-07 10:24:14,963 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region -ROOT-,,0 in 277ms, sequence id=1
> 2008-05-07 10:24:14,964 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: closed 70236052/info
> 2008-05-07 10:24:14,964 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed -ROOT-,,0
> 2008-05-07 10:24:14,964 DEBUG
> org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> hdfs://nantes:54321/hbase/-ROOT-/70236052/log
> 2008-05-07 10:24:15,027 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region .META.,,1
> 2008-05-07 10:24:15,027 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region .META.,,1 disabled
> 2008-05-07 10:24:15,027 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region .META.,,1
> 2008-05-07 10:24:15,027 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region .META.,,1
> 2008-05-07 10:24:15,027 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region .META.,,1. Current region memcache size 0,0
> 2008-05-07 10:24:15,027 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region .META.,,1 in 0ms, sequence id=0
> 2008-05-07 10:24:15,027 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: closed 1028785192/info
> 2008-05-07 10:24:15,028 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed .META.,,1
> 2008-05-07 10:24:15,028 DEBUG
> org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> hdfs://nantes:54321/hbase/.META./1028785192/log
> 2008-05-07 10:24:15,113 INFO
> org.apache.hadoop.ipc.metrics.RpcMetrics: Initializing RPC Metrics
> with hostName=60000, port=60000
> 2008-05-07 10:24:15,259 INFO
> org.apache.hadoop.hbase.master.HMaster: HMaster initialized on
> XXX.XX.40.36:60000
> 2008-05-07 10:24:15,453 INFO org.mortbay.http.HttpServer: Version
> Jetty/5.1.4
> 2008-05-07 10:24:15,930 INFO org.mortbay.util.Credential: Checking
> Resource aliases
> 2008-05-07 10:24:15,949 INFO org.mortbay.util.Container: Started
> org.mortbay.jetty.servlet.WebApplicationHandler@8691dee
> 2008-05-07 10:24:15,974 INFO org.mortbay.util.Container: Started
> WebApplicationContext[/,/]
> 2008-05-07 10:24:16,433 INFO org.mortbay.util.Container: Started
> org.mortbay.jetty.servlet.WebApplicationHandler@342798e7
> 2008-05-07 10:24:16,434 INFO org.mortbay.util.Container: Started
> WebApplicationContext[/api,rest]
> 2008-05-07 10:24:16,434 INFO org.mortbay.util.Container: Started
> HttpContext[/static,/static]
> 2008-05-07 10:24:16,436 INFO org.mortbay.http.SocketListener:
> Started SocketListener on 0.0.0.0:60010
> 2008-05-07 10:24:16,436 INFO org.mortbay.util.Container: Started
> org.mortbay.jetty.Server@7c65216
> 2008-05-07 10:24:16,436 INFO org.apache.hadoop.ipc.Server: IPC
> Server Responder: starting
> 2008-05-07 10:24:16,437 INFO org.apache.hadoop.ipc.Server: IPC
> Server listener on 60000: starting
> 2008-05-07 10:24:16,445 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 0 on 60000: starting
> 2008-05-07 10:24:16,448 INFO
> org.apache.hadoop.hbase.master.ServerManager: received start
> message from: XXX.XX.40.36:60020
> 2008-05-07 10:24:16,477 INFO
> org.apache.hadoop.hbase.master.ServerManager: received start
> message from: XXX.XX.39.250:60020
> 2008-05-07 10:24:16,478 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 1 on 60000: starting
> 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 3 on 60000: starting
> 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 4 on 60000: starting
> 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 5 on 60000: starting
> 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 6 on 60000: starting
> 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 7 on 60000: starting
> 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 8 on 60000: starting
> 2008-05-07 10:24:16,479 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Started service threads
> 2008-05-07 10:24:16,479 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Started service threads
> 2008-05-07 10:24:16,479 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 9 on 60000: starting
> 2008-05-07 10:24:16,483 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 2 on 60000: starting
> 2008-05-07 10:24:17,077 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region -
> ROOT-,,0 to server XXX.XX.39.250:60020
> 2008-05-07 10:24:17,450 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 0, Num
> Servers: 2, Avg Load: 0.0
> 2008-05-07 10:24:20,086 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : -ROOT-,,0 from XXX.XX.39.250:60020
> 2008-05-07 10:24:20,086 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> serving -ROOT-,,0
> 2008-05-07 10:24:20,086 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 1, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:24:20,087 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:24:20,146 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: , startCode: 0
> 2008-05-07 10:24:20,146 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner: Current assignment
> of .META.,,1 is not valid: storedInfo: null, startCode: 0,
> storedInfo.startCode: -1, unassignedRegions: false, pendingRegions:
> false
> 2008-05-07 10:24:20,148 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:24:20,456 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning
> region .META.,,1 to server XXX.XX.40.36:60020
> 2008-05-07 10:24:23,089 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 1, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:24:23,463 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : .META.,,1 from XXX.XX.40.36:60020
> 2008-05-07 10:24:23,463 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.40.36:60020
> serving .META.,,1
> 2008-05-07 10:24:23,464 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:24:23,464 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.40.36:60020
> 2008-05-07 10:24:23,465 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1:
> regionname: .META.,,1, startKey: <>, endKey: <>, encodedName:
> 1028785192, tableDesc: {name: .META., families: {info:={name: info,
> max versions: 1, compression: NONE, in memory: false, block cache
> enabled: false, max length: 2147483647, bloom filter: none}}} open
> on XXX.XX.40.36:60020
> 2008-05-07 10:24:23,466 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating
> row .META.,,1 in table -ROOT-,,0 with startcode 1210148655841 and
> server XXX.XX.40.36:60020
> 2008-05-07 10:24:23,469 DEBUG
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: Adding to
> onlineMetaRegions: {regionname: .META.,,1, startKey: <>, server:
> XXX.XX.40.36:60020}
> 2008-05-07 10:24:26,093 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> ...
> 2008-05-07 10:25:14,191 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:25:14,570 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:25:15,265 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:25:15,277 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:25:15,277 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:25:17,196 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:25:17,577 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:25:20,153 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:25:20,169 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:25:20,171 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:25:20,204 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:25:20,584 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:25:23,211 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> ...
> 2008-05-07 10:26:11,678 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:26:14,302 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:26:14,685 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:26:15,266 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:26:15,269 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:26:15,269 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:26:17,306 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:26:17,687 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:26:20,155 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:26:20,175 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:26:20,176 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:26:20,311 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:26:20,690 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:26:23,315 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> ...
> 2008-05-07 10:27:11,787 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:27:14,416 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:27:14,792 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:27:15,270 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:27:15,272 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:27:15,272 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:27:17,421 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:27:17,799 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:27:20,158 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:27:20,174 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:27:20,175 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:27:20,428 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:27:20,802 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:27:23,433 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> ...
> 2008-05-07 10:28:11,899 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:14,532 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:14,902 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:15,275 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:28:15,278 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:28:15,278 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:28:17,537 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:17,905 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:20,164 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:28:20,180 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:28:20,182 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:28:20,540 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:20,913 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:23,545 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:23,920 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:26,552 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:26,922 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:29,557 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:29,929 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:30,404 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> {name: info, max versions: 1, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}
> 2008-05-07 10:28:32,561 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:32,935 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:35,569 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:35,938 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:38,577 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:38,946 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:41,585 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:41,953 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:44,590 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:44,960 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:47,594 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:47,964 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:50,598 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:50,967 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:52,306 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:28:52,397 INFO
> org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> at /hbase/test1/1180168958/log/hlog.dat.1210148932380
> 2008-05-07 10:28:52,397 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test1,,1210148932333/1180168958
> 2008-05-07 10:28:52,398 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test1,,1210148932333 is 0
> 2008-05-07 10:28:52,399 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test1,,1210148932333/1180168958 available
> 2008-05-07 10:28:52,403 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test1,,1210148932333
> 2008-05-07 10:28:52,403 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test1,,1210148932333 disabled
> 2008-05-07 10:28:52,403 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test1,,1210148932333
> 2008-05-07 10:28:52,403 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test1,,1210148932333
> 2008-05-07 10:28:52,403 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test1,,1210148932333. Current region memcache size
> 0,0
> 2008-05-07 10:28:52,403 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test1,,1210148932333 in 0ms, sequence id=0
> 2008-05-07 10:28:52,403 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test1,,1210148932333
> 2008-05-07 10:28:52,403 DEBUG
> org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> hdfs://nantes:54321/hbase/test1/1180168958/log
> 2008-05-07 10:28:52,446 INFO
> org.apache.hadoop.hbase.master.HMaster: created table test1
> 2008-05-07 10:28:52,448 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> reloading table servers because: No server address listed in .META.
> for region test1,,1210148932333
> 2008-05-07 10:28:52,448 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Removed .META.,,1 from cache because of test1,,999999999999999
> 2008-05-07 10:28:52,450 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> {name: info, max versions: 1, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}
> 2008-05-07 10:28:56,610 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region
> test1,,1210148932333 to server XXX.XX.39.250:60020
> 2008-05-07 10:28:56,982 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:28:59,614 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_PROCESS_OPEN : test1,,1210148932333 from XXX.XX.
> 39.250:60020
> 2008-05-07 10:28:59,614 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : test1,,1210148932333 from XXX.XX.39.250:60020
> 2008-05-07 10:28:59,614 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> serving test1,,1210148932333
> 2008-05-07 10:28:59,614 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.39.250:60020
> 2008-05-07 10:28:59,614 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:28:59,614 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> 1180168958, tableDesc: {name: test1, families: {}} open on XXX.XX.
> 39.250:60020
> 2008-05-07 10:28:59,615 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:28:59,615 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> test1,,1210148932333 in table .META.,,1 with startcode
> 1210148655406 and server XXX.XX.39.250:60020
> 2008-05-07 10:28:59,989 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:02,466 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName test1:
> location server XXX.XX.39.250:60020, location region name
> test1,,1210148932333
> 2008-05-07 10:29:02,466 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:29:02,476 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing unserved
> regions
> 2008-05-07 10:29:02,478 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing regions
> currently being served
> 2008-05-07 10:29:02,478 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: adding region
> test1,,1210148932333 to kill list
> 2008-05-07 10:29:02,478 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: inserted local kill
> list into kill list for server XXX.XX.39.250:60020
> 2008-05-07 10:29:02,481 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> region to be disabled from test1
> 2008-05-07 10:29:02,622 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:02,992 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:05,627 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_CLOSE : test1,,1210148932333 from XXX.XX.39.250:60020
> 2008-05-07 10:29:05,627 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> no longer serving regionname: test1,,1210148932333, startKey: <>,
> endKey: <>, encodedName: 1180168958, tableDesc: {name: test1,
> families: {}}
> 2008-05-07 10:29:05,628 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:29:05,628 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> ProcessRegionClose of test1,,1210148932333, true, false
> 2008-05-07 10:29:05,628 INFO
> org.apache.hadoop.hbase.master.ProcessRegionClose$1: region closed:
> test1,,1210148932333
> 2008-05-07 10:29:05,628 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:29:05,999 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:29:08,630 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:29:09,007 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:29:11,635 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:29:12,014 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:29:12,487 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> region to be disabled from test1
> 2008-05-07 10:29:12,489 INFO
> org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table test1
> 2008-05-07 10:29:12,494 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: updated columns in
> row: test1,,1210148932333
> 2008-05-07 10:29:12,498 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing unserved
> regions
> 2008-05-07 10:29:12,498 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: updating columns in
> row: test1,,1210148932333
> 2008-05-07 10:29:12,499 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: updated columns in
> row: test1,,1210148932333
> 2008-05-07 10:29:12,499 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing regions
> currently being served
> 2008-05-07 10:29:12,500 INFO
> org.apache.hadoop.hbase.client.HBaseAdmin: Enabled table test1
> 2008-05-07 10:29:12,511 DEBUG
> org.apache.hadoop.hbase.client.HTable: reloading table servers
> because: org.apache.hadoop.hbase.NotServingRegionException:
> test1,,1210148932333
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1318)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1280)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> (HRegionServer.java:1098)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke
> (NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> 413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
>
> 2008-05-07 10:29:14,639 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region
> test1,,1210148932333 to server XXX.XX.39.250:60020
> 2008-05-07 10:29:15,020 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 2, Num
> Servers: 2, Avg Load: 1.0
> 2008-05-07 10:29:15,280 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:29:15,282 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> 1180168958, tableDesc: {name: test1, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}}, server: , startCode: 0
> 2008-05-07 10:29:15,283 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:29:15,283 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:29:17,643 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_PROCESS_OPEN : test1,,1210148932333 from XXX.XX.
> 39.250:60020
> 2008-05-07 10:29:17,643 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : test1,,1210148932333 from XXX.XX.39.250:60020
> 2008-05-07 10:29:17,643 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> serving test1,,1210148932333
> 2008-05-07 10:29:17,644 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:17,644 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.39.250:60020
> 2008-05-07 10:29:17,644 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> 1180168958, tableDesc: {name: test1, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}} open on XXX.XX.39.250:60020
> 2008-05-07 10:29:17,644 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:29:17,644 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> test1,,1210148932333 in table .META.,,1 with startcode
> 1210148655406 and server XXX.XX.39.250:60020
> 2008-05-07 10:29:18,027 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:20,168 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:29:20,183 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:29:20,184 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:29:20,650 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:21,030 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:22,513 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Removed test1,,1210148932333 from cache because of 2000164.xml
> 2008-05-07 10:29:23,656 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:24,036 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:26,664 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:26,680 INFO
> org.apache.hadoop.hbase.demonstrator.LoadHandler: loadFile
> finished, 100 files loaded into table test1
> 2008-05-07 10:29:26,680 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:29:27,044 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:29,671 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:30,051 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:30,080 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:29:32,679 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:33,053 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:33,727 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:29:35,684 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:36,060 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:38,687 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:39,067 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:39,400 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:29:39,451 INFO
> org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> at /hbase/test2/949457082/log/hlog.dat.1210148979434
> 2008-05-07 10:29:39,451 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test2,,1210148979403/949457082
> 2008-05-07 10:29:39,452 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test2,,1210148979403 is 0
> 2008-05-07 10:29:39,457 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test2,,1210148979403/949457082 available
> 2008-05-07 10:29:39,458 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test2,,1210148979403
> 2008-05-07 10:29:39,458 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test2,,1210148979403 disabled
> 2008-05-07 10:29:39,458 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test2,,1210148979403
> 2008-05-07 10:29:39,458 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test2,,1210148979403
> 2008-05-07 10:29:39,458 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test2,,1210148979403. Current region memcache size
> 0,0
> 2008-05-07 10:29:39,458 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test2,,1210148979403 in 0ms, sequence id=0
> 2008-05-07 10:29:39,458 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test2,,1210148979403
> 2008-05-07 10:29:39,458 DEBUG
> org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> hdfs://nantes:54321/hbase/test2/949457082/log
> 2008-05-07 10:29:39,501 INFO
> org.apache.hadoop.hbase.master.HMaster: created table test2
> 2008-05-07 10:29:39,502 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> reloading table servers because: No server address listed in .META.
> for region test2,,1210148979403
> 2008-05-07 10:29:39,502 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Removed .META.,,1 from cache because of test2,,999999999999999
> 2008-05-07 10:29:39,504 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> {name: info, max versions: 1, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}
> 2008-05-07 10:29:44,696 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region
> test2,,1210148979403 to server XXX.XX.39.250:60020
> 2008-05-07 10:29:45,080 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:47,700 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_PROCESS_OPEN : test2,,1210148979403 from XXX.XX.
> 39.250:60020
> 2008-05-07 10:29:47,700 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : test2,,1210148979403 from XXX.XX.39.250:60020
> 2008-05-07 10:29:47,700 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> serving test2,,1210148979403
> 2008-05-07 10:29:47,700 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.39.250:60020
> 2008-05-07 10:29:47,700 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:47,701 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> 949457082, tableDesc: {name: test2, families: {}} open on XXX.XX.
> 39.250:60020
> 2008-05-07 10:29:47,701 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:29:47,701 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> test2,,1210148979403 in table .META.,,1 with startcode
> 1210148655406 and server XXX.XX.39.250:60020
> 2008-05-07 10:29:48,082 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:49,518 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName test2:
> location server XXX.XX.39.250:60020, location region name
> test2,,1210148979403
> 2008-05-07 10:29:49,518 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:29:49,523 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing unserved
> regions
> 2008-05-07 10:29:49,523 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing regions
> currently being served
> 2008-05-07 10:29:49,523 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: adding region
> test2,,1210148979403 to kill list
> 2008-05-07 10:29:49,523 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: inserted local kill
> list into kill list for server XXX.XX.39.250:60020
> 2008-05-07 10:29:49,524 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> region to be disabled from test2
> 2008-05-07 10:29:50,708 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:51,090 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:53,716 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_CLOSE : test2,,1210148979403 from XXX.XX.39.250:60020
> 2008-05-07 10:29:53,716 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> no longer serving regionname: test2,,1210148979403, startKey: <>,
> endKey: <>, encodedName: 949457082, tableDesc: {name: test2,
> families: {}}
> 2008-05-07 10:29:53,716 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> ProcessRegionClose of test2,,1210148979403, true, false
> 2008-05-07 10:29:53,716 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:53,716 INFO
> org.apache.hadoop.hbase.master.ProcessRegionClose$1: region closed:
> test2,,1210148979403
> 2008-05-07 10:29:53,716 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:29:54,096 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:56,720 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:57,100 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:29:59,527 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> region to be disabled from test2
> 2008-05-07 10:29:59,529 INFO
> org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table test2
> 2008-05-07 10:29:59,532 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: updated columns in
> row: test2,,1210148979403
> 2008-05-07 10:29:59,536 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing unserved
> regions
> 2008-05-07 10:29:59,536 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: updating columns in
> row: test2,,1210148979403
> 2008-05-07 10:29:59,539 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: updated columns in
> row: test2,,1210148979403
> 2008-05-07 10:29:59,539 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing regions
> currently being served
> 2008-05-07 10:29:59,541 INFO
> org.apache.hadoop.hbase.client.HBaseAdmin: Enabled table test2
> 2008-05-07 10:29:59,547 DEBUG
> org.apache.hadoop.hbase.client.HTable: reloading table servers
> because: org.apache.hadoop.hbase.NotServingRegionException:
> test2,,1210148979403
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1318)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1280)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> (HRegionServer.java:1098)
> at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> 413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
>
> 2008-05-07 10:30:02,728 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region
> test2,,1210148979403 to server XXX.XX.39.250:60020
> 2008-05-07 10:30:03,112 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 3, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:05,733 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_PROCESS_OPEN : test2,,1210148979403 from XXX.XX.
> 39.250:60020
> 2008-05-07 10:30:05,733 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : test2,,1210148979403 from XXX.XX.39.250:60020
> 2008-05-07 10:30:05,733 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> serving test2,,1210148979403
> 2008-05-07 10:30:05,733 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.39.250:60020
> 2008-05-07 10:30:05,733 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:05,733 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> 949457082, tableDesc: {name: test2, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}} open on XXX.XX.39.250:60020
> 2008-05-07 10:30:05,733 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:30:05,733 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> test2,,1210148979403 in table .META.,,1 with startcode
> 1210148655406 and server XXX.XX.39.250:60020
> 2008-05-07 10:30:06,116 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:08,736 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:09,119 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:09,553 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Removed test2,,1210148979403 from cache because of 2000164.xml
> 2008-05-07 10:30:11,745 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:12,127 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:14,750 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:15,134 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:15,286 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:30:15,295 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> 1180168958, tableDesc: {name: test1, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> 2008-05-07 10:30:15,296 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> 949457082, tableDesc: {name: test2, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> 2008-05-07 10:30:15,297 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:30:15,297 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:30:17,753 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:18,142 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:20,176 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:30:20,207 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:30:20,213 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:30:20,758 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:21,147 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:21,598 INFO
> org.apache.hadoop.hbase.demonstrator.LoadHandler: loadFile
> finished, 100 files loaded into table test2
> 2008-05-07 10:30:21,598 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:30:23,764 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:24,152 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:26,768 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:27,160 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:27,220 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:30:28,644 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:30:29,776 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:30,167 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:32,784 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:33,174 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:34,975 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:30:35,049 INFO
> org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> at /hbase/test3/1505113011/log/hlog.dat.1210149035032
> 2008-05-07 10:30:35,049 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test3,,1210149034978/1505113011
> 2008-05-07 10:30:35,050 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test3,,1210149034978 is 0
> 2008-05-07 10:30:35,051 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test3,,1210149034978/1505113011 available
> 2008-05-07 10:30:35,052 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test3,,1210149034978
> 2008-05-07 10:30:35,052 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test3,,1210149034978 disabled
> 2008-05-07 10:30:35,052 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test3,,1210149034978
> 2008-05-07 10:30:35,052 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test3,,1210149034978
> 2008-05-07 10:30:35,052 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test3,,1210149034978. Current region memcache size
> 0,0
> 2008-05-07 10:30:35,052 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test3,,1210149034978 in 0ms, sequence id=0
> 2008-05-07 10:30:35,052 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test3,,1210149034978
> 2008-05-07 10:30:35,052 DEBUG
> org.apache.hadoop.hbase.regionserver.HLog: closing log writer in
> hdfs://nantes:54321/hbase/test3/1505113011/log
> 2008-05-07 10:30:35,090 INFO
> org.apache.hadoop.hbase.master.HMaster: created table test3
> 2008-05-07 10:30:35,091 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> reloading table servers because: No server address listed in .META.
> for region test3,,1210149034978
> 2008-05-07 10:30:35,091 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Removed .META.,,1 from cache because of test3,,999999999999999
> 2008-05-07 10:30:35,093 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Found ROOT regionname: -ROOT-,,0, startKey: <>, endKey: <>,
> encodedName: 70236052, tableDesc: {name: -ROOT-, families: {info:=
> {name: info, max versions: 1, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}
> 2008-05-07 10:30:38,797 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region
> test3,,1210149034978 to server XXX.XX.39.250:60020
> 2008-05-07 10:30:39,180 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:41,801 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_PROCESS_OPEN : test3,,1210149034978 from XXX.XX.
> 39.250:60020
> 2008-05-07 10:30:41,801 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : test3,,1210149034978 from XXX.XX.39.250:60020
> 2008-05-07 10:30:41,802 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> serving test3,,1210149034978
> 2008-05-07 10:30:41,802 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.39.250:60020
> 2008-05-07 10:30:41,802 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> 1505113011, tableDesc: {name: test3, families: {}} open on XXX.XX.
> 39.250:60020
> 2008-05-07 10:30:41,802 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:30:41,802 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> test3,,1210149034978 in table .META.,,1 with startcode
> 1210148655406 and server XXX.XX.39.250:60020
> 2008-05-07 10:30:41,802 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:30:41,802 DEBUG
> org.apache.hadoop.hbase.master.RegionManager: Server XXX.XX.
> 39.250:60020 is overloaded. Server load: 4 avg: 3.0
> 2008-05-07 10:30:41,802 DEBUG
> org.apache.hadoop.hbase.master.RegionManager: Choosing to reassign
> 1 regions. mostLoadedRegions has 4 regions in it.
> 2008-05-07 10:30:41,803 DEBUG
> org.apache.hadoop.hbase.master.RegionManager: Going to close region
> test3,,1210149034978
> 2008-05-07 10:30:42,188 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:30:44,809 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_CLOSE : test3,,1210149034978 from XXX.XX.39.250:60020
> 2008-05-07 10:30:44,809 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> no longer serving regionname: test3,,1210149034978, startKey: <>,
> endKey: <>, encodedName: 1505113011, tableDesc: {name: test3,
> families: {}}
> 2008-05-07 10:30:45,103 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName test3:
> location server XXX.XX.39.250:60020, location region name
> test3,,1210149034978
> 2008-05-07 10:30:45,103 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:30:45,108 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing unserved
> regions
> 2008-05-07 10:30:45,108 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: processing regions
> currently being served
> 2008-05-07 10:30:45,108 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: adding region
> test3,,1210149034978 to kill list
> 2008-05-07 10:30:45,108 DEBUG
> org.apache.hadoop.hbase.master.TableOperation: inserted local kill
> list into kill list for server XXX.XX.39.250:60020
> 2008-05-07 10:30:45,110 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:30:47,813 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region
> test3,,1210149034978 to server XXX.XX.39.250:60020
> 2008-05-07 10:30:48,199 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:50,818 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_PROCESS_OPEN : test3,,1210149034978 from XXX.XX.
> 39.250:60020
> 2008-05-07 10:30:50,818 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : test3,,1210149034978 from XXX.XX.39.250:60020
> 2008-05-07 10:30:50,818 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> serving test3,,1210149034978
> 2008-05-07 10:30:50,818 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.39.250:60020
> 2008-05-07 10:30:50,818 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> 1505113011, tableDesc: {name: test3, families: {}} open on XXX.XX.
> 39.250:60020
> 2008-05-07 10:30:50,818 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:30:50,818 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> test3,,1210149034978 in table .META.,,1 with startcode
> 1210148655406 and server XXX.XX.39.250:60020
> 2008-05-07 10:30:50,819 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:30:50,819 DEBUG
> org.apache.hadoop.hbase.master.RegionManager: Server XXX.XX.
> 39.250:60020 is overloaded. Server load: 4 avg: 3.0
> 2008-05-07 10:30:50,819 DEBUG
> org.apache.hadoop.hbase.master.RegionManager: Choosing to reassign
> 1 regions. mostLoadedRegions has 4 regions in it.
> 2008-05-07 10:30:50,819 INFO
> org.apache.hadoop.hbase.master.RegionManager: Skipping region
> test3,,1210149034978 because it is already closing.
> 2008-05-07 10:30:50,819 DEBUG
> org.apache.hadoop.hbase.master.RegionManager: Going to close region
> test2,,1210148979403
> 2008-05-07 10:30:51,206 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:30:53,826 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_CLOSE : test2,,1210148979403 from XXX.XX.39.250:60020
> 2008-05-07 10:30:53,826 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.39.250:60020
> no longer serving regionname: test2,,1210148979403, startKey: <>,
> endKey: <>, encodedName: 949457082, tableDesc: {name: test2,
> families: {document:={name: document, max versions: 3, compression:
> NONE, in memory: false, block cache enabled: false, max length:
> 2147483647, bloom filter: none}}}
> 2008-05-07 10:30:54,214 INFO
> org.apache.hadoop.hbase.master.RegionManager: assigning region
> test2,,1210148979403 to server XXX.XX.40.36:60020
> 2008-05-07 10:30:55,114 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:30:55,116 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:30:56,829 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 4, Num
> Servers: 2, Avg Load: 2.0
> 2008-05-07 10:30:57,217 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_PROCESS_OPEN : test2,,1210148979403 from XXX.XX.40.36:60020
> 2008-05-07 10:30:57,218 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Received
> MSG_REPORT_OPEN : test2,,1210148979403 from XXX.XX.40.36:60020
> 2008-05-07 10:30:57,218 INFO
> org.apache.hadoop.hbase.master.ServerManager: XXX.XX.40.36:60020
> serving test2,,1210148979403
> 2008-05-07 10:30:57,218 DEBUG
> org.apache.hadoop.hbase.master.HMaster: Main processing loop:
> PendingOpenOperation from XXX.XX.40.36:60020
> 2008-05-07 10:30:57,218 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:30:57,218 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: regionname:
> test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> 949457082, tableDesc: {name: test2, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}} open on XXX.XX.40.36:60020
> 2008-05-07 10:30:57,218 DEBUG
> org.apache.hadoop.hbase.master.RegionServerOperation:
> numberOfMetaRegions: 1, onlineMetaRegions.size(): 1
> 2008-05-07 10:30:57,218 INFO
> org.apache.hadoop.hbase.master.ProcessRegionOpen$1: updating row
> test2,,1210148979403 in table .META.,,1 with startcode
> 1210148655841 and server XXX.XX.40.36:60020
> 2008-05-07 10:30:59,834 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:00,225 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:02,838 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:03,240 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:05,124 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:31:05,126 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:31:05,843 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:06,246 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:08,846 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:09,250 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:11,850 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:12,254 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:14,858 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:15,132 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:31:15,135 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:31:15,258 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:15,289 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:31:15,291 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> 1180168958, tableDesc: {name: test1, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> 2008-05-07 10:31:15,292 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> 949457082, tableDesc: {name: test2, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}}, server: XXX.XX.40.36:60020, startCode: 1210148655841
> 2008-05-07 10:31:15,292 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> 1505113011, tableDesc: {name: test3, families: {}}}, server: XXX.XX.
> 39.250:60020, startCode: 1210148655406
> 2008-05-07 10:31:15,293 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:31:15,293 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:31:17,862 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:18,265 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:20,177 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:31:20,192 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:31:20,194 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:31:20,867 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:21,272 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:23,872 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:24,275 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:25,138 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:31:25,140 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Sleep. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:31:26,878 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:27,282 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:29,892 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:30,289 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:32,899 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:33,296 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:35,145 DEBUG
> org.apache.hadoop.hbase.client.HBaseAdmin: Wake. Waiting for first
> region to be disabled from test3
> 2008-05-07 10:31:35,145 INFO
> org.apache.hadoop.hbase.client.HBaseAdmin: Disabled table test3
> 2008-05-07 10:31:35,904 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:36,299 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:38,912 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:39,306 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:41,916 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:42,313 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:44,920 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:45,316 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:47,924 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:48,319 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:50,936 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:51,327 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:53,940 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:54,334 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:56,946 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:57,337 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:31:59,954 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:00,340 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:02,957 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:03,346 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:05,965 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:06,353 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:08,973 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:09,360 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:11,977 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:12,367 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:14,997 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:15,178 DEBUG
> org.apache.hadoop.hbase.master.TableOperation
> $ProcessTableOperation: Trying to contact region server for
> regionName '.META.,,1', but failed after 5 attempts.
> Exception 1:
> org.apache.hadoop.hbase.TableNotDisabledException: test3Exception 1:
> org.apache.hadoop.hbase.TableNotDisabledException: test3Exception 1:
> org.apache.hadoop.hbase.TableNotDisabledException: test3Exception 1:
> org.apache.hadoop.hbase.TableNotDisabledException: test3
> 2008-05-07 10:32:15,180 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 9 on 60000, call addColumn(test3, {name: document,
> max versions: 3, compression: NONE, in memory: false, block cache
> enabled: false, max length: 2147483647, bloom filter: none}) from
> XXX.XX.40.36:33086: error:
> org.apache.hadoop.hbase.TableNotDisabledException: test3
> org.apache.hadoop.hbase.TableNotDisabledException: test3
> at org.apache.hadoop.hbase.master.ColumnOperation.processScanItem
> (ColumnOperation.java:43)
> at org.apache.hadoop.hbase.master.TableOperation
> $ProcessTableOperation.call(TableOperation.java:120)
> at org.apache.hadoop.hbase.master.TableOperation
> $ProcessTableOperation.call(TableOperation.java:84)
> at
> org.apache.hadoop.hbase.master.RetryableMetaOperation.doWithRetries
> (RetryableMetaOperation.java:59)
> at org.apache.hadoop.hbase.master.TableOperation.process
> (TableOperation.java:158)
> at org.apache.hadoop.hbase.master.HMaster.addColumn(HMaster.java:650)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke
> (NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:585)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> 413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
>
> 2008-05-07 10:32:15,181 DEBUG
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers:
> Cache hit in table locations for row <> and tableName .META.:
> location server XXX.XX.40.36:60020, location region name .META.,,1
> 2008-05-07 10:32:15,296 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scanning meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020}
> 2008-05-07 10:32:15,298 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test1,,1210148932333, startKey: <>, endKey: <>, encodedName:
> 1180168958, tableDesc: {name: test1, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}}, server: XXX.XX.39.250:60020, startCode: 1210148655406
> 2008-05-07 10:32:15,300 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test2,,1210148979403, startKey: <>, endKey: <>, encodedName:
> 949457082, tableDesc: {name: test2, families: {document:={name:
> document, max versions: 3, compression: NONE, in memory: false,
> block cache enabled: false, max length: 2147483647, bloom filter:
> none}}}}, server: XXX.XX.40.36:60020, startCode: 1210148655841
> 2008-05-07 10:32:15,301 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner regioninfo: {regionname:
> test3,,1210149034978, startKey: <>, endKey: <>, encodedName:
> 1505113011, tableDesc: {name: test3, families: {}}}, server: XXX.XX.
> 39.250:60020, startCode: 1210148655406
> 2008-05-07 10:32:15,302 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.metaScanner scan of meta region {regionname: .META.,,
> 1, startKey: <>, server: XXX.XX.40.36:60020} complete
> 2008-05-07 10:32:15,302 INFO
> org.apache.hadoop.hbase.master.BaseScanner: all meta regions scanned
> 2008-05-07 10:32:15,373 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:18,003 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:18,380 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:20,180 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scanning meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020}
> 2008-05-07 10:32:20,195 DEBUG
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner regioninfo: {regionname: .META.,,1,
> startKey: <>, endKey: <>, encodedName: 1028785192, tableDesc:
> {name: .META., families: {info:={name: info, max versions: 1,
> compression: NONE, in memory: false, block cache enabled: false,
> max length: 2147483647, bloom filter: none}}}}, server: XXX.XX.
> 40.36:60020, startCode: 1210148655841
> 2008-05-07 10:32:20,196 INFO
> org.apache.hadoop.hbase.master.BaseScanner:
> RegionManager.rootScanner scan of meta region {regionname: -ROOT-,,
> 0, startKey: <>, server: XXX.XX.39.250:60020} complete
> 2008-05-07 10:32:21,005 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> 2008-05-07 10:32:21,387 DEBUG
> org.apache.hadoop.hbase.master.ServerManager: Total Load: 5, Num
> Servers: 2, Avg Load: 3.0
> ...2008-05-07 10:24:15,357 INFO
> org.apache.hadoop.ipc.metrics.RpcMetrics: Initializing RPC Metrics
> with hostName=60020, port=60020
> 2008-05-07 10:24:15,410 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegionServer: Telling master
> at nantes:60000 that we are up
> 2008-05-07 10:24:16,550 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegionServer: Done telling
> master we are up
> 2008-05-07 10:24:16,550 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegionServer: Config from
> master: fs.default.name=hdfs://nantes:54321/hbase
> 2008-05-07 10:24:16,550 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegionServer: Config from
> master: hbase.rootdir=hdfs://nantes:54321/hbase
> 2008-05-07 10:24:16,647 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegionServer: Log dir hdfs://
> nantes:54321/hbase/log_XXX.XX.39.250_1210148655406_60020
> 2008-05-07 10:24:16,744 INFO
> org.apache.hadoop.hbase.regionserver.HLog: New log writer created
> at /hbase/log_XXX.XX.39.250_1210148655406_60020/hlog.dat.1210148656697
> 2008-05-07 10:24:16,821 INFO org.mortbay.http.HttpServer: Version
> Jetty/5.1.4
> 2008-05-07 10:24:16,822 INFO org.mortbay.util.Container: Started
> HttpContext[/static,/static]
> 2008-05-07 10:24:17,095 INFO org.mortbay.util.Credential: Checking
> Resource aliases
> 2008-05-07 10:24:17,112 INFO org.mortbay.util.Container: Started
> org.mortbay.jetty.servlet.WebApplicationHandler@794e113b
> 2008-05-07 10:24:17,139 INFO org.mortbay.util.Container: Started
> WebApplicationContext[/,/]
> 2008-05-07 10:24:17,141 INFO org.mortbay.http.SocketListener:
> Started SocketListener on 0.0.0.0:60030
> 2008-05-07 10:24:17,141 INFO org.mortbay.util.Container: Started
> org.mortbay.jetty.Server@421fbfd6
> 2008-05-07 10:24:17,141 INFO org.apache.hadoop.ipc.Server: IPC
> Server Responder: starting
> 2008-05-07 10:24:17,142 INFO org.apache.hadoop.ipc.Server: IPC
> Server listener on 60020: starting
> 2008-05-07 10:24:17,142 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 0 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 1 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 2 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 3 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 4 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 5 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 6 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 7 on 60020: starting
> 2008-05-07 10:24:17,143 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 8 on 60020: starting
> 2008-05-07 10:24:17,143 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer: HRegionServer
> started at: XXX.XX.39.250:60020
> 2008-05-07 10:24:17,145 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 9 on 60020: starting
> 2008-05-07 10:24:17,151 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : -ROOT-,,0
> 2008-05-07 10:24:17,158 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region -
> ROOT-,,0/70236052
> 2008-05-07 10:24:17,226 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: loaded /hbase/-ROOT-/
> 70236052/info/info/5787712489651860883, isReference=false, sequence
> id=1
> 2008-05-07 10:24:17,241 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Loaded 1 file(s) in
> hstore 70236052/info, max sequence id 1
> 2008-05-07 10:24:17,278 INFO
> org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop
> library
> 2008-05-07 10:24:17,279 INFO
> org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded
> & initialized native-zlib library
> 2008-05-07 10:24:17,290 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region -ROOT-,,0 is 2
> 2008-05-07 10:24:17,297 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region -ROOT-,,
> 0/70236052 available
> 2008-05-07 10:24:17,297 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: -ROOT-,,0
> 2008-05-07 10:24:17,297 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region -ROOT-,,0
> 2008-05-07 10:24:17,297 DEBUG
> org.apache.hadoop.hbase.regionserver.HLog: changing sequence number
> from 0 to 2
> 2008-05-07 10:24:17,300 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region -ROOT-,,0 in 0sec
> 2008-05-07 10:28:56,680 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test1,,1210148932333
> 2008-05-07 10:28:56,681 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test1,,1210148932333/1180168958
> 2008-05-07 10:28:56,683 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test1,,1210148932333 is 0
> 2008-05-07 10:28:56,690 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test1,,1210148932333/1180168958 available
> 2008-05-07 10:28:56,690 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test1,,1210148932333
> 2008-05-07 10:28:56,690 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test1,,1210148932333
> 2008-05-07 10:28:56,693 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test1,,1210148932333 in 0sec
> 2008-05-07 10:29:02,692 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_CLOSE : test1,,1210148932333
> 2008-05-07 10:29:02,692 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test1,,1210148932333
> 2008-05-07 10:29:02,693 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test1,,1210148932333 disabled
> 2008-05-07 10:29:02,693 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test1,,1210148932333
> 2008-05-07 10:29:02,693 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test1,,1210148932333
> 2008-05-07 10:29:02,693 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test1,,1210148932333. Current region memcache size
> 0,0
> 2008-05-07 10:29:02,693 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test1,,1210148932333 in 0ms, sequence id=4
> 2008-05-07 10:29:02,693 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test1,,1210148932333
> 2008-05-07 10:29:12,578 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 9 on 60020, call batchUpdate(test1,,1210148932333,
> org.apache.hadoop.hbase.io.BatchUpdate@756f70a4) from XXX.XX.
> 40.36:58851: error:
> org.apache.hadoop.hbase.NotServingRegionException:
> test1,,1210148932333
> org.apache.hadoop.hbase.NotServingRegionException:
> test1,,1210148932333
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1318)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1280)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> (HRegionServer.java:1098)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke
> (NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> 413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> 2008-05-07 10:29:14,708 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test1,,1210148932333
> 2008-05-07 10:29:14,709 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test1,,1210148932333/1180168958
> 2008-05-07 10:29:14,763 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> hstore 1180168958/document, max sequence id -1
> 2008-05-07 10:29:14,764 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test1,,1210148932333 is 0
> 2008-05-07 10:29:14,767 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test1,,1210148932333/1180168958 available
> 2008-05-07 10:29:14,767 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test1,,1210148932333
> 2008-05-07 10:29:14,767 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test1,,1210148932333
> 2008-05-07 10:29:14,769 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test1,,1210148932333 in 0sec
> 2008-05-07 10:29:44,764 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test2,,1210148979403
> 2008-05-07 10:29:44,765 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test2,,1210148979403/949457082
> 2008-05-07 10:29:44,767 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test2,,1210148979403 is 0
> 2008-05-07 10:29:44,769 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test2,,1210148979403/949457082 available
> 2008-05-07 10:29:44,770 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test2,,1210148979403
> 2008-05-07 10:29:44,770 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test2,,1210148979403
> 2008-05-07 10:29:44,772 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test2,,1210148979403 in 0sec
> 2008-05-07 10:29:50,776 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_CLOSE : test2,,1210148979403
> 2008-05-07 10:29:50,776 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test2,,1210148979403
> 2008-05-07 10:29:50,776 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test2,,1210148979403 disabled
> 2008-05-07 10:29:50,776 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test2,,1210148979403
> 2008-05-07 10:29:50,776 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test2,,1210148979403
> 2008-05-07 10:29:50,776 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test2,,1210148979403. Current region memcache size
> 0,0
> 2008-05-07 10:29:50,777 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test2,,1210148979403 in 1ms, sequence id=105
> 2008-05-07 10:29:50,777 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test2,,1210148979403
> 2008-05-07 10:29:59,614 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 8 on 60020, call batchUpdate(test2,,1210148979403,
> org.apache.hadoop.hbase.io.BatchUpdate@7d5dc37d) from XXX.XX.
> 40.36:58907: error:
> org.apache.hadoop.hbase.NotServingRegionException:
> test2,,1210148979403
> org.apache.hadoop.hbase.NotServingRegionException:
> test2,,1210148979403
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1318)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1280)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> (HRegionServer.java:1098)
> at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> 413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> 2008-05-07 10:30:02,796 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test2,,1210148979403
> 2008-05-07 10:30:02,797 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test2,,1210148979403/949457082
> 2008-05-07 10:30:02,844 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> hstore 949457082/document, max sequence id -1
> 2008-05-07 10:30:02,846 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test2,,1210148979403 is 0
> 2008-05-07 10:30:02,848 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test2,,1210148979403/949457082 available
> 2008-05-07 10:30:02,848 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test2,,1210148979403
> 2008-05-07 10:30:02,848 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test2,,1210148979403
> 2008-05-07 10:30:02,850 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test2,,1210148979403 in 0sec
> 2008-05-07 10:30:38,864 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test3,,1210149034978
> 2008-05-07 10:30:38,865 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test3,,1210149034978/1505113011
> 2008-05-07 10:30:38,867 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test3,,1210149034978 is 0
> 2008-05-07 10:30:38,869 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test3,,1210149034978/1505113011 available
> 2008-05-07 10:30:38,869 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test3,,1210149034978
> 2008-05-07 10:30:38,869 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test3,,1210149034978
> 2008-05-07 10:30:38,871 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test3,,1210149034978 in 0sec
> 2008-05-07 10:30:41,870 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_CLOSE : test3,,1210149034978
> 2008-05-07 10:30:41,870 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test3,,1210149034978
> 2008-05-07 10:30:41,870 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test3,,1210149034978 disabled
> 2008-05-07 10:30:41,870 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test3,,1210149034978
> 2008-05-07 10:30:41,870 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test3,,1210149034978
> 2008-05-07 10:30:41,870 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test3,,1210149034978. Current region memcache size
> 0,0
> 2008-05-07 10:30:41,870 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test3,,1210149034978 in 0ms, sequence id=206
> 2008-05-07 10:30:41,870 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test3,,1210149034978
> 2008-05-07 10:30:47,880 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_CLOSE : test3,,1210149034978
> 2008-05-07 10:30:47,880 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test3,,1210149034978
> 2008-05-07 10:30:47,881 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test3,,1210149034978/1505113011
> 2008-05-07 10:30:47,883 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test3,,1210149034978 is 0
> 2008-05-07 10:30:47,885 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test3,,1210149034978/1505113011 available
> 2008-05-07 10:30:47,885 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test3,,1210149034978
> 2008-05-07 10:30:47,885 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test3,,1210149034978
> 2008-05-07 10:30:47,887 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test3,,1210149034978 in 0sec
> 2008-05-07 10:30:50,886 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_CLOSE : test2,,1210148979403
> 2008-05-07 10:30:50,886 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test2,,1210148979403
> 2008-05-07 10:30:50,886 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test2,,1210148979403 disabled
> 2008-05-07 10:30:50,886 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test2,,1210148979403
> 2008-05-07 10:30:50,886 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test2,,1210148979403
> 2008-05-07 10:30:50,886 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test2,,1210148979403. Current region memcache size
> 1,5m
> 2008-05-07 10:30:51,109 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Added /hbase/
> test2/949457082/document/mapfiles/4703355206274213543 with 100
> entries, sequence id 207, data size 1,5m, file size 1,5m
> 2008-05-07 10:30:51,109 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test2,,1210148979403 in 223ms, sequence id=207
> 2008-05-07 10:30:51,110 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: closed 949457082/document
> 2008-05-07 10:30:51,110 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test2,,1210148979403
> 2008-05-07 10:32:54,130 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test4,,1210149169246
> 2008-05-07 10:32:54,130 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test4,,1210149169246/1639067551
> 2008-05-07 10:32:54,133 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test4,,1210149169246 is 0
> 2008-05-07 10:32:54,135 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test4,,1210149169246/1639067551 available
> 2008-05-07 10:32:54,135 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test4,,1210149169246
> 2008-05-07 10:32:54,135 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test4,,1210149169246
> 2008-05-07 10:32:54,137 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test4,,1210149169246 in 0sec
> 2008-05-07 10:32:57,137 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_CLOSE : test4,,1210149169246
> 2008-05-07 10:32:57,137 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: compactions and cache
> flushes disabled for region test4,,1210149169246
> 2008-05-07 10:32:57,137 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Updates and scanners
> for region test4,,1210149169246 disabled
> 2008-05-07 10:32:57,137 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more active
> scanners for region test4,,1210149169246
> 2008-05-07 10:32:57,137 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: no more row locks
> outstanding on region test4,,1210149169246
> 2008-05-07 10:32:57,137 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Started memcache
> flush for region test4,,1210149169246. Current region memcache size
> 0,0
> 2008-05-07 10:32:57,137 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Finished memcache
> flush for region test4,,1210149169246 in 0ms, sequence id=208
> 2008-05-07 10:32:57,138 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: closed
> test4,,1210149169246
> 2008-05-07 10:33:00,147 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_CLOSE : test4,,1210149169246
> 2008-05-07 10:33:09,467 INFO org.apache.hadoop.ipc.Server: IPC
> Server handler 5 on 60020, call batchUpdate(test4,,1210149169246,
> org.apache.hadoop.hbase.io.BatchUpdate@20dccfab) from XXX.XX.
> 40.36:43007: error:
> org.apache.hadoop.hbase.NotServingRegionException:
> test4,,1210149169246
> org.apache.hadoop.hbase.NotServingRegionException:
> test4,,1210149169246
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1318)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegion
> (HRegionServer.java:1280)
> at org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdate
> (HRegionServer.java:1098)
> at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:
> 413)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:896)
> 2008-05-07 10:33:12,168 INFO
> org.apache.hadoop.hbase.regionserver.HRegionServer:
> MSG_REGION_OPEN : test4,,1210149169246
> 2008-05-07 10:33:12,168 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Opening region
> test4,,1210149169246/1639067551
> 2008-05-07 10:33:12,218 DEBUG
> org.apache.hadoop.hbase.regionserver.HStore: Loaded 0 file(s) in
> hstore 1639067551/document, max sequence id -1
> 2008-05-07 10:33:12,220 DEBUG
> org.apache.hadoop.hbase.regionserver.HRegion: Next sequence id for
> region test4,,1210149169246 is 0
> 2008-05-07 10:33:12,222 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: region
> test4,,1210149169246/1639067551 available
> 2008-05-07 10:33:12,222 DEBUG
> org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction
> requested for region: test4,,1210149169246
> 2008-05-07 10:33:12,222 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: starting compaction
> on region test4,,1210149169246
> 2008-05-07 10:33:12,224 INFO
> org.apache.hadoop.hbase.regionserver.HRegion: compaction completed
> on region test4,,1210149169246 in 0sec
> ...
Re: TableNotDisabledException - is it HBASE-478?
Posted by stack <st...@duboce.net>.
Michaela Buergle wrote:
...
> I use the TRUNK version (from 1 or 2 days ago) with 2 nodes.
I was wondering why you are using TRUNK? It comes with no guarantees
(And its about to be sent for a loop if HBASE-82 goes in). I'd suggest
you use the head of the 0.1 branch. If you use this, and there are
issues, we'll drop all to fix them.
Yours,
St.Ack
Re: TableNotDisabledException - is it HBASE-478?
Posted by Michaela Buergle <Mi...@neofonie.de>.
> Roughly once every 5 tries, I don't succeed - I get a
> "TableNotDisabledException" when I try to add the column family. It
> seems that immediately before the problem occurs, regions are reassigned
> because one server is loaded above the average value.
I must add though that using only two nodes those reassignments occur
quite often, so there may not be any connection.
Btw in my master.log, with every reassignment following the
TableNotDisabledException I get
"Skipping region test3,,1210149034978 because it is already closing."
Regards
micha