You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by "Buttler, David" <bu...@llnl.gov> on 2011/04/26 21:24:53 UTC
balancer log explosion
Hi all,
Looking back at my logs, it looks like I upgraded to 0.90.1 on March 28th.
Up until April 11th , not much activity was going on. Logs mostly under 100K, except when I was importing a lot of data.
Ever since then my logs have been filled with messages like:
/opt/hdfs/logs/hbase-hadoop-master-node-00.log.2011-04-11:2011-04-11 08:29:23,027 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: No previous transition plan was found (or we are ignoring an existing plan) for TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186 so generated a random one; hri=TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186, src=, dest=node-01,60020,1302535602535; 5 (online=5, exclude=null) available servers
[note: keys are sha1 hashes]
Now my logs are more than 100MB per day. Any hints?
Dave
RE: balancer log explosion
Posted by "Buttler, David" <bu...@llnl.gov>.
I restarted hbase (jobs just started timing out for no reason this morning), and the balancer issue seems to have gone away as well.
Dave
-----Original Message-----
From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of Stack
Sent: Tuesday, April 26, 2011 12:28 PM
To: user@hbase.apache.org
Cc: hbase-user@hadoop.apache.org
Subject: Re: balancer log explosion
Is the balancer running continually? Does it never setttle?
St.Ack
On Tue, Apr 26, 2011 at 12:24 PM, Buttler, David <bu...@llnl.gov> wrote:
> Hi all,
> Looking back at my logs, it looks like I upgraded to 0.90.1 on March 28th.
>
> Up until April 11th , not much activity was going on. Logs mostly under 100K, except when I was importing a lot of data.
> Ever since then my logs have been filled with messages like:
> /opt/hdfs/logs/hbase-hadoop-master-node-00.log.2011-04-11:2011-04-11 08:29:23,027 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: No previous transition plan was found (or we are ignoring an existing plan) for TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186 so generated a random one; hri=TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186, src=, dest=node-01,60020,1302535602535; 5 (online=5, exclude=null) available servers
>
> [note: keys are sha1 hashes]
>
> Now my logs are more than 100MB per day. Any hints?
>
> Dave
>
>
Re: balancer log explosion
Posted by Stack <st...@duboce.net>.
Is the balancer running continually? Does it never setttle?
St.Ack
On Tue, Apr 26, 2011 at 12:24 PM, Buttler, David <bu...@llnl.gov> wrote:
> Hi all,
> Looking back at my logs, it looks like I upgraded to 0.90.1 on March 28th.
>
> Up until April 11th , not much activity was going on. Logs mostly under 100K, except when I was importing a lot of data.
> Ever since then my logs have been filled with messages like:
> /opt/hdfs/logs/hbase-hadoop-master-node-00.log.2011-04-11:2011-04-11 08:29:23,027 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: No previous transition plan was found (or we are ignoring an existing plan) for TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186 so generated a random one; hri=TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186, src=, dest=node-01,60020,1302535602535; 5 (online=5, exclude=null) available servers
>
> [note: keys are sha1 hashes]
>
> Now my logs are more than 100MB per day. Any hints?
>
> Dave
>
>
Re: balancer log explosion
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Just that line? Nothing about regions in transition that timed out?
Usually there's a few other lines coming with this one, might give us
a hint.
Thx,
J-D
On Tue, Apr 26, 2011 at 12:24 PM, Buttler, David <bu...@llnl.gov> wrote:
> Hi all,
> Looking back at my logs, it looks like I upgraded to 0.90.1 on March 28th.
>
> Up until April 11th , not much activity was going on. Logs mostly under 100K, except when I was importing a lot of data.
> Ever since then my logs have been filled with messages like:
> /opt/hdfs/logs/hbase-hadoop-master-node-00.log.2011-04-11:2011-04-11 08:29:23,027 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: No previous transition plan was found (or we are ignoring an existing plan) for TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186 so generated a random one; hri=TABLE,af34e2d327faefa308e1e193bb4193eb6bb6d0a9,1289278870247.1996943186, src=, dest=node-01,60020,1302535602535; 5 (online=5, exclude=null) available servers
>
> [note: keys are sha1 hashes]
>
> Now my logs are more than 100MB per day. Any hints?
>
> Dave
>
>