You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Ramon Wang <ra...@appannie.com> on 2014/02/21 10:40:38 UTC
"compact" command cannot trigger major compaction
Hi Folks
I'm trying to trigger a major compaction in my HBase cluster with 16 data
nodes, in the shell command, i input the following command:
hbase> compact 't1'
But it seems doesn't work, what i got from MASTER log is as below, nothing
more, :
2014-02-21 01:36:40,232 WARN org.apache.hadoop.conf.Configuration:
> fs.default.name is deprecated. Instead, use fs.defaultFS
> 2014-02-21 01:36:40,235 INFO org.apache.zookeeper.ZooKeeper: Initiating
> client connection,
> connectString=aa-prod-nn-1:2181,aa-prod-nn-2:2181,aa-prod-mgt:2181
> sessionTimeout=60000
> watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@34cf935a
> 2014-02-21 01:36:40,236 INFO
> org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: The identifier of
> this process is 57962@aa-prod-nn-2
> 2014-02-21 01:36:40,236 INFO org.apache.zookeeper.ClientCnxn: Opening
> socket connection to server aa-prod-nn-1/10.2.2.11:2181. Will not attempt
> to authenticate using SASL (java.lang.SecurityException: Unable to locate a
> login configuration)
> 2014-02-21 01:36:40,238 INFO org.apache.zookeeper.ClientCnxn: Socket
> connection established to aa-prod-nn-1/10.2.2.11:2181, initiating session
> 2014-02-21 01:36:40,249 INFO org.apache.zookeeper.ClientCnxn: Session
> establishment complete on server aa-prod-nn-1/10.2.2.11:2181, sessionid =
> 0x14449b786b60eec, negotiated timeout = 40000
> 2014-02-21 01:36:40,688 INFO org.apache.zookeeper.ZooKeeper: Session:
> 0x14449b786b60eec closed
> 2014-02-21 01:36:40,688 INFO org.apache.zookeeper.ClientCnxn: EventThread
> shut down
And in the HBASE UI "Table Attributes" list, Compaction --> NONE, guys, any
idea? Thanks.
Cheers
Ramon
Re: "compact" command cannot trigger major compaction
Posted by Ramon Wang <ra...@appannie.com>.
Thanks Matteo! major_compact did the job.
Cheers
Ramon
On Fri, Feb 21, 2014 at 5:44 PM, Matteo Bertozzi <th...@gmail.com>wrote:
> did you tried to use the "major_compact" command?
> hbase> major_compact 't1'
>
> Matteo
>
>
>
> On Fri, Feb 21, 2014 at 9:40 AM, Ramon Wang <ra...@appannie.com> wrote:
>
> > Hi Folks
> >
> > I'm trying to trigger a major compaction in my HBase cluster with 16 data
> > nodes, in the shell command, i input the following command:
> >
> > hbase> compact 't1'
> >
> >
> > But it seems doesn't work, what i got from MASTER log is as below,
> nothing
> > more, :
> >
> > 2014-02-21 01:36:40,232 WARN org.apache.hadoop.conf.Configuration:
> > > fs.default.name is deprecated. Instead, use fs.defaultFS
> > > 2014-02-21 01:36:40,235 INFO org.apache.zookeeper.ZooKeeper: Initiating
> > > client connection,
> > > connectString=aa-prod-nn-1:2181,aa-prod-nn-2:2181,aa-prod-mgt:2181
> > > sessionTimeout=60000
> > >
> >
> watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@34cf935a
> > > 2014-02-21 01:36:40,236 INFO
> > > org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: The identifier
> of
> > > this process is 57962@aa-prod-nn-2
> > > 2014-02-21 01:36:40,236 INFO org.apache.zookeeper.ClientCnxn: Opening
> > > socket connection to server aa-prod-nn-1/10.2.2.11:2181. Will not
> > attempt
> > > to authenticate using SASL (java.lang.SecurityException: Unable to
> > locate a
> > > login configuration)
> > > 2014-02-21 01:36:40,238 INFO org.apache.zookeeper.ClientCnxn: Socket
> > > connection established to aa-prod-nn-1/10.2.2.11:2181, initiating
> > session
> > > 2014-02-21 01:36:40,249 INFO org.apache.zookeeper.ClientCnxn: Session
> > > establishment complete on server aa-prod-nn-1/10.2.2.11:2181,
> sessionid
> > =
> > > 0x14449b786b60eec, negotiated timeout = 40000
> > > 2014-02-21 01:36:40,688 INFO org.apache.zookeeper.ZooKeeper: Session:
> > > 0x14449b786b60eec closed
> > > 2014-02-21 01:36:40,688 INFO org.apache.zookeeper.ClientCnxn:
> EventThread
> > > shut down
> >
> >
> > And in the HBASE UI "Table Attributes" list, Compaction --> NONE, guys,
> any
> > idea? Thanks.
> >
> > Cheers
> > Ramon
> >
>
Re: "compact" command cannot trigger major compaction
Posted by Matteo Bertozzi <th...@gmail.com>.
did you tried to use the "major_compact" command?
hbase> major_compact 't1'
Matteo
On Fri, Feb 21, 2014 at 9:40 AM, Ramon Wang <ra...@appannie.com> wrote:
> Hi Folks
>
> I'm trying to trigger a major compaction in my HBase cluster with 16 data
> nodes, in the shell command, i input the following command:
>
> hbase> compact 't1'
>
>
> But it seems doesn't work, what i got from MASTER log is as below, nothing
> more, :
>
> 2014-02-21 01:36:40,232 WARN org.apache.hadoop.conf.Configuration:
> > fs.default.name is deprecated. Instead, use fs.defaultFS
> > 2014-02-21 01:36:40,235 INFO org.apache.zookeeper.ZooKeeper: Initiating
> > client connection,
> > connectString=aa-prod-nn-1:2181,aa-prod-nn-2:2181,aa-prod-mgt:2181
> > sessionTimeout=60000
> >
> watcher=catalogtracker-on-org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation@34cf935a
> > 2014-02-21 01:36:40,236 INFO
> > org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: The identifier of
> > this process is 57962@aa-prod-nn-2
> > 2014-02-21 01:36:40,236 INFO org.apache.zookeeper.ClientCnxn: Opening
> > socket connection to server aa-prod-nn-1/10.2.2.11:2181. Will not
> attempt
> > to authenticate using SASL (java.lang.SecurityException: Unable to
> locate a
> > login configuration)
> > 2014-02-21 01:36:40,238 INFO org.apache.zookeeper.ClientCnxn: Socket
> > connection established to aa-prod-nn-1/10.2.2.11:2181, initiating
> session
> > 2014-02-21 01:36:40,249 INFO org.apache.zookeeper.ClientCnxn: Session
> > establishment complete on server aa-prod-nn-1/10.2.2.11:2181, sessionid
> =
> > 0x14449b786b60eec, negotiated timeout = 40000
> > 2014-02-21 01:36:40,688 INFO org.apache.zookeeper.ZooKeeper: Session:
> > 0x14449b786b60eec closed
> > 2014-02-21 01:36:40,688 INFO org.apache.zookeeper.ClientCnxn: EventThread
> > shut down
>
>
> And in the HBASE UI "Table Attributes" list, Compaction --> NONE, guys, any
> idea? Thanks.
>
> Cheers
> Ramon
>