You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Yaniv Yancovich <ya...@gigya-inc.com> on 2014/12/08 22:32:48 UTC

Can I delete oldLogs from Hbase?

Hi,
I am using hbase 0.94.6 (CDH 4.5).
I saw that my oldLogs folder keeps growing to 4.4T. This stopped at early
October, but still the files doesn't being cleaned.
Can I delete them? Why do i need them on first place?

I see in master log the following NPE:
2014-07-17 08:15:05,862 ERROR
org.apache.hadoop.hbase.master.cleaner.LogCleaner: Caught exception
java.lang.NullPointerException
        at
org.apache.hadoop.hbase.replication.ReplicationZookeeper.get
ListHLogsForPeerForRS(ReplicationZookeeper.java:625)
        at
org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.loadHLogsFromQueues(ReplicationLogCleaner.java:110)
        at
org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.get
DeletableFiles(ReplicationLogCleaner.java:76)
        at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteFiles(CleanerChore.java:234)
        at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteEntries(CleanerChore.java:158)
        at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.chore(CleanerChore.java:125)
        at org.apache.hadoop.hbase.Chore.run(Chore.java:67)
        at java.lang.Thread.run(Thread.java:744)

I checked for old hbase-defaults.xml in master conf and didn't find such.

Any ideas?

Re: Can I delete oldLogs from Hbase?

Posted by Ted Yu <yu...@gmail.com>.
0.94.6 is pretty old.

Looking at change history of ReplicationLogCleaner.java, you would see
changes that went in after 0.94.6
e.g. HBASE-9377:
    Backport HBASE- 9208 - ReplicationLogCleaner slow at large scale (Dave
Latham)

Can you upgrade to newer release ?

On Mon, Dec 8, 2014 at 1:32 PM, Yaniv Yancovich <ya...@gigya-inc.com> wrote:

> Hi,
> I am using hbase 0.94.6 (CDH 4.5).
> I saw that my oldLogs folder keeps growing to 4.4T. This stopped at early
> October, but still the files doesn't being cleaned.
> Can I delete them? Why do i need them on first place?
>
> I see in master log the following NPE:
> 2014-07-17 08:15:05,862 ERROR
> org.apache.hadoop.hbase.master.cleaner.LogCleaner: Caught exception
> java.lang.NullPointerException
>         at
> org.apache.hadoop.hbase.replication.ReplicationZookeeper.get
> ListHLogsForPeerForRS(ReplicationZookeeper.java:625)
>         at
>
> org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.loadHLogsFromQueues(ReplicationLogCleaner.java:110)
>         at
> org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.get
> DeletableFiles(ReplicationLogCleaner.java:76)
>         at
>
> org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteFiles(CleanerChore.java:234)
>         at
>
> org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteEntries(CleanerChore.java:158)
>         at
>
> org.apache.hadoop.hbase.master.cleaner.CleanerChore.chore(CleanerChore.java:125)
>         at org.apache.hadoop.hbase.Chore.run(Chore.java:67)
>         at java.lang.Thread.run(Thread.java:744)
>
> I checked for old hbase-defaults.xml in master conf and didn't find such.
>
> Any ideas?
>