You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Yaniv Yancovich <ya...@gigya-inc.com> on 2014/12/08 22:32:48 UTC
Can I delete oldLogs from Hbase?
Hi,
I am using hbase 0.94.6 (CDH 4.5).
I saw that my oldLogs folder keeps growing to 4.4T. This stopped at early
October, but still the files doesn't being cleaned.
Can I delete them? Why do i need them on first place?
I see in master log the following NPE:
2014-07-17 08:15:05,862 ERROR
org.apache.hadoop.hbase.master.cleaner.LogCleaner: Caught exception
java.lang.NullPointerException
at
org.apache.hadoop.hbase.replication.ReplicationZookeeper.get
ListHLogsForPeerForRS(ReplicationZookeeper.java:625)
at
org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.loadHLogsFromQueues(ReplicationLogCleaner.java:110)
at
org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.get
DeletableFiles(ReplicationLogCleaner.java:76)
at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteFiles(CleanerChore.java:234)
at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteEntries(CleanerChore.java:158)
at
org.apache.hadoop.hbase.master.cleaner.CleanerChore.chore(CleanerChore.java:125)
at org.apache.hadoop.hbase.Chore.run(Chore.java:67)
at java.lang.Thread.run(Thread.java:744)
I checked for old hbase-defaults.xml in master conf and didn't find such.
Any ideas?
Re: Can I delete oldLogs from Hbase?
Posted by Ted Yu <yu...@gmail.com>.
0.94.6 is pretty old.
Looking at change history of ReplicationLogCleaner.java, you would see
changes that went in after 0.94.6
e.g. HBASE-9377:
Backport HBASE- 9208 - ReplicationLogCleaner slow at large scale (Dave
Latham)
Can you upgrade to newer release ?
On Mon, Dec 8, 2014 at 1:32 PM, Yaniv Yancovich <ya...@gigya-inc.com> wrote:
> Hi,
> I am using hbase 0.94.6 (CDH 4.5).
> I saw that my oldLogs folder keeps growing to 4.4T. This stopped at early
> October, but still the files doesn't being cleaned.
> Can I delete them? Why do i need them on first place?
>
> I see in master log the following NPE:
> 2014-07-17 08:15:05,862 ERROR
> org.apache.hadoop.hbase.master.cleaner.LogCleaner: Caught exception
> java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.replication.ReplicationZookeeper.get
> ListHLogsForPeerForRS(ReplicationZookeeper.java:625)
> at
>
> org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.loadHLogsFromQueues(ReplicationLogCleaner.java:110)
> at
> org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner.get
> DeletableFiles(ReplicationLogCleaner.java:76)
> at
>
> org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteFiles(CleanerChore.java:234)
> at
>
> org.apache.hadoop.hbase.master.cleaner.CleanerChore.checkAndDeleteEntries(CleanerChore.java:158)
> at
>
> org.apache.hadoop.hbase.master.cleaner.CleanerChore.chore(CleanerChore.java:125)
> at org.apache.hadoop.hbase.Chore.run(Chore.java:67)
> at java.lang.Thread.run(Thread.java:744)
>
> I checked for old hbase-defaults.xml in master conf and didn't find such.
>
> Any ideas?
>