You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by charan kumar <ch...@gmail.com> on 2011/02/23 19:58:08 UTC
huge .oldlogs
Hello,
I was wondering, if I can safely remove the .oldlogs folder. The table
data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB) for
.oldlogs folder.
I am using hbase-0.90.0 hadoop-append.
Thanks,
Charan
Re: huge .oldlogs
Posted by charan kumar <ch...@gmail.com>.
Excellent! Thank you J-D
On Wed, Feb 23, 2011 at 11:45 AM, Jean-Daniel Cryans <jd...@apache.org>wrote:
> Yes, you can delete the content of the folder (not the folder itself)
> safely.
>
> J-D
>
> On Wed, Feb 23, 2011 at 11:37 AM, charan kumar <ch...@gmail.com>
> wrote:
> > I have been inserting a ton of data for the past few days. This looks
> like
> > the issue.
> >
> > If the issue is related to that, can I delete the .oldlogs folder without
> > causing any issues?
> >
> > I will also look into upgrading..
> >
> >
> > On Wed, Feb 23, 2011 at 11:23 AM, Jean-Daniel Cryans <
> jdcryans@apache.org>wrote:
> >
> >> I'll have to trust you on that :)
> >>
> >> The other possible situation is that you are inserting a ton of data
> >> and logs are generated faster than they get cleaned. 0.90.0 has a
> >> limiter that was later removed in 0.90.1 by
> >> https://issues.apache.org/jira/browse/HBASE-3501 so you should upgrade
> >> and see if it fixes it.
> >>
> >> J-D
> >>
> >> On Wed, Feb 23, 2011 at 11:18 AM, charan kumar <ch...@gmail.com>
> >> wrote:
> >> > Hi J-D,
> >> >
> >> > There are no NPE's in the log.
> >> >
> >> > Thanks,
> >> > Charan
> >> >
> >> > On Wed, Feb 23, 2011 at 11:04 AM, Jean-Daniel Cryans <
> >> jdcryans@apache.org>wrote:
> >> >
> >> >> Check you master log, if you see a lot of NPEs then it means you have
> >> >> an old hbase-default.xml lying around.
> >> >>
> >> >> J-D
> >> >>
> >> >> On Wed, Feb 23, 2011 at 10:58 AM, charan kumar <
> charan.kumar@gmail.com>
> >> >> wrote:
> >> >> > Hello,
> >> >> >
> >> >> > I was wondering, if I can safely remove the .oldlogs folder. The
> >> table
> >> >> > data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB)
> for
> >> >> > .oldlogs folder.
> >> >> >
> >> >> > I am using hbase-0.90.0 hadoop-append.
> >> >> >
> >> >> > Thanks,
> >> >> > Charan
> >> >> >
> >> >>
> >> >
> >>
> >
>
Re: huge .oldlogs
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Yes, you can delete the content of the folder (not the folder itself) safely.
J-D
On Wed, Feb 23, 2011 at 11:37 AM, charan kumar <ch...@gmail.com> wrote:
> I have been inserting a ton of data for the past few days. This looks like
> the issue.
>
> If the issue is related to that, can I delete the .oldlogs folder without
> causing any issues?
>
> I will also look into upgrading..
>
>
> On Wed, Feb 23, 2011 at 11:23 AM, Jean-Daniel Cryans <jd...@apache.org>wrote:
>
>> I'll have to trust you on that :)
>>
>> The other possible situation is that you are inserting a ton of data
>> and logs are generated faster than they get cleaned. 0.90.0 has a
>> limiter that was later removed in 0.90.1 by
>> https://issues.apache.org/jira/browse/HBASE-3501 so you should upgrade
>> and see if it fixes it.
>>
>> J-D
>>
>> On Wed, Feb 23, 2011 at 11:18 AM, charan kumar <ch...@gmail.com>
>> wrote:
>> > Hi J-D,
>> >
>> > There are no NPE's in the log.
>> >
>> > Thanks,
>> > Charan
>> >
>> > On Wed, Feb 23, 2011 at 11:04 AM, Jean-Daniel Cryans <
>> jdcryans@apache.org>wrote:
>> >
>> >> Check you master log, if you see a lot of NPEs then it means you have
>> >> an old hbase-default.xml lying around.
>> >>
>> >> J-D
>> >>
>> >> On Wed, Feb 23, 2011 at 10:58 AM, charan kumar <ch...@gmail.com>
>> >> wrote:
>> >> > Hello,
>> >> >
>> >> > I was wondering, if I can safely remove the .oldlogs folder. The
>> table
>> >> > data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB) for
>> >> > .oldlogs folder.
>> >> >
>> >> > I am using hbase-0.90.0 hadoop-append.
>> >> >
>> >> > Thanks,
>> >> > Charan
>> >> >
>> >>
>> >
>>
>
Re: huge .oldlogs
Posted by charan kumar <ch...@gmail.com>.
I have been inserting a ton of data for the past few days. This looks like
the issue.
If the issue is related to that, can I delete the .oldlogs folder without
causing any issues?
I will also look into upgrading..
On Wed, Feb 23, 2011 at 11:23 AM, Jean-Daniel Cryans <jd...@apache.org>wrote:
> I'll have to trust you on that :)
>
> The other possible situation is that you are inserting a ton of data
> and logs are generated faster than they get cleaned. 0.90.0 has a
> limiter that was later removed in 0.90.1 by
> https://issues.apache.org/jira/browse/HBASE-3501 so you should upgrade
> and see if it fixes it.
>
> J-D
>
> On Wed, Feb 23, 2011 at 11:18 AM, charan kumar <ch...@gmail.com>
> wrote:
> > Hi J-D,
> >
> > There are no NPE's in the log.
> >
> > Thanks,
> > Charan
> >
> > On Wed, Feb 23, 2011 at 11:04 AM, Jean-Daniel Cryans <
> jdcryans@apache.org>wrote:
> >
> >> Check you master log, if you see a lot of NPEs then it means you have
> >> an old hbase-default.xml lying around.
> >>
> >> J-D
> >>
> >> On Wed, Feb 23, 2011 at 10:58 AM, charan kumar <ch...@gmail.com>
> >> wrote:
> >> > Hello,
> >> >
> >> > I was wondering, if I can safely remove the .oldlogs folder. The
> table
> >> > data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB) for
> >> > .oldlogs folder.
> >> >
> >> > I am using hbase-0.90.0 hadoop-append.
> >> >
> >> > Thanks,
> >> > Charan
> >> >
> >>
> >
>
Re: huge .oldlogs
Posted by Jean-Daniel Cryans <jd...@apache.org>.
I'll have to trust you on that :)
The other possible situation is that you are inserting a ton of data
and logs are generated faster than they get cleaned. 0.90.0 has a
limiter that was later removed in 0.90.1 by
https://issues.apache.org/jira/browse/HBASE-3501 so you should upgrade
and see if it fixes it.
J-D
On Wed, Feb 23, 2011 at 11:18 AM, charan kumar <ch...@gmail.com> wrote:
> Hi J-D,
>
> There are no NPE's in the log.
>
> Thanks,
> Charan
>
> On Wed, Feb 23, 2011 at 11:04 AM, Jean-Daniel Cryans <jd...@apache.org>wrote:
>
>> Check you master log, if you see a lot of NPEs then it means you have
>> an old hbase-default.xml lying around.
>>
>> J-D
>>
>> On Wed, Feb 23, 2011 at 10:58 AM, charan kumar <ch...@gmail.com>
>> wrote:
>> > Hello,
>> >
>> > I was wondering, if I can safely remove the .oldlogs folder. The table
>> > data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB) for
>> > .oldlogs folder.
>> >
>> > I am using hbase-0.90.0 hadoop-append.
>> >
>> > Thanks,
>> > Charan
>> >
>>
>
Re: huge .oldlogs
Posted by Ted Yu <yu...@gmail.com>.
Please look for other exceptions.
I have been stress testing 0.90.1 and my .oldlogs folder is empty.
On Wed, Feb 23, 2011 at 11:18 AM, charan kumar <ch...@gmail.com>wrote:
> Hi J-D,
>
> There are no NPE's in the log.
>
> Thanks,
> Charan
>
> On Wed, Feb 23, 2011 at 11:04 AM, Jean-Daniel Cryans <jdcryans@apache.org
> >wrote:
>
> > Check you master log, if you see a lot of NPEs then it means you have
> > an old hbase-default.xml lying around.
> >
> > J-D
> >
> > On Wed, Feb 23, 2011 at 10:58 AM, charan kumar <ch...@gmail.com>
> > wrote:
> > > Hello,
> > >
> > > I was wondering, if I can safely remove the .oldlogs folder. The
> table
> > > data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB) for
> > > .oldlogs folder.
> > >
> > > I am using hbase-0.90.0 hadoop-append.
> > >
> > > Thanks,
> > > Charan
> > >
> >
>
Re: huge .oldlogs
Posted by charan kumar <ch...@gmail.com>.
Hi J-D,
There are no NPE's in the log.
Thanks,
Charan
On Wed, Feb 23, 2011 at 11:04 AM, Jean-Daniel Cryans <jd...@apache.org>wrote:
> Check you master log, if you see a lot of NPEs then it means you have
> an old hbase-default.xml lying around.
>
> J-D
>
> On Wed, Feb 23, 2011 at 10:58 AM, charan kumar <ch...@gmail.com>
> wrote:
> > Hello,
> >
> > I was wondering, if I can safely remove the .oldlogs folder. The table
> > data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB) for
> > .oldlogs folder.
> >
> > I am using hbase-0.90.0 hadoop-append.
> >
> > Thanks,
> > Charan
> >
>
Re: huge .oldlogs
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Check you master log, if you see a lot of NPEs then it means you have
an old hbase-default.xml lying around.
J-D
On Wed, Feb 23, 2011 at 10:58 AM, charan kumar <ch...@gmail.com> wrote:
> Hello,
>
> I was wondering, if I can safely remove the .oldlogs folder. The table
> data I have has 1 TB , where as 2.5 TB (with replication 7.5 TB) for
> .oldlogs folder.
>
> I am using hbase-0.90.0 hadoop-append.
>
> Thanks,
> Charan
>