You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by yonghu <yo...@gmail.com> on 2012/04/15 17:58:38 UTC
dump HLog content!
Hello,
My hbase version is 0.92.0 and is installed in pseudo-mode. I found a
strange situation of HLog. After I inserted new data value into table,
the volume of HLog is 0. I checked in HDFS.
drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34 /hbase/.logs
drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34
/hbase/.logs/yonghu-laptop,60020,1334504008467
-rw-r--r-- 3 yonghu supergroup 0 2012-04-15 17:34
/hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
But I can use hbase org.apache.hadoop.hbase.regionserver.wal.HLog
--dump to see the content of log information. However, if I write java
program to extract the log information. The output is null! Somebody
knows why?
Thanks!
Yong
Re: dump HLog content!
Posted by yonghu <yo...@gmail.com>.
Thanks for your important information. I have found this information
in the hbase-default.xml file.
Regards!
Yong
On Sun, Apr 15, 2012 at 8:36 PM, Manish Bhoge
<ma...@rocketmail.com> wrote:
> Yong,
>
> It is a Hlog log roll property that keep the log size 0 until the complete block is written OR until it completes the log roll duration mentioned in configuration (default 60 min). However it still persists the edits in .edit files and once it reaches to the interval defined for log roll it writes back to log. That is the reason you can see the logs(size) more than zero byte.eventually it moves the log into .oldlogs also.
>
> Thanks
> Manish
> Sent from my BlackBerry, pls excuse typo
>
> -----Original Message-----
> From: yonghu <yo...@gmail.com>
> Date: Sun, 15 Apr 2012 18:58:45
> To: <us...@hbase.apache.org>
> Reply-To: user@hbase.apache.org
> Subject: Re: dump HLog content!
>
> Thanks for your reply. After nearly 60minutes, I can see the Hlog volume.
>
> -rw-r--r-- 3 yonghu supergroup 2125 2012-04-15 17:34
> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>
> I have no idea why it takes so long time.
>
> Yong
>
> On Sun, Apr 15, 2012 at 6:34 PM, yonghu <yo...@gmail.com> wrote:
>> yes
>>
>> On Sun, Apr 15, 2012 at 6:30 PM, Ted Yu <yu...@gmail.com> wrote:
>>> Did 'HLog --dump' show real contents for a 0-sized file ?
>>>
>>> Cheers
>>>
>>> On Sun, Apr 15, 2012 at 8:58 AM, yonghu <yo...@gmail.com> wrote:
>>>
>>>> Hello,
>>>>
>>>> My hbase version is 0.92.0 and is installed in pseudo-mode. I found a
>>>> strange situation of HLog. After I inserted new data value into table,
>>>> the volume of HLog is 0. I checked in HDFS.
>>>>
>>>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34 /hbase/.logs
>>>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34
>>>> /hbase/.logs/yonghu-laptop,60020,1334504008467
>>>> -rw-r--r-- 3 yonghu supergroup 0 2012-04-15 17:34
>>>>
>>>> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>>>>
>>>> But I can use hbase org.apache.hadoop.hbase.regionserver.wal.HLog
>>>> --dump to see the content of log information. However, if I write java
>>>> program to extract the log information. The output is null! Somebody
>>>> knows why?
>>>>
>>>> Thanks!
>>>>
>>>> Yong
>>>>
Re: dump HLog content!
Posted by Manish Bhoge <ma...@rocketmail.com>.
Yong,
It is a Hlog log roll property that keep the log size 0 until the complete block is written OR until it completes the log roll duration mentioned in configuration (default 60 min). However it still persists the edits in .edit files and once it reaches to the interval defined for log roll it writes back to log. That is the reason you can see the logs(size) more than zero byte.eventually it moves the log into .oldlogs also.
Thanks
Manish
Sent from my BlackBerry, pls excuse typo
-----Original Message-----
From: yonghu <yo...@gmail.com>
Date: Sun, 15 Apr 2012 18:58:45
To: <us...@hbase.apache.org>
Reply-To: user@hbase.apache.org
Subject: Re: dump HLog content!
Thanks for your reply. After nearly 60minutes, I can see the Hlog volume.
-rw-r--r-- 3 yonghu supergroup 2125 2012-04-15 17:34
/hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
I have no idea why it takes so long time.
Yong
On Sun, Apr 15, 2012 at 6:34 PM, yonghu <yo...@gmail.com> wrote:
> yes
>
> On Sun, Apr 15, 2012 at 6:30 PM, Ted Yu <yu...@gmail.com> wrote:
>> Did 'HLog --dump' show real contents for a 0-sized file ?
>>
>> Cheers
>>
>> On Sun, Apr 15, 2012 at 8:58 AM, yonghu <yo...@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> My hbase version is 0.92.0 and is installed in pseudo-mode. I found a
>>> strange situation of HLog. After I inserted new data value into table,
>>> the volume of HLog is 0. I checked in HDFS.
>>>
>>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34 /hbase/.logs
>>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34
>>> /hbase/.logs/yonghu-laptop,60020,1334504008467
>>> -rw-r--r-- 3 yonghu supergroup 0 2012-04-15 17:34
>>>
>>> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>>>
>>> But I can use hbase org.apache.hadoop.hbase.regionserver.wal.HLog
>>> --dump to see the content of log information. However, if I write java
>>> program to extract the log information. The output is null! Somebody
>>> knows why?
>>>
>>> Thanks!
>>>
>>> Yong
>>>
Re: dump HLog content!
Posted by yonghu <yo...@gmail.com>.
Thanks for your reply. After nearly 60minutes, I can see the Hlog volume.
-rw-r--r-- 3 yonghu supergroup 2125 2012-04-15 17:34
/hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
I have no idea why it takes so long time.
Yong
On Sun, Apr 15, 2012 at 6:34 PM, yonghu <yo...@gmail.com> wrote:
> yes
>
> On Sun, Apr 15, 2012 at 6:30 PM, Ted Yu <yu...@gmail.com> wrote:
>> Did 'HLog --dump' show real contents for a 0-sized file ?
>>
>> Cheers
>>
>> On Sun, Apr 15, 2012 at 8:58 AM, yonghu <yo...@gmail.com> wrote:
>>
>>> Hello,
>>>
>>> My hbase version is 0.92.0 and is installed in pseudo-mode. I found a
>>> strange situation of HLog. After I inserted new data value into table,
>>> the volume of HLog is 0. I checked in HDFS.
>>>
>>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34 /hbase/.logs
>>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34
>>> /hbase/.logs/yonghu-laptop,60020,1334504008467
>>> -rw-r--r-- 3 yonghu supergroup 0 2012-04-15 17:34
>>>
>>> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>>>
>>> But I can use hbase org.apache.hadoop.hbase.regionserver.wal.HLog
>>> --dump to see the content of log information. However, if I write java
>>> program to extract the log information. The output is null! Somebody
>>> knows why?
>>>
>>> Thanks!
>>>
>>> Yong
>>>
Re: dump HLog content!
Posted by yonghu <yo...@gmail.com>.
yes
On Sun, Apr 15, 2012 at 6:30 PM, Ted Yu <yu...@gmail.com> wrote:
> Did 'HLog --dump' show real contents for a 0-sized file ?
>
> Cheers
>
> On Sun, Apr 15, 2012 at 8:58 AM, yonghu <yo...@gmail.com> wrote:
>
>> Hello,
>>
>> My hbase version is 0.92.0 and is installed in pseudo-mode. I found a
>> strange situation of HLog. After I inserted new data value into table,
>> the volume of HLog is 0. I checked in HDFS.
>>
>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34 /hbase/.logs
>> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34
>> /hbase/.logs/yonghu-laptop,60020,1334504008467
>> -rw-r--r-- 3 yonghu supergroup 0 2012-04-15 17:34
>>
>> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>>
>> But I can use hbase org.apache.hadoop.hbase.regionserver.wal.HLog
>> --dump to see the content of log information. However, if I write java
>> program to extract the log information. The output is null! Somebody
>> knows why?
>>
>> Thanks!
>>
>> Yong
>>
Re: dump HLog content!
Posted by Ted Yu <yu...@gmail.com>.
Did 'HLog --dump' show real contents for a 0-sized file ?
Cheers
On Sun, Apr 15, 2012 at 8:58 AM, yonghu <yo...@gmail.com> wrote:
> Hello,
>
> My hbase version is 0.92.0 and is installed in pseudo-mode. I found a
> strange situation of HLog. After I inserted new data value into table,
> the volume of HLog is 0. I checked in HDFS.
>
> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34 /hbase/.logs
> drwxr-xr-x - yonghu supergroup 0 2012-04-15 17:34
> /hbase/.logs/yonghu-laptop,60020,1334504008467
> -rw-r--r-- 3 yonghu supergroup 0 2012-04-15 17:34
>
> /hbase/.logs/yonghu-laptop,60020,1334504008467/yonghu-laptop%2C60020%2C1334504008467.1334504048854
>
> But I can use hbase org.apache.hadoop.hbase.regionserver.wal.HLog
> --dump to see the content of log information. However, if I write java
> program to extract the log information. The output is null! Somebody
> knows why?
>
> Thanks!
>
> Yong
>