You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by Clint Morgan <cm...@troove.net> on 2008/06/09 21:42:29 UTC

current status of regionserver's logs

I'm trying to figure out how write ahead logging is working, but don't
see where/how the log is read (eg on regionserver recovery). Can
someone let me know what the status is? Is it intended to wait on hdfs
append before working on recovery process?

cheers,
-clint

Re: current status of regionserver's logs

Posted by Clint Morgan <cl...@gmail.com>.
Nevermind, found it in HStore

On Mon, Jun 9, 2008 at 1:05 PM, Clint Morgan <cl...@gmail.com> wrote:
> Cool, so ProcessServerShutdown splits up a reionservers logs amongst
> its regions.
>
> Where does the region replay the log when it comes back up (to move
> non-flushed edits into Memcache/hstore)?
>
>
> On Mon, Jun 9, 2008 at 12:48 PM, Jim Kellerman <ji...@powerset.com> wrote:
>> Logs are recovered by the Master when it detects that a region server has died.
>> If you are looking at trunk, see: o.a.h.h.master.BaseScanner.checkAssigned and o.a.h.master.ProcessServerShutdown
>>
>> ---
>> Jim Kellerman, Senior Engineer; Powerset
>>
>>
>>> -----Original Message-----
>>> From: clint.a.m@gmail.com [mailto:clint.a.m@gmail.com] On
>>> Behalf Of Clint Morgan
>>> Sent: Monday, June 09, 2008 12:42 PM
>>> To: hbase-dev@hadoop.apache.org
>>> Subject: current status of regionserver's logs
>>>
>>> I'm trying to figure out how write ahead logging is working,
>>> but don't see where/how the log is read (eg on regionserver
>>> recovery). Can someone let me know what the status is? Is it
>>> intended to wait on hdfs append before working on recovery process?
>>>
>>> cheers,
>>> -clint
>>>
>>> No virus found in this incoming message.
>>> Checked by AVG.
>>> Version: 8.0.100 / Virus Database: 270.1.0/1492 - Release
>>> Date: 6/9/2008 10:29 AM
>>>
>> No virus found in this outgoing message.
>> Checked by AVG.
>> Version: 8.0.100 / Virus Database: 270.1.0/1492 - Release Date: 6/9/2008 10:29 AM
>>
>

Re: current status of regionserver's logs

Posted by Clint Morgan <cl...@gmail.com>.
Cool, so ProcessServerShutdown splits up a reionservers logs amongst
its regions.

Where does the region replay the log when it comes back up (to move
non-flushed edits into Memcache/hstore)?


On Mon, Jun 9, 2008 at 12:48 PM, Jim Kellerman <ji...@powerset.com> wrote:
> Logs are recovered by the Master when it detects that a region server has died.
> If you are looking at trunk, see: o.a.h.h.master.BaseScanner.checkAssigned and o.a.h.master.ProcessServerShutdown
>
> ---
> Jim Kellerman, Senior Engineer; Powerset
>
>
>> -----Original Message-----
>> From: clint.a.m@gmail.com [mailto:clint.a.m@gmail.com] On
>> Behalf Of Clint Morgan
>> Sent: Monday, June 09, 2008 12:42 PM
>> To: hbase-dev@hadoop.apache.org
>> Subject: current status of regionserver's logs
>>
>> I'm trying to figure out how write ahead logging is working,
>> but don't see where/how the log is read (eg on regionserver
>> recovery). Can someone let me know what the status is? Is it
>> intended to wait on hdfs append before working on recovery process?
>>
>> cheers,
>> -clint
>>
>> No virus found in this incoming message.
>> Checked by AVG.
>> Version: 8.0.100 / Virus Database: 270.1.0/1492 - Release
>> Date: 6/9/2008 10:29 AM
>>
> No virus found in this outgoing message.
> Checked by AVG.
> Version: 8.0.100 / Virus Database: 270.1.0/1492 - Release Date: 6/9/2008 10:29 AM
>

RE: current status of regionserver's logs

Posted by Jim Kellerman <ji...@powerset.com>.
Logs are recovered by the Master when it detects that a region server has died.
If you are looking at trunk, see: o.a.h.h.master.BaseScanner.checkAssigned and o.a.h.master.ProcessServerShutdown

---
Jim Kellerman, Senior Engineer; Powerset


> -----Original Message-----
> From: clint.a.m@gmail.com [mailto:clint.a.m@gmail.com] On
> Behalf Of Clint Morgan
> Sent: Monday, June 09, 2008 12:42 PM
> To: hbase-dev@hadoop.apache.org
> Subject: current status of regionserver's logs
>
> I'm trying to figure out how write ahead logging is working,
> but don't see where/how the log is read (eg on regionserver
> recovery). Can someone let me know what the status is? Is it
> intended to wait on hdfs append before working on recovery process?
>
> cheers,
> -clint
>
> No virus found in this incoming message.
> Checked by AVG.
> Version: 8.0.100 / Virus Database: 270.1.0/1492 - Release
> Date: 6/9/2008 10:29 AM
>
No virus found in this outgoing message.
Checked by AVG.
Version: 8.0.100 / Virus Database: 270.1.0/1492 - Release Date: 6/9/2008 10:29 AM