You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Jerry Lam <ch...@gmail.com> on 2012/07/01 03:55:00 UTC
Re: Recovering corrupt HLog files
This is interesting because I saw this happens in the past. Is walplayer can be back ported to 0.90.x?
Best Regards,
Jerry
Sent from my iPad
On 2012-06-30, at 16:34, Li Pi <li...@idle.li> wrote:
> Nope. It came out in 0.94 otoh.
>
> On Sat, Jun 30, 2012 at 12:29 PM, Bryan Beaudreault <
> bbeaudreault@hubspot.com> wrote:
>
>> I should have mentioned in my initial email that I am operating on HBase
>> 0.90.4. Is WALPlayer available in this version? I am having trouble
>> finding it or anything similar.
>>
>> On Sat, Jun 30, 2012 at 1:14 PM, Li Pi <li...@idle.li> wrote:
>>
>>> WALPlayer will look at the timestamp. Replaying an older edit that has
>>> since been overwritten shouldn't change anything.
>>>
>>> On Sat, Jun 30, 2012 at 9:49 AM, Bryan Beaudreault <
>>> bbeaudreault@hubspot.com
>>>> wrote:
>>>
>>>> They are all pretty large, around 40+mb. Will the walplayer be smart
>>>> enough to only write edits that still look relevant (i.e. based on
>>>> timestamps of the edits vs timestamps of the versions in hbase)?
>> Writes
>>>> have been coming in since we recovered.
>>>>
>>>> On Sat, Jun 30, 2012 at 11:05 AM, Stack <st...@duboce.net> wrote:
>>>>
>>>>> On Sat, Jun 30, 2012 at 8:38 AM, Bryan Beaudreault
>>>>> <bb...@hubspot.com> wrote:
>>>>>> 12/06/30 00:00:48 INFO wal.HLogSplitter: Got while parsing hlog
>>>>>>
>>>>>
>>>>
>>>
>> hdfs://my-namenode-ip-addr:8020/hbase/.logs/my-rs-ip-addr,60020,1338667719591/my-rs-ip-addr%3A60020.1340935453874.
>>>>>> Marking as corrupted
>>>>>>
>>>>>
>>>>> What size do these logs have?
>>>>>
>>>>>> We are back to stable operating now, and in trying to research
>> this I
>>>>> found
>>>>>> the hdfs://my-namenode-ip-addr:8020/hbase/.corrupt directory.
>> There
>>>> are
>>>>> 20
>>>>>> files listed there.
>>>>>>
>>>>>
>>>>> Ditto.
>>>>>
>>>>>> What are our options for tracking down and potentially recovering
>> any
>>>>> data
>>>>>> that was lost. Or how can we even tell what was lost, if any?
>> Does
>>>> the
>>>>>> existence of these files pretty much guarantee data lost? There
>>> doesn't
>>>>>> seem to be much documentation on this. From reading it seems like
>> it
>>>>> might
>>>>>> be possible that part of each of these files was recovered.
>>>>>>
>>>>>
>>>>> If size > 0, could try walplaying them:
>>>>> http://hbase.apache.org/book.html#walplayer
>>>>>
>>>>> St.Ack
>>>>>
>>>>
>>>
>>