You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@bookkeeper.apache.org by John Nagro <jn...@hubspot.com> on 2012/07/09 19:07:36 UTC

Bk Server Log Error

Hello -

I just upgraded my 4.1-SNAPSHOT servers to 4.1.1-SNAPSHOT today and noticed
this error message repeating in the logs of a single server. I have 5
servers total, the other 4 appear to be working normally.

Thanks!

-John Nagro

ERRORS:

2012-07-09 13:03:12,779 - INFO
 [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log
meta from entryLogId: 23
2012-07-09 13:03:33,797 - WARN
 [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception
when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438
(169!=338)
at
org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:03:35,059 - INFO
 [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log
meta from entryLogId: 23
2012-07-09 13:03:54,874 - WARN
 [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception
when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438
(169!=338)
at
org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:03:56,146 - INFO
 [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log
meta from entryLogId: 23
2012-07-09 13:04:15,583 - WARN
 [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception
when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438
(169!=338)
at
org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:04:16,842 - INFO
 [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log
meta from entryLogId: 23
2012-07-09 13:04:38,692 - WARN
 [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception
when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438
(169!=338)
at
org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:04:39,957 - INFO
 [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log
meta from entryLogId: 23
2012-07-09 13:05:01,227 - WARN
 [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception
when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438
(169!=338)
at
org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:05:02,541 - INFO
 [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log
meta from entryLogId: 23
2012-07-09 13:05:24,777 - WARN
 [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception
when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438
(169!=338)
at
org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:05:26,036 - INFO
 [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log
meta from entryLogId: 23
2012-07-09 13:05:48,835 - WARN
 [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception
when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438
(169!=338)
at
org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at
org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)

Re: Bk Server Log Error

Posted by Sijie Guo <gu...@gmail.com>.
yes. so why I am asking the gcWaitTime setting. I think GcThread had
scanned to entry log 23, but entry log 23 has last entry corrupted. so it
would start scanning from entry log 23 again, because we haven't finished
scan entry log 23.

On Tue, Jul 10, 2012 at 2:25 PM, Uma Maheswara Rao G
<ma...@huawei.com>wrote:

>  Is that Bookie met any sudden crash?
>
> As Sijie pointed some thing wrong in flushing. Anyway on scan failure, it
> will reconsider for scan again I think. That might be the reason, you are
> getting this message again and again.
>
> But we have to address the root for that short read.
>
>
>
> Regards,
>
> Uma
>  ------------------------------
> *From:* Sijie Guo [guosijie@gmail.com]
> *Sent:* Tuesday, July 10, 2012 11:39 AM
> *To:* bookkeeper-user@zookeeper.apache.org
> *Subject:* Re: Bk Server Log Error
>
>  John,
>
>  Is entry log 23 the latest entry log? What is the file length of entry
> log 23?
>
>  I am doubting the entry at the offset 1534204438 @ entry log 23 would be
> last entry of entry log 23. And there is something wrong happened on
> flushing entry log 23 when you shutdown that bookie server.
>
>  BTW, what is your gcWaitTime setting? is it 1000ms?
>
>
>
> On Tue, Jul 10, 2012 at 1:07 AM, John Nagro <jn...@hubspot.com> wrote:
>
>> Hello -
>>
>>  I just upgraded my 4.1-SNAPSHOT servers to 4.1.1-SNAPSHOT today and
>> noticed this error message repeating in the logs of a single server. I have
>> 5 servers total, the other 4 appear to be working normally.
>>
>>  Thanks!
>>
>>  -John Nagro
>>
>>  ERRORS:
>>
>>  2012-07-09 13:03:12,779 - INFO
>>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
>> log meta from entryLogId: 23
>> 2012-07-09 13:03:33,797 - WARN
>>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
>> exception when processing 23recovery will take care of the problem
>> java.io.IOException: Short read for ledger entry from entryLog
>> 23@1534204438(169!=338)
>> at
>> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>> 2012-07-09 13:03:35,059 - INFO
>>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
>> log meta from entryLogId: 23
>> 2012-07-09 13:03:54,874 - WARN
>>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
>> exception when processing 23recovery will take care of the problem
>> java.io.IOException: Short read for ledger entry from entryLog
>> 23@1534204438(169!=338)
>> at
>> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>> 2012-07-09 13:03:56,146 - INFO
>>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
>> log meta from entryLogId: 23
>> 2012-07-09 13:04:15,583 - WARN
>>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
>> exception when processing 23recovery will take care of the problem
>> java.io.IOException: Short read for ledger entry from entryLog
>> 23@1534204438(169!=338)
>> at
>> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>> 2012-07-09 13:04:16,842 - INFO
>>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
>> log meta from entryLogId: 23
>> 2012-07-09 13:04:38,692 - WARN
>>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
>> exception when processing 23recovery will take care of the problem
>> java.io.IOException: Short read for ledger entry from entryLog
>> 23@1534204438(169!=338)
>> at
>> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>> 2012-07-09 13:04:39,957 - INFO
>>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
>> log meta from entryLogId: 23
>> 2012-07-09 13:05:01,227 - WARN
>>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
>> exception when processing 23recovery will take care of the problem
>> java.io.IOException: Short read for ledger entry from entryLog
>> 23@1534204438(169!=338)
>> at
>> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>> 2012-07-09 13:05:02,541 - INFO
>>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
>> log meta from entryLogId: 23
>> 2012-07-09 13:05:24,777 - WARN
>>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
>> exception when processing 23recovery will take care of the problem
>> java.io.IOException: Short read for ledger entry from entryLog
>> 23@1534204438(169!=338)
>> at
>> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>> 2012-07-09 13:05:26,036 - INFO
>>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
>> log meta from entryLogId: 23
>> 2012-07-09 13:05:48,835 - WARN
>>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
>> exception when processing 23recovery will take care of the problem
>> java.io.IOException: Short read for ledger entry from entryLog
>> 23@1534204438(169!=338)
>> at
>> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>> at
>> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>>
>
>

RE: Bk Server Log Error

Posted by Uma Maheswara Rao G <ma...@huawei.com>.
Is that Bookie met any sudden crash?

As Sijie pointed some thing wrong in flushing. Anyway on scan failure, it will reconsider for scan again I think. That might be the reason, you are getting this message again and again.

But we have to address the root for that short read.



Regards,

Uma

________________________________
From: Sijie Guo [guosijie@gmail.com]
Sent: Tuesday, July 10, 2012 11:39 AM
To: bookkeeper-user@zookeeper.apache.org
Subject: Re: Bk Server Log Error

John,

Is entry log 23 the latest entry log? What is the file length of entry log 23?

I am doubting the entry at the offset 1534204438 @ entry log 23 would be last entry of entry log 23. And there is something wrong happened on flushing entry log 23 when you shutdown that bookie server.

BTW, what is your gcWaitTime setting? is it 1000ms?



On Tue, Jul 10, 2012 at 1:07 AM, John Nagro <jn...@hubspot.com>> wrote:
Hello -

I just upgraded my 4.1-SNAPSHOT servers to 4.1.1-SNAPSHOT today and noticed this error message repeating in the logs of a single server. I have 5 servers total, the other 4 appear to be working normally.

Thanks!

-John Nagro

ERRORS:

2012-07-09 13:03:12,779 - INFO  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23
2012-07-09 13:03:33,797 - WARN  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338)
at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:03:35,059 - INFO  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23
2012-07-09 13:03:54,874 - WARN  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338)
at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:03:56,146 - INFO  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23
2012-07-09 13:04:15,583 - WARN  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338)
at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:04:16,842 - INFO  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23
2012-07-09 13:04:38,692 - WARN  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338)
at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:04:39,957 - INFO  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23
2012-07-09 13:05:01,227 - WARN  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338)
at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:05:02,541 - INFO  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23
2012-07-09 13:05:24,777 - WARN  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338)
at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
2012-07-09 13:05:26,036 - INFO  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23
2012-07-09 13:05:48,835 - WARN  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem
java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338)
at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)


Re: Bk Server Log Error

Posted by Sijie Guo <gu...@gmail.com>.
John,

Is entry log 23 the latest entry log? What is the file length of entry log
23?

I am doubting the entry at the offset 1534204438 @ entry log 23 would be
last entry of entry log 23. And there is something wrong happened on
flushing entry log 23 when you shutdown that bookie server.

BTW, what is your gcWaitTime setting? is it 1000ms?



On Tue, Jul 10, 2012 at 1:07 AM, John Nagro <jn...@hubspot.com> wrote:

> Hello -
>
> I just upgraded my 4.1-SNAPSHOT servers to 4.1.1-SNAPSHOT today and
> noticed this error message repeating in the logs of a single server. I have
> 5 servers total, the other 4 appear to be working normally.
>
> Thanks!
>
> -John Nagro
>
> ERRORS:
>
> 2012-07-09 13:03:12,779 - INFO
>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
> log meta from entryLogId: 23
> 2012-07-09 13:03:33,797 - WARN
>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
> exception when processing 23recovery will take care of the problem
> java.io.IOException: Short read for ledger entry from entryLog
> 23@1534204438(169!=338)
>  at
> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
> 2012-07-09 13:03:35,059 - INFO
>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
> log meta from entryLogId: 23
> 2012-07-09 13:03:54,874 - WARN
>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
> exception when processing 23recovery will take care of the problem
> java.io.IOException: Short read for ledger entry from entryLog
> 23@1534204438(169!=338)
> at
> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
> 2012-07-09 13:03:56,146 - INFO
>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
> log meta from entryLogId: 23
> 2012-07-09 13:04:15,583 - WARN
>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
> exception when processing 23recovery will take care of the problem
> java.io.IOException: Short read for ledger entry from entryLog
> 23@1534204438(169!=338)
>  at
> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
> 2012-07-09 13:04:16,842 - INFO
>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
> log meta from entryLogId: 23
> 2012-07-09 13:04:38,692 - WARN
>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
> exception when processing 23recovery will take care of the problem
> java.io.IOException: Short read for ledger entry from entryLog
> 23@1534204438(169!=338)
> at
> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
> 2012-07-09 13:04:39,957 - INFO
>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
> log meta from entryLogId: 23
> 2012-07-09 13:05:01,227 - WARN
>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
> exception when processing 23recovery will take care of the problem
> java.io.IOException: Short read for ledger entry from entryLog
> 23@1534204438(169!=338)
>  at
> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
> 2012-07-09 13:05:02,541 - INFO
>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
> log meta from entryLogId: 23
> 2012-07-09 13:05:24,777 - WARN
>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
> exception when processing 23recovery will take care of the problem
> java.io.IOException: Short read for ledger entry from entryLog
> 23@1534204438(169!=338)
> at
> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
> 2012-07-09 13:05:26,036 - INFO
>  [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry
> log meta from entryLogId: 23
> 2012-07-09 13:05:48,835 - WARN
>  [GarbageCollectorThread:GarbageCollectorThread@485] - Premature
> exception when processing 23recovery will take care of the problem
> java.io.IOException: Short read for ledger entry from entryLog
> 23@1534204438(169!=338)
>  at
> org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504)
>  at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481)
> at
> org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
>