You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@kafka.apache.org by "Stoyan Stoyanov (Jira)" <ji...@apache.org> on 2019/10/28 16:26:00 UTC

[jira] [Comment Edited] (KAFKA-4972) Kafka 0.10.0 Found a corrupted index file during Kafka broker startup

    [ https://issues.apache.org/jira/browse/KAFKA-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961220#comment-16961220 ] 

Stoyan Stoyanov edited comment on KAFKA-4972 at 10/28/19 4:25 PM:
------------------------------------------------------------------

Seen in version 2.2.1

One mitigation is:
 # Stop Kafka
 # Delete all "*.timeindex" files
 # Start Kafka again


was (Author: stoyan.stoyanov):
Seen in version 2.2.1

> Kafka 0.10.0  Found a corrupted index file during Kafka broker startup
> ----------------------------------------------------------------------
>
>                 Key: KAFKA-4972
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4972
>             Project: Kafka
>          Issue Type: Bug
>          Components: log
>    Affects Versions: 0.10.0.0
>         Environment: JDK: HotSpot  x64  1.7.0_80
> Tag: 0.10.0
>            Reporter: fangjinuo
>            Priority: Critical
>              Labels: reliability
>         Attachments: Snap3.png
>
>
> -deleted text-After force shutdown all kafka brokers one by one, restart them one by one, but a broker startup failure.
> The following WARN leval log was found in the log file:
> found a corrutped index file,  xxxx.index , delet it  ...
> you can view details by following attachment.
> ~I look up some codes in core module, found out :
> the nonthreadsafe method LogSegment.append(offset, messages)  has tow caller:
> 1) Log.append(messages)                          // here has a synchronized lock 
> 2) LogCleaner.cleanInto(topicAndPartition, source, dest, map, retainDeletes, messageFormatVersion)   // here has not 
> So I guess this may be the reason for the repeated offset in 00000xx.log file (logsegment's .log) ~
> Although this is just my inference, but I hope that this problem can be quickly repaired



--
This message was sent by Atlassian Jira
(v8.3.4#803005)