You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Kane Kane <ka...@gmail.com> on 2013/10/15 00:05:20 UTC
unclean shutdown
After unclean shutdown kafka reports this error on startup:
[2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
java.lang.IllegalArgumentException: requirement failed: Corrupt index
found, index file (/disk1/kafka-logs/perf2-22/00000000000000000000.index)
has non-zero size but the last offset is 0 and the base offset is 0
How it's supposed to bring broker back after unclean shutdown?
Thanks.
Re: unclean shutdown
Posted by Kane Kane <ka...@gmail.com>.
Thanks!
On Mon, Oct 14, 2013 at 5:29 PM, Neha Narkhede <ne...@gmail.com>wrote:
> Just deleting the index files should fix this issue.
>
>
> On Mon, Oct 14, 2013 at 5:23 PM, Kane Kane <ka...@gmail.com> wrote:
>
> > Thanks a lot Neha, so I have to delete only index files not log files
> > themselves? What is better way to do that?
> >
> >
> > On Mon, Oct 14, 2013 at 4:52 PM, Neha Narkhede <neha.narkhede@gmail.com
> > >wrote:
> >
> > > It is possible that the unclean broker shutdown left the index in an
> > > inconsistent state. You can delete the corrupted index files, that will
> > > make the Kafka server rebuild the index on startup.
> > >
> > > Thanks,
> > > Neha
> > >
> > >
> > > On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com>
> > wrote:
> > >
> > > > After unclean shutdown kafka reports this error on startup:
> > > > [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
> > > > startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> > > > java.lang.IllegalArgumentException: requirement failed: Corrupt index
> > > > found, index file
> > (/disk1/kafka-logs/perf2-22/00000000000000000000.index)
> > > > has non-zero size but the last offset is 0 and the base offset is 0
> > > >
> > > > How it's supposed to bring broker back after unclean shutdown?
> > > >
> > > > Thanks.
> > > >
> > >
> >
>
Re: unclean shutdown
Posted by Neha Narkhede <ne...@gmail.com>.
Just deleting the index files should fix this issue.
On Mon, Oct 14, 2013 at 5:23 PM, Kane Kane <ka...@gmail.com> wrote:
> Thanks a lot Neha, so I have to delete only index files not log files
> themselves? What is better way to do that?
>
>
> On Mon, Oct 14, 2013 at 4:52 PM, Neha Narkhede <neha.narkhede@gmail.com
> >wrote:
>
> > It is possible that the unclean broker shutdown left the index in an
> > inconsistent state. You can delete the corrupted index files, that will
> > make the Kafka server rebuild the index on startup.
> >
> > Thanks,
> > Neha
> >
> >
> > On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com>
> wrote:
> >
> > > After unclean shutdown kafka reports this error on startup:
> > > [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
> > > startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> > > java.lang.IllegalArgumentException: requirement failed: Corrupt index
> > > found, index file
> (/disk1/kafka-logs/perf2-22/00000000000000000000.index)
> > > has non-zero size but the last offset is 0 and the base offset is 0
> > >
> > > How it's supposed to bring broker back after unclean shutdown?
> > >
> > > Thanks.
> > >
> >
>
Re: unclean shutdown
Posted by Kane Kane <ka...@gmail.com>.
Thanks a lot Neha, so I have to delete only index files not log files
themselves? What is better way to do that?
On Mon, Oct 14, 2013 at 4:52 PM, Neha Narkhede <ne...@gmail.com>wrote:
> It is possible that the unclean broker shutdown left the index in an
> inconsistent state. You can delete the corrupted index files, that will
> make the Kafka server rebuild the index on startup.
>
> Thanks,
> Neha
>
>
> On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com> wrote:
>
> > After unclean shutdown kafka reports this error on startup:
> > [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
> > startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> > java.lang.IllegalArgumentException: requirement failed: Corrupt index
> > found, index file (/disk1/kafka-logs/perf2-22/00000000000000000000.index)
> > has non-zero size but the last offset is 0 and the base offset is 0
> >
> > How it's supposed to bring broker back after unclean shutdown?
> >
> > Thanks.
> >
>
Re: unclean shutdown
Posted by Kane Kane <ka...@gmail.com>.
I couldn't reproduce it yet, I'm rolling out the fresh install and trying
to do so.
On Mon, Oct 14, 2013 at 8:40 PM, Jun Rao <ju...@gmail.com> wrote:
> Is this issue reproducible?
>
> Thanks,
>
> Jun
>
>
> On Mon, Oct 14, 2013 at 8:30 PM, Kane Kane <ka...@gmail.com> wrote:
>
> > Yes, my expectation would be that broker will try to restore or delete it
> > itself.
> >
> >
> > On Mon, Oct 14, 2013 at 5:55 PM, Sriram Subramanian <
> > srsubramanian@linkedin.com> wrote:
> >
> > > Is this a bug? Can an unclean shutdown leave the index in a corrupt
> state
> > > that the broker cannot start (expected state)?
> > >
> > > On 10/14/13 4:52 PM, "Neha Narkhede" <ne...@gmail.com> wrote:
> > >
> > > > It is possible that the unclean broker shutdown left the index in an
> > > >inconsistent state. You can delete the corrupted index files, that
> will
> > > >make the Kafka server rebuild the index on startup.
> > > >
> > > >Thanks,
> > > >Neha
> > > >
> > > >
> > > >On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com>
> > wrote:
> > > >
> > > >> After unclean shutdown kafka reports this error on startup:
> > > >> [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
> > > >> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> > > >> java.lang.IllegalArgumentException: requirement failed: Corrupt
> index
> > > >> found, index file
> > > >>(/disk1/kafka-logs/perf2-22/00000000000000000000.index)
> > > >> has non-zero size but the last offset is 0 and the base offset is 0
> > > >>
> > > >> How it's supposed to bring broker back after unclean shutdown?
> > > >>
> > > >> Thanks.
> > > >>
> > >
> > >
> >
>
Re: unclean shutdown
Posted by Jun Rao <ju...@gmail.com>.
Is this issue reproducible?
Thanks,
Jun
On Mon, Oct 14, 2013 at 8:30 PM, Kane Kane <ka...@gmail.com> wrote:
> Yes, my expectation would be that broker will try to restore or delete it
> itself.
>
>
> On Mon, Oct 14, 2013 at 5:55 PM, Sriram Subramanian <
> srsubramanian@linkedin.com> wrote:
>
> > Is this a bug? Can an unclean shutdown leave the index in a corrupt state
> > that the broker cannot start (expected state)?
> >
> > On 10/14/13 4:52 PM, "Neha Narkhede" <ne...@gmail.com> wrote:
> >
> > > It is possible that the unclean broker shutdown left the index in an
> > >inconsistent state. You can delete the corrupted index files, that will
> > >make the Kafka server rebuild the index on startup.
> > >
> > >Thanks,
> > >Neha
> > >
> > >
> > >On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com>
> wrote:
> > >
> > >> After unclean shutdown kafka reports this error on startup:
> > >> [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
> > >> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> > >> java.lang.IllegalArgumentException: requirement failed: Corrupt index
> > >> found, index file
> > >>(/disk1/kafka-logs/perf2-22/00000000000000000000.index)
> > >> has non-zero size but the last offset is 0 and the base offset is 0
> > >>
> > >> How it's supposed to bring broker back after unclean shutdown?
> > >>
> > >> Thanks.
> > >>
> >
> >
>
Re: unclean shutdown
Posted by Kane Kane <ka...@gmail.com>.
Yes, my expectation would be that broker will try to restore or delete it
itself.
On Mon, Oct 14, 2013 at 5:55 PM, Sriram Subramanian <
srsubramanian@linkedin.com> wrote:
> Is this a bug? Can an unclean shutdown leave the index in a corrupt state
> that the broker cannot start (expected state)?
>
> On 10/14/13 4:52 PM, "Neha Narkhede" <ne...@gmail.com> wrote:
>
> > It is possible that the unclean broker shutdown left the index in an
> >inconsistent state. You can delete the corrupted index files, that will
> >make the Kafka server rebuild the index on startup.
> >
> >Thanks,
> >Neha
> >
> >
> >On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com> wrote:
> >
> >> After unclean shutdown kafka reports this error on startup:
> >> [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
> >> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> >> java.lang.IllegalArgumentException: requirement failed: Corrupt index
> >> found, index file
> >>(/disk1/kafka-logs/perf2-22/00000000000000000000.index)
> >> has non-zero size but the last offset is 0 and the base offset is 0
> >>
> >> How it's supposed to bring broker back after unclean shutdown?
> >>
> >> Thanks.
> >>
>
>
Re: unclean shutdown
Posted by Sriram Subramanian <sr...@linkedin.com>.
Is this a bug? Can an unclean shutdown leave the index in a corrupt state
that the broker cannot start (expected state)?
On 10/14/13 4:52 PM, "Neha Narkhede" <ne...@gmail.com> wrote:
> It is possible that the unclean broker shutdown left the index in an
>inconsistent state. You can delete the corrupted index files, that will
>make the Kafka server rebuild the index on startup.
>
>Thanks,
>Neha
>
>
>On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com> wrote:
>
>> After unclean shutdown kafka reports this error on startup:
>> [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
>> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
>> java.lang.IllegalArgumentException: requirement failed: Corrupt index
>> found, index file
>>(/disk1/kafka-logs/perf2-22/00000000000000000000.index)
>> has non-zero size but the last offset is 0 and the base offset is 0
>>
>> How it's supposed to bring broker back after unclean shutdown?
>>
>> Thanks.
>>
Re: unclean shutdown
Posted by Neha Narkhede <ne...@gmail.com>.
It is possible that the unclean broker shutdown left the index in an
inconsistent state. You can delete the corrupted index files, that will
make the Kafka server rebuild the index on startup.
Thanks,
Neha
On Mon, Oct 14, 2013 at 3:05 PM, Kane Kane <ka...@gmail.com> wrote:
> After unclean shutdown kafka reports this error on startup:
> [2013-10-14 16:44:24,898] FATAL Fatal error during KafkaServerStable
> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> java.lang.IllegalArgumentException: requirement failed: Corrupt index
> found, index file (/disk1/kafka-logs/perf2-22/00000000000000000000.index)
> has non-zero size but the last offset is 0 and the base offset is 0
>
> How it's supposed to bring broker back after unclean shutdown?
>
> Thanks.
>