You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Vadim Keylis <vk...@gmail.com> on 2013/08/23 19:13:25 UTC

How to rebuild missing index?

We got to this state somehow. Is there way to rebuild index or tell kafka
recovery process skip topics that are incomplete
[2013-08-13 17:20:08,953] INFO [Log Manager on Broker 7] Loading log
'm3_registration-29' (kafka.log.LogManager)
[2013-08-13 17:20:08,992] FATAL Fatal error during KafkaServerStable
startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
java.lang.IllegalStateException: Found log file with no corresponding index
file.

Thanks,
Vadim

Re: How to rebuild missing index?

Posted by Jun Rao <ju...@gmail.com>.
To recover, you have to manually delete log segment files without an index.

Thanks,

Jun


On Fri, Aug 23, 2013 at 7:53 PM, Vadim Keylis <vk...@gmail.com> wrote:

> I was creating topics and ran out of open file handlers that caused index
> not be created.
>
> Are there plans to push it into 0.8 branch? If not, what are the steps to
> recover?
>
> Thanks,
> Vadim
>
>
>
>
> On Fri, Aug 23, 2013 at 3:45 PM, Neha Narkhede <neha.narkhede@gmail.com
> >wrote:
>
> > This is fixed on trunk. What I am curious about is how you reached this
> > state ?
> >
> > Thanks,
> > Neha
> >
> >
> > On Fri, Aug 23, 2013 at 10:13 AM, Vadim Keylis <vkeylis2009@gmail.com
> > >wrote:
> >
> > > We got to this state somehow. Is there way to rebuild index or tell
> kafka
> > > recovery process skip topics that are incomplete
> > > [2013-08-13 17:20:08,953] INFO [Log Manager on Broker 7] Loading log
> > > 'm3_registration-29' (kafka.log.LogManager)
> > > [2013-08-13 17:20:08,992] FATAL Fatal error during KafkaServerStable
> > > startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> > > java.lang.IllegalStateException: Found log file with no corresponding
> > index
> > > file.
> > >
> > > Thanks,
> > > Vadim
> > >
> >
>

Re: How to rebuild missing index?

Posted by Vadim Keylis <vk...@gmail.com>.
I was creating topics and ran out of open file handlers that caused index
not be created.

Are there plans to push it into 0.8 branch? If not, what are the steps to
recover?

Thanks,
Vadim




On Fri, Aug 23, 2013 at 3:45 PM, Neha Narkhede <ne...@gmail.com>wrote:

> This is fixed on trunk. What I am curious about is how you reached this
> state ?
>
> Thanks,
> Neha
>
>
> On Fri, Aug 23, 2013 at 10:13 AM, Vadim Keylis <vkeylis2009@gmail.com
> >wrote:
>
> > We got to this state somehow. Is there way to rebuild index or tell kafka
> > recovery process skip topics that are incomplete
> > [2013-08-13 17:20:08,953] INFO [Log Manager on Broker 7] Loading log
> > 'm3_registration-29' (kafka.log.LogManager)
> > [2013-08-13 17:20:08,992] FATAL Fatal error during KafkaServerStable
> > startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> > java.lang.IllegalStateException: Found log file with no corresponding
> index
> > file.
> >
> > Thanks,
> > Vadim
> >
>

Re: How to rebuild missing index?

Posted by Neha Narkhede <ne...@gmail.com>.
This is fixed on trunk. What I am curious about is how you reached this
state ?

Thanks,
Neha


On Fri, Aug 23, 2013 at 10:13 AM, Vadim Keylis <vk...@gmail.com>wrote:

> We got to this state somehow. Is there way to rebuild index or tell kafka
> recovery process skip topics that are incomplete
> [2013-08-13 17:20:08,953] INFO [Log Manager on Broker 7] Loading log
> 'm3_registration-29' (kafka.log.LogManager)
> [2013-08-13 17:20:08,992] FATAL Fatal error during KafkaServerStable
> startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
> java.lang.IllegalStateException: Found log file with no corresponding index
> file.
>
> Thanks,
> Vadim
>