You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Otis Gospodnetic <ot...@gmail.com> on 2013/05/01 02:17:56 UTC

Re: How to recover from "Error opening new searcher" when machine crashed while indexing

Hi,

Try running the CheckIndex tool.

Otis
Solr & ElasticSearch Support
http://sematext.com/
On Apr 30, 2013 3:10 PM, "Utkarsh Sengar" <ut...@gmail.com> wrote:

> Solr 4.0 was indexing data and the machine crashed.
>
> Any suggestions on how to recover my index since I don't want to delete my
> data directory?
>
> When I try to start it again, I get this error:
> ERROR 12:01:46,493 Failed to load Solr core: xyz.index1
> ERROR 12:01:46,493 Cause:
> ERROR 12:01:46,494 Error opening new searcher
> org.apache.solr.common.SolrException: Error opening new searcher
>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:701)
>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:564)
>     at
>
> org.apache.solr.core.CassandraCoreContainer.load(CassandraCoreContainer.java:213)
>     at
> com.datastax.bdp.plugin.SolrCorePlugin.activateImpl(SolrCorePlugin.java:66)
>     at
>
> com.datastax.bdp.plugin.PluginManager$PluginInitializer.call(PluginManager.java:161)
>     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>     at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>     at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>     at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
>     at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1290)
>     at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1402)
>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:675)
>     ... 9 more
> Caused by: org.apache.lucene.index.IndexNotFoundException: no segments*
> file found in NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@
> /media/SSD/data/solr.data/rlcatalogks.prodinfo/index
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@d7581b;
> maxCacheMB=48.0 maxMergeSizeMB=4.0): files: [_73ne_nrm.cfs,
> _73ng_Lucene40_0.tip, _73nh_nrm.cfs, _73ng_Lucene40_0.tim, _73nf.fnm,
> _73n5_Lucene40_0.frq, _73ne.fdt, _73nh.fdx, _73ne_nrm.cfe, _73ne.fdx,
> _73ne_Lucene40_0.tim, _73ne.si, _73ni.fnm, _73nh_Lucene40_0.prx,
> _73ni.fdt,
> _73n5.si, _73ne_Lucene40_0.tip, _73nf_Lucene40_0.frq,
> _73nf_Lucene40_0.prx,
> _73nf_nrm.cfe, _73ne_Lucene40_0.frq, _73ng_Lucene40_0.prx,
> _73nf_Lucene40_0.tip, _73n5.fdx, _73ng_Lucene40_0.frq, _73ng.fnm,
> _73ni.fdx, _73n5.fnm, _73nf_Lucene40_0.tim, _73ni.si, _73n5.fdt,
> _73nf_nrm.cfs, _73nh_nrm.cfe, _73ni_Lucene40_0.frq, _73ng.fdx,
> _73ne_Lucene40_0.prx, _73nh.fnm, _73nh_Lucene40_0.tip,
> _73nh_Lucene40_0.tim, _73nh.si, _73n5_Lucene40_0.tip,
> _73ni_Lucene40_0.prx,
> _73n5_Lucene40_0.tim, _73nf.si, _73ng_nrm.cfe, _73n5_Lucene40_0.prx,
> _392j_42f.del, _73ng.fdt, _73ng.si, _73ni_nrm.cfe, _73n5_nrm.cfe,
> _73ni_nrm.cfs, _73nf.fdx, _73ni_Lucene40_0.tip, _73n5_nrm.cfs,
> _73ni_Lucene40_0.tim, _73nf.fdt, _73ne.fnm, _73nh.fdt,
> _73nh_Lucene40_0.frq, _73ng_nrm.cfs]
>
>
> --
> Thanks,
> -Utkarsh
>

Re: How to recover from "Error opening new searcher" when machine crashed while indexing

Posted by Furkan KAMACI <fu...@gmail.com>.
Sorry but how do you use check index tool? Do you use Luke or does Solr has
built in functionality?

2013/5/1 Otis Gospodnetic <ot...@gmail.com>

> Was afraid of that and wondering if CheckIndex could regenerate the
> segments file based on segments it finds in the index dir?
>
> Otis
> Solr & ElasticSearch Support
> http://sematext.com/
>
>
>
> On May 1, 2013 7:15 AM, "Michael McCandless" <lu...@mikemccandless.com>
> wrote:
>
> > Alas I think CheckIndex can't do much here: there is no segments file,
> > so you'll have to reindex from scratch.
> >
> > Just to check: did you ever called commit while building the index
> > before the machine crashed?
> >
> > Mike McCandless
> >
> > http://blog.mikemccandless.com
> >
> >
> > On Tue, Apr 30, 2013 at 8:17 PM, Otis Gospodnetic
> > <ot...@gmail.com> wrote:
> > > Hi,
> > >
> > > Try running the CheckIndex tool.
> > >
> > > Otis
> > > Solr & ElasticSearch Support
> > > http://sematext.com/
> > > On Apr 30, 2013 3:10 PM, "Utkarsh Sengar" <ut...@gmail.com>
> wrote:
> > >
> > >> Solr 4.0 was indexing data and the machine crashed.
> > >>
> > >> Any suggestions on how to recover my index since I don't want to
> delete
> > my
> > >> data directory?
> > >>
> > >> When I try to start it again, I get this error:
> > >> ERROR 12:01:46,493 Failed to load Solr core: xyz.index1
> > >> ERROR 12:01:46,493 Cause:
> > >> ERROR 12:01:46,494 Error opening new searcher
> > >> org.apache.solr.common.SolrException: Error opening new searcher
> > >>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:701)
> > >>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:564)
> > >>     at
> > >>
> > >>
> >
> org.apache.solr.core.CassandraCoreContainer.load(CassandraCoreContainer.java:213)
> > >>     at
> > >>
> >
> com.datastax.bdp.plugin.SolrCorePlugin.activateImpl(SolrCorePlugin.java:66)
> > >>     at
> > >>
> > >>
> >
> com.datastax.bdp.plugin.PluginManager$PluginInitializer.call(PluginManager.java:161)
> > >>     at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> > >>     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> > >>     at
> > >>
> > >>
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> > >>     at
> > >>
> > >>
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> > >>     at java.lang.Thread.run(Thread.java:662)
> > >> Caused by: org.apache.solr.common.SolrException: Error opening new
> > searcher
> > >>     at
> org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1290)
> > >>     at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1402)
> > >>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:675)
> > >>     ... 9 more
> > >> Caused by: org.apache.lucene.index.IndexNotFoundException: no
> segments*
> > >> file found in
> > NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@
> > >> /media/SSD/data/solr.data/rlcatalogks.prodinfo/index
> > >> lockFactory=org.apache.lucene.store.NativeFSLockFactory@d7581b;
> > >> maxCacheMB=48.0 maxMergeSizeMB=4.0): files: [_73ne_nrm.cfs,
> > >> _73ng_Lucene40_0.tip, _73nh_nrm.cfs, _73ng_Lucene40_0.tim, _73nf.fnm,
> > >> _73n5_Lucene40_0.frq, _73ne.fdt, _73nh.fdx, _73ne_nrm.cfe, _73ne.fdx,
> > >> _73ne_Lucene40_0.tim, _73ne.si, _73ni.fnm, _73nh_Lucene40_0.prx,
> > >> _73ni.fdt,
> > >> _73n5.si, _73ne_Lucene40_0.tip, _73nf_Lucene40_0.frq,
> > >> _73nf_Lucene40_0.prx,
> > >> _73nf_nrm.cfe, _73ne_Lucene40_0.frq, _73ng_Lucene40_0.prx,
> > >> _73nf_Lucene40_0.tip, _73n5.fdx, _73ng_Lucene40_0.frq, _73ng.fnm,
> > >> _73ni.fdx, _73n5.fnm, _73nf_Lucene40_0.tim, _73ni.si, _73n5.fdt,
> > >> _73nf_nrm.cfs, _73nh_nrm.cfe, _73ni_Lucene40_0.frq, _73ng.fdx,
> > >> _73ne_Lucene40_0.prx, _73nh.fnm, _73nh_Lucene40_0.tip,
> > >> _73nh_Lucene40_0.tim, _73nh.si, _73n5_Lucene40_0.tip,
> > >> _73ni_Lucene40_0.prx,
> > >> _73n5_Lucene40_0.tim, _73nf.si, _73ng_nrm.cfe, _73n5_Lucene40_0.prx,
> > >> _392j_42f.del, _73ng.fdt, _73ng.si, _73ni_nrm.cfe, _73n5_nrm.cfe,
> > >> _73ni_nrm.cfs, _73nf.fdx, _73ni_Lucene40_0.tip, _73n5_nrm.cfs,
> > >> _73ni_Lucene40_0.tim, _73nf.fdt, _73ne.fnm, _73nh.fdt,
> > >> _73nh_Lucene40_0.frq, _73ng_nrm.cfs]
> > >>
> > >>
> > >> --
> > >> Thanks,
> > >> -Utkarsh
> > >>
> >
>

Re: How to recover from "Error opening new searcher" when machine crashed while indexing

Posted by Otis Gospodnetic <ot...@gmail.com>.
Was afraid of that and wondering if CheckIndex could regenerate the
segments file based on segments it finds in the index dir?

Otis
Solr & ElasticSearch Support
http://sematext.com/



On May 1, 2013 7:15 AM, "Michael McCandless" <lu...@mikemccandless.com>
wrote:

> Alas I think CheckIndex can't do much here: there is no segments file,
> so you'll have to reindex from scratch.
>
> Just to check: did you ever called commit while building the index
> before the machine crashed?
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Tue, Apr 30, 2013 at 8:17 PM, Otis Gospodnetic
> <ot...@gmail.com> wrote:
> > Hi,
> >
> > Try running the CheckIndex tool.
> >
> > Otis
> > Solr & ElasticSearch Support
> > http://sematext.com/
> > On Apr 30, 2013 3:10 PM, "Utkarsh Sengar" <ut...@gmail.com> wrote:
> >
> >> Solr 4.0 was indexing data and the machine crashed.
> >>
> >> Any suggestions on how to recover my index since I don't want to delete
> my
> >> data directory?
> >>
> >> When I try to start it again, I get this error:
> >> ERROR 12:01:46,493 Failed to load Solr core: xyz.index1
> >> ERROR 12:01:46,493 Cause:
> >> ERROR 12:01:46,494 Error opening new searcher
> >> org.apache.solr.common.SolrException: Error opening new searcher
> >>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:701)
> >>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:564)
> >>     at
> >>
> >>
> org.apache.solr.core.CassandraCoreContainer.load(CassandraCoreContainer.java:213)
> >>     at
> >>
> com.datastax.bdp.plugin.SolrCorePlugin.activateImpl(SolrCorePlugin.java:66)
> >>     at
> >>
> >>
> com.datastax.bdp.plugin.PluginManager$PluginInitializer.call(PluginManager.java:161)
> >>     at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> >>     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> >>     at
> >>
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> >>     at
> >>
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> >>     at java.lang.Thread.run(Thread.java:662)
> >> Caused by: org.apache.solr.common.SolrException: Error opening new
> searcher
> >>     at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1290)
> >>     at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1402)
> >>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:675)
> >>     ... 9 more
> >> Caused by: org.apache.lucene.index.IndexNotFoundException: no segments*
> >> file found in
> NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@
> >> /media/SSD/data/solr.data/rlcatalogks.prodinfo/index
> >> lockFactory=org.apache.lucene.store.NativeFSLockFactory@d7581b;
> >> maxCacheMB=48.0 maxMergeSizeMB=4.0): files: [_73ne_nrm.cfs,
> >> _73ng_Lucene40_0.tip, _73nh_nrm.cfs, _73ng_Lucene40_0.tim, _73nf.fnm,
> >> _73n5_Lucene40_0.frq, _73ne.fdt, _73nh.fdx, _73ne_nrm.cfe, _73ne.fdx,
> >> _73ne_Lucene40_0.tim, _73ne.si, _73ni.fnm, _73nh_Lucene40_0.prx,
> >> _73ni.fdt,
> >> _73n5.si, _73ne_Lucene40_0.tip, _73nf_Lucene40_0.frq,
> >> _73nf_Lucene40_0.prx,
> >> _73nf_nrm.cfe, _73ne_Lucene40_0.frq, _73ng_Lucene40_0.prx,
> >> _73nf_Lucene40_0.tip, _73n5.fdx, _73ng_Lucene40_0.frq, _73ng.fnm,
> >> _73ni.fdx, _73n5.fnm, _73nf_Lucene40_0.tim, _73ni.si, _73n5.fdt,
> >> _73nf_nrm.cfs, _73nh_nrm.cfe, _73ni_Lucene40_0.frq, _73ng.fdx,
> >> _73ne_Lucene40_0.prx, _73nh.fnm, _73nh_Lucene40_0.tip,
> >> _73nh_Lucene40_0.tim, _73nh.si, _73n5_Lucene40_0.tip,
> >> _73ni_Lucene40_0.prx,
> >> _73n5_Lucene40_0.tim, _73nf.si, _73ng_nrm.cfe, _73n5_Lucene40_0.prx,
> >> _392j_42f.del, _73ng.fdt, _73ng.si, _73ni_nrm.cfe, _73n5_nrm.cfe,
> >> _73ni_nrm.cfs, _73nf.fdx, _73ni_Lucene40_0.tip, _73n5_nrm.cfs,
> >> _73ni_Lucene40_0.tim, _73nf.fdt, _73ne.fnm, _73nh.fdt,
> >> _73nh_Lucene40_0.frq, _73ng_nrm.cfs]
> >>
> >>
> >> --
> >> Thanks,
> >> -Utkarsh
> >>
>

Re: How to recover from "Error opening new searcher" when machine crashed while indexing

Posted by Michael McCandless <lu...@mikemccandless.com>.
Alas I think CheckIndex can't do much here: there is no segments file,
so you'll have to reindex from scratch.

Just to check: did you ever called commit while building the index
before the machine crashed?

Mike McCandless

http://blog.mikemccandless.com


On Tue, Apr 30, 2013 at 8:17 PM, Otis Gospodnetic
<ot...@gmail.com> wrote:
> Hi,
>
> Try running the CheckIndex tool.
>
> Otis
> Solr & ElasticSearch Support
> http://sematext.com/
> On Apr 30, 2013 3:10 PM, "Utkarsh Sengar" <ut...@gmail.com> wrote:
>
>> Solr 4.0 was indexing data and the machine crashed.
>>
>> Any suggestions on how to recover my index since I don't want to delete my
>> data directory?
>>
>> When I try to start it again, I get this error:
>> ERROR 12:01:46,493 Failed to load Solr core: xyz.index1
>> ERROR 12:01:46,493 Cause:
>> ERROR 12:01:46,494 Error opening new searcher
>> org.apache.solr.common.SolrException: Error opening new searcher
>>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:701)
>>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:564)
>>     at
>>
>> org.apache.solr.core.CassandraCoreContainer.load(CassandraCoreContainer.java:213)
>>     at
>> com.datastax.bdp.plugin.SolrCorePlugin.activateImpl(SolrCorePlugin.java:66)
>>     at
>>
>> com.datastax.bdp.plugin.PluginManager$PluginInitializer.call(PluginManager.java:161)
>>     at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>>     at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>     at
>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>>     at
>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>>     at java.lang.Thread.run(Thread.java:662)
>> Caused by: org.apache.solr.common.SolrException: Error opening new searcher
>>     at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1290)
>>     at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1402)
>>     at org.apache.solr.core.SolrCore.<init>(SolrCore.java:675)
>>     ... 9 more
>> Caused by: org.apache.lucene.index.IndexNotFoundException: no segments*
>> file found in NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@
>> /media/SSD/data/solr.data/rlcatalogks.prodinfo/index
>> lockFactory=org.apache.lucene.store.NativeFSLockFactory@d7581b;
>> maxCacheMB=48.0 maxMergeSizeMB=4.0): files: [_73ne_nrm.cfs,
>> _73ng_Lucene40_0.tip, _73nh_nrm.cfs, _73ng_Lucene40_0.tim, _73nf.fnm,
>> _73n5_Lucene40_0.frq, _73ne.fdt, _73nh.fdx, _73ne_nrm.cfe, _73ne.fdx,
>> _73ne_Lucene40_0.tim, _73ne.si, _73ni.fnm, _73nh_Lucene40_0.prx,
>> _73ni.fdt,
>> _73n5.si, _73ne_Lucene40_0.tip, _73nf_Lucene40_0.frq,
>> _73nf_Lucene40_0.prx,
>> _73nf_nrm.cfe, _73ne_Lucene40_0.frq, _73ng_Lucene40_0.prx,
>> _73nf_Lucene40_0.tip, _73n5.fdx, _73ng_Lucene40_0.frq, _73ng.fnm,
>> _73ni.fdx, _73n5.fnm, _73nf_Lucene40_0.tim, _73ni.si, _73n5.fdt,
>> _73nf_nrm.cfs, _73nh_nrm.cfe, _73ni_Lucene40_0.frq, _73ng.fdx,
>> _73ne_Lucene40_0.prx, _73nh.fnm, _73nh_Lucene40_0.tip,
>> _73nh_Lucene40_0.tim, _73nh.si, _73n5_Lucene40_0.tip,
>> _73ni_Lucene40_0.prx,
>> _73n5_Lucene40_0.tim, _73nf.si, _73ng_nrm.cfe, _73n5_Lucene40_0.prx,
>> _392j_42f.del, _73ng.fdt, _73ng.si, _73ni_nrm.cfe, _73n5_nrm.cfe,
>> _73ni_nrm.cfs, _73nf.fdx, _73ni_Lucene40_0.tip, _73n5_nrm.cfs,
>> _73ni_Lucene40_0.tim, _73nf.fdt, _73ne.fnm, _73nh.fdt,
>> _73nh_Lucene40_0.frq, _73ng_nrm.cfs]
>>
>>
>> --
>> Thanks,
>> -Utkarsh
>>