You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by mdz-munich <se...@bsb-muenchen.de> on 2011/07/19 11:08:52 UTC

Solr 3.3: SEVERE: java.io.IOException: seek past EOF

Hi Developers and Users,

a serious Problem occurred: 

19.07.2011 10:50:32 org.apache.solr.common.SolrException log
SEVERE: java.io.IOException: seek past EOF
	at
org.apache.lucene.store.MMapDirectory$MMapIndexInput.seek(MMapDirectory.java:343)
	at org.apache.lucene.index.FieldsReader.seekIndex(FieldsReader.java:226)
	at org.apache.lucene.index.FieldsReader.doc(FieldsReader.java:242)
	at org.apache.lucene.index.SegmentReader.document(SegmentReader.java:471)
	at
org.apache.lucene.index.DirectoryReader.document(DirectoryReader.java:564)
	at
org.apache.solr.search.SolrIndexReader.document(SolrIndexReader.java:260)
	at org.apache.solr.search.SolrIndexSearcher.doc(SolrIndexSearcher.java:440)
	at
org.apache.solr.util.SolrPluginUtils.optimizePreFetchDocs(SolrPluginUtils.java:270)
	at
org.apache.solr.handler.component.QueryComponent.doPrefetch(QueryComponent.java:358)
	at
org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:265)
	at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:202)
	at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
	at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
	at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
	at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)
	at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)
	at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:240)
	at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:164)
	at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:462)
	at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:164)
	at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)
	at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:562)
	at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)
	at
org.apache.catalina.valves.RequestFilterValve.process(RequestFilterValve.java:210)
	at
org.apache.catalina.valves.RemoteAddrValve.invoke(RemoteAddrValve.java:85)
	at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:395)
	at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:250)
	at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:188)
	at
org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:302)
	at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:897)
	at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:919)
	at java.lang.Thread.run(Thread.java:736)

Fresh index with Solr 3.3. It only occurs with some Words (in this case it
was "Graf", no idea). Query-Type (dismax, standard, edismax), Highlighting
and Faceting have no affect, only the term to search. And it seems to affect
only OCR-fields, which are usually larger than fields for meta-data.

Any ideas? 

Grettings & best regards,

Sebastian 



--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-3-3-SEVERE-java-io-IOException-seek-past-EOF-tp3181869p3181869.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 3.3: SEVERE: java.io.IOException: seek past EOF

Posted by blogger8 <bl...@gmail.com>.
I'm experiencing the same problem.

I'm running Lucene/solr 3.5 with Webspher FEP6

My setup has multiple slaves which are replicating via  master server by
doing SnapPull every 60 seconds. The exception I see in the trace log is
below

[8/23/14 16:28:46:001 UTC] 00000059 SolrCore      E
org.apache.solr.common.SolrException log java.io.IOException: seek past EOF:
MMapIndexInput(path="/usr/WebSphere/AppServer70/profiles/search/solr
/home/MC_10001/en_US/CatalogEntry/data/index/_16.frq")
        at
org.apache.lucene.store.MMapDirectory$MMapIndexInput.seek(MMapDirectory.java:352)
        at
org.apache.lucene.index.SegmentTermDocs.seek(SegmentTermDocs.java:92)
        at
org.apache.lucene.index.SegmentTermDocs.seek(SegmentTermDocs.java:59)
        at
org.apache.lucene.index.IndexReader.termDocs(IndexReader.java:1277)
        at
org.apache.lucene.index.SegmentReader.termDocs(SegmentReader.java:490)
        at
org.apache.solr.search.SolrIndexReader.termDocs(SolrIndexReader.java:321)
        at
org.apache.lucene.search.TermQuery$TermWeight.scorer(TermQuery.java:102)
        at
org.apache.lucene.search.BooleanQuery$BooleanWeight.scorer(BooleanQuery.java:298)
        at
org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:577)
        at
org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:364)
        at
org.apache.solr.search.SolrIndexSearcher.getDocSetNC(SolrIndexSearcher.java:849)
        at
org.apache.solr.search.SolrIndexSearcher.getPositiveDocSet(SolrIndexSearcher.java:621)
        at
org.apache.solr.search.SolrIndexSearcher.getProcessedFilter(SolrIndexSearcher.java:755)
        at
org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1327)
        at
org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1158)
        at
org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:362)
        at
org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:378)
        at
com.ibm.commerce.foundation.internal.server.services.search.component.solr.SolrSearchMultipleQueryComponent.process(SolrSearchMultipleQueryComponent.java:394)
        at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:194)
        at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:1372)



I'm also seeing the following error in the SystemOut.log very often 

[8/22/14 18:17:02:903 UTC] 0000004b ReplicationHa E
org.apache.solr.handler.ReplicationHandler doFetch SnapPull failed
org.apache.solr.common.SolrException: Index fetch failed :
at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:331)
at
org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:268)
at org.apache.solr.handler.SnapPuller$1.run(SnapPuller.java:159)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at
java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:738)
Caused by: java.io.FileNotFoundException: File does not exist
/usr/WebSphere/AppServer70/profiles/search/solr/home/MC_10001/en_US/CatalogEntry/data/index.20140822181700/_15.prx
at org.apache.solr.common.util.FileUtils.sync(FileUtils.java:64)
at org.apache.solr.handler.SnapPuller$FileFetcher$1.run(SnapPuller.java:923)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)

But there is a directory named "index" under
/usr/WebSphere/AppServer70/profiles/search/solr/home/MC_10001/en_US/CatalogEntry/data/
which contains all the index files on all slaves and the files seems to be
getting refreshed (up to date) as well. I don't quite understand why it is
still complaining and why is it looking for a folder by the name
index.<date> instead.


Appreciate your assistance on this.

Cheers,
blogger8







--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-3-3-SEVERE-java-io-IOException-seek-past-EOF-tp3181869p4155164.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr 3.3: SEVERE: java.io.IOException: seek past EOF

Posted by mdz-munich <se...@bsb-muenchen.de>.
Ups, false alarm.

CustomSimilarity, combined with a very small set of documents caused the
problem.

Greetings,

Sebastian 



--
View this message in context: http://lucene.472066.n3.nabble.com/Solr-3-3-SEVERE-java-io-IOException-seek-past-EOF-tp3181869p3181943.html
Sent from the Solr - User mailing list archive at Nabble.com.