You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Michael McCandless <lu...@mikemccandless.com> on 2010/12/17 17:18:25 UTC

WARNING: re-index all trunk indices!

If you are using Lucene's trunk (nightly build) release, read on...

I just committed a change (for LUCENE-2811) that changes the index
format on trunk, thus breaking (w/ likely strange exceptions on
reading the segments_N file) any trunk indices created in the past
week or so.

Mike

Re: WARNING: re-index all trunk indices!

Posted by Yonik Seeley <yo...@lucidimagination.com>.
On Fri, Dec 17, 2010 at 11:18 AM, Michael McCandless
<lu...@mikemccandless.com> wrote:
> If you are using Lucene's trunk (nightly build) release, read on...
>
> I just committed a change (for LUCENE-2811) that changes the index
> format on trunk, thus breaking (w/ likely strange exceptions on
> reading the segments_N file) any trunk indices created in the past
> week or so.

For reference, the exception I got trying to start Solr with an older
index on Windows is below.

-Yonik
http://www.lucidimagination.com


SEVERE: java.lang.RuntimeException: java.io.IOException: read past EOF
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1095)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:587)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:660)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:412)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:294)
        at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:243)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:86)
        at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
        at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
        at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.mortbay.start.Main.invokeMain(Main.java:194)
        at org.mortbay.start.Main.start(Main.java:534)
        at org.mortbay.start.Main.start(Main.java:441)
        at org.mortbay.start.Main.main(Main.java:119)
Caused by: java.io.IOException: read past EOF
        at org.apache.lucene.store.MMapDirectory$MMapIndexInput.readBytes(MMapDirectory.java:242)
        at org.apache.lucene.store.ChecksumIndexInput.readBytes(ChecksumIndexInput.java:48)
        at org.apache.lucene.store.DataInput.readString(DataInput.java:121)
        at org.apache.lucene.store.DataInput.readStringStringMap(DataInput.java:148)
        at org.apache.lucene.index.SegmentInfo.<init>(SegmentInfo.java:192)
        at org.apache.lucene.index.codecs.DefaultSegmentInfosReader.read(DefaultSegmentInfosReader.java:57)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:220)
        at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:90)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:623)
        at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:86)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:437)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:316)
        at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1084)
        ... 31 more

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: WARNING: re-index all trunk indices!

Posted by Yonik Seeley <yo...@lucidimagination.com>.
On Fri, Dec 17, 2010 at 11:18 AM, Michael McCandless
<lu...@mikemccandless.com> wrote:
> If you are using Lucene's trunk (nightly build) release, read on...
>
> I just committed a change (for LUCENE-2811) that changes the index
> format on trunk, thus breaking (w/ likely strange exceptions on
> reading the segments_N file) any trunk indices created in the past
> week or so.

For reference, the exception I got trying to start Solr with an older
index on Windows is below.

-Yonik
http://www.lucidimagination.com


SEVERE: java.lang.RuntimeException: java.io.IOException: read past EOF
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1095)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:587)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:660)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:412)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:294)
        at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:243)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:86)
        at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
        at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
        at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.mortbay.start.Main.invokeMain(Main.java:194)
        at org.mortbay.start.Main.start(Main.java:534)
        at org.mortbay.start.Main.start(Main.java:441)
        at org.mortbay.start.Main.main(Main.java:119)
Caused by: java.io.IOException: read past EOF
        at org.apache.lucene.store.MMapDirectory$MMapIndexInput.readBytes(MMapDirectory.java:242)
        at org.apache.lucene.store.ChecksumIndexInput.readBytes(ChecksumIndexInput.java:48)
        at org.apache.lucene.store.DataInput.readString(DataInput.java:121)
        at org.apache.lucene.store.DataInput.readStringStringMap(DataInput.java:148)
        at org.apache.lucene.index.SegmentInfo.<init>(SegmentInfo.java:192)
        at org.apache.lucene.index.codecs.DefaultSegmentInfosReader.read(DefaultSegmentInfosReader.java:57)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:220)
        at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:90)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:623)
        at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:86)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:437)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:316)
        at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1084)
        ... 31 more

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


Re: WARNING: re-index all trunk indices!

Posted by Yonik Seeley <yo...@lucidimagination.com>.
On Fri, Dec 17, 2010 at 11:18 AM, Michael McCandless
<lu...@mikemccandless.com> wrote:
> If you are using Lucene's trunk (nightly build) release, read on...
>
> I just committed a change (for LUCENE-2811) that changes the index
> format on trunk, thus breaking (w/ likely strange exceptions on
> reading the segments_N file) any trunk indices created in the past
> week or so.

For reference, the exception I got trying to start Solr with an older
index on Windows is below.

-Yonik
http://www.lucidimagination.com


SEVERE: java.lang.RuntimeException: java.io.IOException: read past EOF
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1095)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:587)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:660)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:412)
        at org.apache.solr.core.CoreContainer.load(CoreContainer.java:294)
        at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:243)
        at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:86)
        at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:97)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:713)
        at org.mortbay.jetty.servlet.Context.startContext(Context.java:140)
        at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1282)
        at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:518)
        at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:156)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:152)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:130)
        at org.mortbay.jetty.Server.doStart(Server.java:224)
        at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:50)
        at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:985)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.mortbay.start.Main.invokeMain(Main.java:194)
        at org.mortbay.start.Main.start(Main.java:534)
        at org.mortbay.start.Main.start(Main.java:441)
        at org.mortbay.start.Main.main(Main.java:119)
Caused by: java.io.IOException: read past EOF
        at org.apache.lucene.store.MMapDirectory$MMapIndexInput.readBytes(MMapDirectory.java:242)
        at org.apache.lucene.store.ChecksumIndexInput.readBytes(ChecksumIndexInput.java:48)
        at org.apache.lucene.store.DataInput.readString(DataInput.java:121)
        at org.apache.lucene.store.DataInput.readStringStringMap(DataInput.java:148)
        at org.apache.lucene.index.SegmentInfo.<init>(SegmentInfo.java:192)
        at org.apache.lucene.index.codecs.DefaultSegmentInfosReader.read(DefaultSegmentInfosReader.java:57)
        at org.apache.lucene.index.SegmentInfos.read(SegmentInfos.java:220)
        at org.apache.lucene.index.DirectoryReader$1.doBody(DirectoryReader.java:90)
        at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:623)
        at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:86)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:437)
        at org.apache.lucene.index.IndexReader.open(IndexReader.java:316)
        at org.apache.solr.core.StandardIndexReaderFactory.newReader(StandardIndexReaderFactory.java:38)
        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1084)
        ... 31 more