You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Yonik Seeley (JIRA)" <ji...@apache.org> on 2015/08/26 22:24:46 UTC
[jira] [Commented] (SOLR-7980) CorruptIndex exceptions in
ChaosMonkeySafeLeaderTest
[ https://issues.apache.org/jira/browse/SOLR-7980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715446#comment-14715446 ]
Yonik Seeley commented on SOLR-7980:
------------------------------------
Examples:
{code}
2> 25342 WARN (qtp1987916571-72) [n:127.0.0.1:32803_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Could not read check
sum from index file: _0_SimpleText_0.pst
2> org.apache.lucene.index.CorruptIndexException: codec footer mismatch (file truncated?): actual footer=808464432 vs expected footer=-1071082520 (resource=MMapIndexInput(path="/opt/code/lusolr_trunk2/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_38F55D766B70D5BD-001/shard-1-001/cores/collection1/data/index/_0_SimpleText_0.pst"))
2> at org.apache.lucene.codecs.CodecUtil.validateFooter(CodecUtil.java:416)
2> at org.apache.lucene.codecs.CodecUtil.retrieveChecksum(CodecUtil.java:401)
2> at org.apache.solr.handler.ReplicationHandler.getFileList(ReplicationHandler.java:558)
2> at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:247)
2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079)
2> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:667)
2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)
2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:210)
2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
2> at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
2> at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
2> at org.eclipse.jetty.server.Server.handle(Server.java:499)
2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
2> at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
2> at java.lang.Thread.run(Thread.java:745)
{code}
{code}
2> 19962 WARN (RecoveryThread-collection1) [n:127.0.0.1:49515_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.h.IndexFetcher Could not retrie
ve checksum from file.
2> java.lang.IllegalArgumentException: Seeking to negative position: MMapIndexInput(path="/opt/code/lusolr_trunk2/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_1142D018587DF1D8-001/shard-2-001/cores/collection1/data/index/_0.fdx")
2> at org.apache.lucene.store.ByteBufferIndexInput$SingleBufferImpl.seek(ByteBufferIndexInput.java:408)
2> at org.apache.lucene.codecs.CodecUtil.retrieveChecksum(CodecUtil.java:400)
2> at org.apache.solr.handler.IndexFetcher.compareFile(IndexFetcher.java:876)
2> at org.apache.solr.handler.IndexFetcher.downloadIndexFiles(IndexFetcher.java:839)
2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:437)
2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:265)
2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:382)
2> at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:162)
2> at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
2> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227)
2> Caused by: java.lang.IllegalArgumentException
2> at java.nio.Buffer.position(Buffer.java:244)
2> at org.apache.lucene.store.ByteBufferIndexInput$SingleBufferImpl.seek(ByteBufferIndexInput.java:405)
2> ... 9 more
2> 19963 WARN (RecoveryThread-collection1) [n:127.0.0.1:49515_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.h.IndexFetcher File _0.fdx did not match. expected length is 576 and actual length is 0
2> 19966 INFO (qtp615760151-67) [n:127.0.0.1:39537_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
2> 19979 INFO (qtp615760151-71) [n:127.0.0.1:39537_ c:collection1 s:shard1 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1] webapp= path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.tip&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
2> 19981 WARN (RecoveryThread-collection1) [n:127.0.0.1:49515_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.h.IndexFetcher Could not retrieve checksum from file.
2> org.apache.lucene.index.CorruptIndexException: codec footer mismatch (file truncated?): actual footer=50675024 vs expected footer=-1071082520 (resource=MMapIndexInput(path="/opt/code/lusolr_trunk2/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_1142D018587DF1D8-001/shard-2-001/cores/collection1/data/index/_0.fdt"))
2> at org.apache.lucene.codecs.CodecUtil.validateFooter(CodecUtil.java:416)
2> at org.apache.lucene.codecs.CodecUtil.retrieveChecksum(CodecUtil.java:401)
2> at org.apache.solr.handler.IndexFetcher.compareFile(IndexFetcher.java:876)
2> at org.apache.solr.handler.IndexFetcher.downloadIndexFiles(IndexFetcher.java:839)
2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:437)
2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:265)
2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:382)
2> at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:162)
2> at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
2> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227)
2> 19982 WARN (RecoveryThread-collection1) [n:127.0.0.1:49515_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.h.IndexFetcher File _0.fdt did not match. expected length is 27692 and actual length is 24575
{code}
{code}
2> 24514 WARN (RecoveryThread-collection1) [n:127.0.0.1:60874_rq%2Fvp c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.h.IndexFetcher Could not retrieve checksum from file.
2> java.lang.IllegalArgumentException: Seeking to negative position: MMapIndexInput(path="/opt/code/lusolr_trunk2/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FA732538BC500952-001/shard-3-001/cores/collection1/data/index/_0.fdx")
2> at org.apache.lucene.store.ByteBufferIndexInput$SingleBufferImpl.seek(ByteBufferIndexInput.java:408)
2> at org.apache.lucene.codecs.CodecUtil.retrieveChecksum(CodecUtil.java:400)
2> at org.apache.solr.handler.IndexFetcher.compareFile(IndexFetcher.java:876)
2> at org.apache.solr.handler.IndexFetcher.isIndexStale(IndexFetcher.java:947)
2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:390)
2> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:265)
2> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:382)
2> at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:162)
2> at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
2> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227)
2> Caused by: java.lang.IllegalArgumentException
2> at java.nio.Buffer.position(Buffer.java:244)
2> at org.apache.lucene.store.ByteBufferIndexInput$SingleBufferImpl.seek(ByteBufferIndexInput.java:405)
2> ... 9 more
{code}
> CorruptIndex exceptions in ChaosMonkeySafeLeaderTest
> ----------------------------------------------------
>
> Key: SOLR-7980
> URL: https://issues.apache.org/jira/browse/SOLR-7980
> Project: Solr
> Issue Type: Bug
> Reporter: Yonik Seeley
>
> Found during investigation of SOLR-7836
> If you loop the test long enough, you'll occasionally see CorruptIndex exceptions, although it won't cause the test to fail.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org