You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "david.w.smiley@gmail.com" <da...@gmail.com> on 2015/03/01 06:23:58 UTC

Re: [JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_40-ea-b22) - Build # 11897 - Still Failing!

Ha!  Randomized testing FTW!

~ David Smiley
Freelance Apache Lucene/Solr Search Consultant/Developer
http://www.linkedin.com/in/davidwsmiley

On Sat, Feb 28, 2015 at 10:29 AM, Michael McCandless <
lucene@mikemccandless.com> wrote:

> I committed a fix .. this was a fun one: SimpleText had a bug where if
> you indexed a SORTED doc value with the string value "END", its
> checkIntegrity got confused and falsely detected corruption.
>
> It just took our random tests this long to index the string "END" ...
>
> Soon we will be indexing the full works of Shakespeare...
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Sat, Feb 28, 2015 at 7:28 AM, Policeman Jenkins Server
> <je...@thetaphi.de> wrote:
> > Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11897/
> > Java: 32bit/jdk1.8.0_40-ea-b22 -server -XX:+UseConcMarkSweepGC
> >
> > 1 tests failed.
> > FAILED:
> org.apache.lucene.codecs.simpletext.TestSimpleTextDocValuesFormat.testSortedFixedLengthVsStoredFields
> >
> > Error Message:
> > SimpleText failure: expected checksum line but got length 3
> (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat)))
> >
> > Stack Trace:
> > org.apache.lucene.index.CorruptIndexException: SimpleText failure:
> expected checksum line but got length 3
> (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat)))
> >         at
> __randomizedtesting.SeedInfo.seed([4879A5F99AD2035B:A4FCD66955DBA1EC]:0)
> >         at
> org.apache.lucene.codecs.simpletext.SimpleTextUtil.checkFooter(SimpleTextUtil.java:90)
> >         at
> org.apache.lucene.codecs.simpletext.SimpleTextDocValuesReader.checkIntegrity(SimpleTextDocValuesReader.java:527)
> >         at
> org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:135)
> >         at
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:143)
> >         at
> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105)
> >         at
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3928)
> >         at
> org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3509)
> >         at
> org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
> >         at
> org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1798)
> >         at
> org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2733)
> >         at
> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2838)
> >         at
> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2805)
> >         at
> org.apache.lucene.index.RandomIndexWriter.commit(RandomIndexWriter.java:252)
> >         at
> org.apache.lucene.index.BaseDocValuesFormatTestCase.doTestSortedVsStoredFields(BaseDocValuesFormatTestCase.java:1448)
> >         at
> org.apache.lucene.index.BaseDocValuesFormatTestCase.testSortedFixedLengthVsStoredFields(BaseDocValuesFormatTestCase.java:1493)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:497)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
> >         at java.lang.Thread.run(Thread.java:745)
> >         Suppressed: java.lang.AssertionError
> >                 at
> org.apache.lucene.codecs.simpletext.SimpleTextDocValuesWriter.close(SimpleTextDocValuesWriter.java:441)
> >                 at
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:144)
> >                 ... 48 more
> >
> >
> >
> >
> > Build Log:
> > [...truncated 5611 lines...]
> >    [junit4] Suite:
> org.apache.lucene.codecs.simpletext.TestSimpleTextDocValuesFormat
> >    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=TestSimpleTextDocValuesFormat
> -Dtests.method=testSortedFixedLengthVsStoredFields
> -Dtests.seed=4879A5F99AD2035B -Dtests.multiplier=3 -Dtests.slow=true
> -Dtests.locale=et -Dtests.timezone=Africa/Addis_Ababa -Dtests.asserts=true
> -Dtests.file.encoding=UTF-8
> >    [junit4] ERROR   1.68s J1 |
> TestSimpleTextDocValuesFormat.testSortedFixedLengthVsStoredFields <<<
> >    [junit4]    > Throwable #1:
> org.apache.lucene.index.CorruptIndexException: SimpleText failure: expected
> checksum line but got length 3
> (resource=BufferedChecksumIndexInput(MockIndexInputWrapper(_w.dat)))
> >    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([4879A5F99AD2035B:A4FCD66955DBA1EC]:0)
> >    [junit4]    >        at
> org.apache.lucene.codecs.simpletext.SimpleTextUtil.checkFooter(SimpleTextUtil.java:90)
> >    [junit4]    >        at
> org.apache.lucene.codecs.simpletext.SimpleTextDocValuesReader.checkIntegrity(SimpleTextDocValuesReader.java:527)
> >    [junit4]    >        at
> org.apache.lucene.codecs.DocValuesConsumer.merge(DocValuesConsumer.java:135)
> >    [junit4]    >        at
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:143)
> >    [junit4]    >        at
> org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:105)
> >    [junit4]    >        at
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3928)
> >    [junit4]    >        at
> org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3509)
> >    [junit4]    >        at
> org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:40)
> >    [junit4]    >        at
> org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1798)
> >    [junit4]    >        at
> org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2733)
> >    [junit4]    >        at
> org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2838)
> >    [junit4]    >        at
> org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2805)
> >    [junit4]    >        at
> org.apache.lucene.index.RandomIndexWriter.commit(RandomIndexWriter.java:252)
> >    [junit4]    >        at
> org.apache.lucene.index.BaseDocValuesFormatTestCase.doTestSortedVsStoredFields(BaseDocValuesFormatTestCase.java:1448)
> >    [junit4]    >        at
> org.apache.lucene.index.BaseDocValuesFormatTestCase.testSortedFixedLengthVsStoredFields(BaseDocValuesFormatTestCase.java:1493)
> >    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
> >    [junit4]    >        Suppressed: java.lang.AssertionError
> >    [junit4]    >                at
> org.apache.lucene.codecs.simpletext.SimpleTextDocValuesWriter.close(SimpleTextDocValuesWriter.java:441)
> >    [junit4]    >                at
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:144)
> >    [junit4]    >                ... 48 more
> >    [junit4]   2> NOTE: leaving temporary files on disk at:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/codecs/test/J1/temp/lucene.codecs.simpletext.TestSimpleTextDocValuesFormat
> 4879A5F99AD2035B-001
> >    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {},
> docValues:{}, sim=DefaultSimilarity, locale=et, timezone=Africa/Addis_Ababa
> >    [junit4]   2> NOTE: Linux 3.13.0-45-generic i386/Oracle Corporation
> 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=27185056,total=64880640
> >    [junit4]   2> NOTE: All tests run in this JVM:
> [TestSimpleTextFieldInfoFormat, TestVarGapDocFreqIntervalPostingsFormat,
> TestSimpleTextNormsFormat, TestBloomPostingsFormat,
> TestSimpleTextPostingsFormat, TestSimpleTextDocValuesFormat]
> >    [junit4] Completed on J1 in 57.94s, 84 tests, 1 error <<< FAILURES!
> >
> > [...truncated 50 lines...]
> > BUILD FAILED
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The
> following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The
> following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The
> following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39:
> The following error occurred while executing this line:
> > /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:456:
> The following error occurred while executing this line:
> >
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:2081:
> The following error occurred while executing this line:
> >
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/module-build.xml:58:
> The following error occurred while executing this line:
> >
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1351:
> The following error occurred while executing this line:
> >
> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:958:
> There were test failures: 19 suites, 501 tests, 1 error, 19 ignored (19
> assumptions)
> >
> > Total time: 27 minutes 47 seconds
> > Build step 'Invoke Ant' marked build as failure
> > [description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b22
> -server -XX:+UseConcMarkSweepGC
> > Archiving artifacts
> > Recording test results
> > Email was triggered for: Failure - Any
> > Sending email for trigger: Failure - Any
> >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>