You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/10/21 06:39:21 UTC
[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) - Build
# 18103 - Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18103/
Java: 64bit/jdk-9-ea+140 -XX:+UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.lucene.search.TestBooleanRewrites.testRandom
Error Message:
expected:<2048.99267578125> but was:<2048.992919921875>
Stack Trace:
java.lang.AssertionError: expected:<2048.99267578125> but was:<2048.992919921875>
at __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:443)
at org.junit.Assert.assertEquals(Assert.java:512)
at org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
at org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native Method)
at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(java.base@9-ea/Method.java:535)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
Build Log:
[...truncated 1309 lines...]
[junit4] Suite: org.apache.lucene.search.TestBooleanRewrites
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestBooleanRewrites -Dtests.method=testRandom -Dtests.seed=DDF676110AA095BA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=qu -Dtests.timezone=JST -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.05s J1 | TestBooleanRewrites.testRandom <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<2048.99267578125> but was:<2048.992919921875>
[junit4] > at __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
[junit4] > at org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
[junit4] > at org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
[junit4] > at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native Method)
[junit4] > at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
[junit4] > at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
[junit4] > at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=16269, maxDocsPerChunk=9, blockSize=4), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=16269, blockSize=4)), sim=ClassicSimilarity, locale=qu, timezone=JST
[junit4] 2> NOTE: Linux 4.4.0-42-generic amd64/Oracle Corporation 9-ea (64-bit)/cpus=12,threads=1,free=153179392,total=333971456
[junit4] 2> NOTE: All tests run in this JVM: [TestStandardAnalyzer, TestByteBlockPool, TestNumericUtils, Test2BPostingsBytes, TestSumDocFreq, TestCharTermAttributeImpl, TestByteArrayDataInput, TestLucene50StoredFieldsFormat, TestPhraseQuery, MultiCollectorTest, TestShardSearching, TestQueryRescorer, Test2BBKDPoints, TestIndexReaderClose, TestSpanContainQuery, TestSloppyMath, TestLongPostings, TestSmallFloat, TestTimSorterWorstCase, TestStressNRT, TestMultiDocValues, TestFieldCacheRewriteMethod, TestSameTokenSamePosition, TestCheckIndex, TestHugeRamFile, TestPagedBytes, TestEarlyTermination, TestTermVectorsWriter, TestDemoParallelLeafReader, TestDocumentsWriterStallControl, TestAutomatonQueryUnicode, TestOmitNorms, TestIntBlockPool, TestMultiset, TestSearcherManager, TestIndexSearcher, TestIndexWriterDelete, TestLiveFieldValues, TestScoreCachingWrappingScorer, TestDocument, TestDirectPacked, TestFieldsReader, TestSimpleFSDirectory, TestPayloads, TestAutomaton, FuzzyTermOnShortTermsTest, TestSortedSetSortField, TestSortRandom, TestBooleanQuery, TestIntArrayDocIdSet, TestCharArraySet, TestRadixSelector, TestSleepingLockWrapper, TestTermdocPerf, TestDocsAndPositions, TestNamedSPILoader, TestRecyclingIntBlockAllocator, TestIndexWriterUnicode, TestStressAdvance, TestFixedLengthBytesRefArray, TestConsistentFieldNumbers, Test2BDocs, TestMultiFields, TestDocumentsWriterDeleteQueue, TestMutablePointsReaderUtils, TestIndexableField, TestExitableDirectoryReader, TestSortRescorer, TestDuelingCodecs, TestNRTReaderCleanup, TestCharsRef, TestIndexFileDeleter, TestIndexWriterMerging, TestFSTs, TestIndexWriterWithThreads, TestMultiMMap, TestBasics, TestIndexWriterMergePolicy, TestAtomicUpdate, TestHighCompressionMode, TestTopDocsMerge, TestTieredMergePolicy, TestLevenshteinAutomata, TestByteSlices, TestNRTCachingDirectory, TestParallelCompositeReader, TestIndexWriterNRTIsCurrent, TestCrash, TestSegmentTermDocs, TestPerFieldPostingsFormat2, TestTermsEnum2, TestPostingsOffsets, TestTransactionRollback, TestFlex, TestStressIndexing2, TestBagOfPostings, TestWildcard, TestSimilarity2, TestFieldMaskingSpanQuery, TestExternalCodecs, TestNoDeletionPolicy, TestRegexpQuery, TestPerSegmentDeletes, TestSegmentTermEnum, TestComplexExplanationsOfNonMatches, TestPrefixCodedTerms, TestAllFilesHaveCodecHeader, TestTermScorer, TestMultiLevelSkipList, TestSearchForDuplicates, TestCompiledAutomaton, TestElevationComparator, TestSubScorerFreqs, TestConjunctions, TestPositionIncrement, TestSpanExplanationsOfNonMatches, TestSetOnce, TestFilterIterator, TestPriorityQueue, TestAttributeSource, TestBooleanScorer, TestAssertions, TestTwoPhaseCommitTool, TestIndexWriterOnJRECrash, Test4GBStoredFields, TestNGramPhraseQuery, TestSimpleAttributeImpl, TestIndexCommit, TestIOUtils, TestNewestSegment, Test2BPagedBytes, TestStopFilter, TestPackedTokenAttributeImpl, TestCodecUtil, TestGrowableByteArrayDataOutput, TestLucene50TermVectorsFormat, TestAllFilesHaveChecksumFooter, TestDuelingCodecsAtNight, TestFilterDirectoryReader, TestIndexWriterMaxDocs, TestIndexWriterOnVMError, TestIndexWriterOutOfFileDescriptors, TestInfoStream, TestManyFields, TestMaxPosition, TestMergePolicyWrapper, TestMergeRateLimiter, TestMultiTermsEnum, TestNumericDocValuesUpdates, TestOrdinalMap, TestPointValues, TestReadOnlyIndex, TestReaderWrapperDVTypeCheck, TestSegmentInfos, TestSwappedIndexFiles, TestTermVectors, TestTerms, TestTragicIndexWriterDeadlock, TestTryDelete, TestBlendedTermQuery, TestBooleanRewrites]
[junit4] Completed [340/434 (1!)] on J1 in 0.06s, 10 tests, 1 failure <<< FAILURES!
[...truncated 61242 lines...]
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Adrien Grand <jp...@gmail.com>.
I opened https://issues.apache.org/jira/browse/LUCENE-7517.
Le ven. 21 oct. 2016 à 14:52, Robert Muir <rc...@gmail.com> a écrit :
> The problem is more than worth it. The alternative is to remove the
> optimization? I don't think being incorrect / adding leniency to tests
> is a valid option at all. In general, if we dont apply a general fix,
> it will just make more such optimizations harder: more jenkins
> failures, more deltas in tests, just a bad direction.
>
> I guess what i propose is something more like: change Scorer.score()
> to return double, and use double precision internally in all scoring
> (also similarity code).
>
> But keep it a float in e.g. ScoreDoc/TopDocs: we just "export" that to
> the user at the end. This is really best practice anyway, we shouldnt
> be storing intermediate calculations as 32-bit floats. It would just
> be a generalization of what DisjunctionSumScorer etc are already
> doing.
>
>
> On Fri, Oct 21, 2016 at 8:34 AM, Adrien Grand <jp...@gmail.com> wrote:
> > I suspect we could do something on the Scorer API indeed, eg. by giving
> > scorers a way to expose the double value of the score. However it's not
> > clear to me that this problem is worth making the Scorer API more
> complex?
> >
> > Le ven. 21 oct. 2016 à 12:37, Robert Muir <rc...@gmail.com> a écrit :
> >>
> >> But maybe the old "trick" can still be used somehow: just means using
> >> double precision internally to erase most differences? Maybe it means
> >> a change to scorer api or whatever, but still I think its a good
> >> practical solution (vs something more extreme like kahan summation). I
> >> am sure it does not work if someone has like 500k boolean clauses or
> >> for more extreme cases, but it prevents these problems for typical
> >> cases like keyword searches.
> >>
> >>
> >> On Fri, Oct 21, 2016 at 6:31 AM, Adrien Grand <jp...@gmail.com>
> wrote:
> >> > Le ven. 21 oct. 2016 à 12:20, Robert Muir <rc...@gmail.com> a écrit
> :
> >> >>
> >> >> What changed?
> >> >
> >> >
> >> > The issue here is ReqOptSumScorer, which computes the score of the
> MUST
> >> > and
> >> > SHOULD clauses separately and then sum them up. In that test case, in
> >> > one
> >> > case body:d is in the list of SHOULD clauses, and in the other case it
> >> > is in
> >> > the list of MUST clauses.
> >> >
> >> > For the same reason, "+a b", "+a +b" and "a +b" may return different
> >> > scores
> >> > on the same documents.
> >> >
> >> > I can undo the change if you think this is a blocker, but that would
> be
> >> > disappointing as it would mean that we cannot do other exciting
> changes
> >> > like
> >> > flattening nested disjunctions since it would cause the same problem.
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: dev-help@lucene.apache.org
> >>
> >
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Robert Muir <rc...@gmail.com>.
The problem is more than worth it. The alternative is to remove the
optimization? I don't think being incorrect / adding leniency to tests
is a valid option at all. In general, if we dont apply a general fix,
it will just make more such optimizations harder: more jenkins
failures, more deltas in tests, just a bad direction.
I guess what i propose is something more like: change Scorer.score()
to return double, and use double precision internally in all scoring
(also similarity code).
But keep it a float in e.g. ScoreDoc/TopDocs: we just "export" that to
the user at the end. This is really best practice anyway, we shouldnt
be storing intermediate calculations as 32-bit floats. It would just
be a generalization of what DisjunctionSumScorer etc are already
doing.
On Fri, Oct 21, 2016 at 8:34 AM, Adrien Grand <jp...@gmail.com> wrote:
> I suspect we could do something on the Scorer API indeed, eg. by giving
> scorers a way to expose the double value of the score. However it's not
> clear to me that this problem is worth making the Scorer API more complex?
>
> Le ven. 21 oct. 2016 à 12:37, Robert Muir <rc...@gmail.com> a écrit :
>>
>> But maybe the old "trick" can still be used somehow: just means using
>> double precision internally to erase most differences? Maybe it means
>> a change to scorer api or whatever, but still I think its a good
>> practical solution (vs something more extreme like kahan summation). I
>> am sure it does not work if someone has like 500k boolean clauses or
>> for more extreme cases, but it prevents these problems for typical
>> cases like keyword searches.
>>
>>
>> On Fri, Oct 21, 2016 at 6:31 AM, Adrien Grand <jp...@gmail.com> wrote:
>> > Le ven. 21 oct. 2016 à 12:20, Robert Muir <rc...@gmail.com> a écrit :
>> >>
>> >> What changed?
>> >
>> >
>> > The issue here is ReqOptSumScorer, which computes the score of the MUST
>> > and
>> > SHOULD clauses separately and then sum them up. In that test case, in
>> > one
>> > case body:d is in the list of SHOULD clauses, and in the other case it
>> > is in
>> > the list of MUST clauses.
>> >
>> > For the same reason, "+a b", "+a +b" and "a +b" may return different
>> > scores
>> > on the same documents.
>> >
>> > I can undo the change if you think this is a blocker, but that would be
>> > disappointing as it would mean that we cannot do other exciting changes
>> > like
>> > flattening nested disjunctions since it would cause the same problem.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Adrien Grand <jp...@gmail.com>.
I suspect we could do something on the Scorer API indeed, eg. by giving
scorers a way to expose the double value of the score. However it's not
clear to me that this problem is worth making the Scorer API more complex?
Le ven. 21 oct. 2016 à 12:37, Robert Muir <rc...@gmail.com> a écrit :
> But maybe the old "trick" can still be used somehow: just means using
> double precision internally to erase most differences? Maybe it means
> a change to scorer api or whatever, but still I think its a good
> practical solution (vs something more extreme like kahan summation). I
> am sure it does not work if someone has like 500k boolean clauses or
> for more extreme cases, but it prevents these problems for typical
> cases like keyword searches.
>
>
> On Fri, Oct 21, 2016 at 6:31 AM, Adrien Grand <jp...@gmail.com> wrote:
> > Le ven. 21 oct. 2016 à 12:20, Robert Muir <rc...@gmail.com> a écrit :
> >>
> >> What changed?
> >
> >
> > The issue here is ReqOptSumScorer, which computes the score of the MUST
> and
> > SHOULD clauses separately and then sum them up. In that test case, in one
> > case body:d is in the list of SHOULD clauses, and in the other case it
> is in
> > the list of MUST clauses.
> >
> > For the same reason, "+a b", "+a +b" and "a +b" may return different
> scores
> > on the same documents.
> >
> > I can undo the change if you think this is a blocker, but that would be
> > disappointing as it would mean that we cannot do other exciting changes
> like
> > flattening nested disjunctions since it would cause the same problem.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Robert Muir <rc...@gmail.com>.
But maybe the old "trick" can still be used somehow: just means using
double precision internally to erase most differences? Maybe it means
a change to scorer api or whatever, but still I think its a good
practical solution (vs something more extreme like kahan summation). I
am sure it does not work if someone has like 500k boolean clauses or
for more extreme cases, but it prevents these problems for typical
cases like keyword searches.
On Fri, Oct 21, 2016 at 6:31 AM, Adrien Grand <jp...@gmail.com> wrote:
> Le ven. 21 oct. 2016 à 12:20, Robert Muir <rc...@gmail.com> a écrit :
>>
>> What changed?
>
>
> The issue here is ReqOptSumScorer, which computes the score of the MUST and
> SHOULD clauses separately and then sum them up. In that test case, in one
> case body:d is in the list of SHOULD clauses, and in the other case it is in
> the list of MUST clauses.
>
> For the same reason, "+a b", "+a +b" and "a +b" may return different scores
> on the same documents.
>
> I can undo the change if you think this is a blocker, but that would be
> disappointing as it would mean that we cannot do other exciting changes like
> flattening nested disjunctions since it would cause the same problem.
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Adrien Grand <jp...@gmail.com>.
Le ven. 21 oct. 2016 à 12:20, Robert Muir <rc...@gmail.com> a écrit :
> What changed?
>
The issue here is ReqOptSumScorer, which computes the score of the MUST and
SHOULD clauses separately and then sum them up. In that test case, in one
case body:d is in the list of SHOULD clauses, and in the other case it is
in the list of MUST clauses.
For the same reason, "+a b", "+a +b" and "a +b" may return different scores
on the same documents.
I can undo the change if you think this is a blocker, but that would be
disappointing as it would mean that we cannot do other exciting changes
like flattening nested disjunctions since it would cause the same problem.
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Robert Muir <rc...@gmail.com>.
We had similar tests before though, with BS1 vs BS2. Because BS1
scored out-of-order, it performed additions in different order, too.
But we did the math in these boolean scorers with double precision
internally and this kept the test happy (I am sure, if you had a
massive massive BQ it would have eventually failed).
What changed?
Sorry, I think as soon as you start adding leniency here, the test is
instantly worthless. You might as well delete it, because you can no
longer tell if a difference in score "matters" or not.
On Fri, Oct 21, 2016 at 6:15 AM, Adrien Grand <jp...@gmail.com> wrote:
> I don't think this test failure proves that the optimization is broken. The
> other failure is a bit easier to understand so I'll use it as an example,
> but this one is the same. We have an initial query which is ((((#body:d
> (+body:b (body:d body:a))^4.0 +body:c body:d)^4.0)^8.0)^3.0)^9.0 and we are
> trying to check that we get the same scores if we rewrite it or if we don't.
>
> For that particular query, the rewritten form is:
> ((+body:b (body:d body:a))^4.0 +body:c +body:d)^864.0
>
> The only boolean simplification that happened is that body:d was made a MUST
> clause since it was both a FILTER and a SHOULD clause. The rest is only
> about simplifications of nested BoostQueries. The score is different due to
> the fact that additions are performed in a different order, which is
> expected with floats. And then the difference is amplified by the fact that
> this particular query has a high boost.
>
> Le ven. 21 oct. 2016 à 11:30, Robert Muir <rc...@gmail.com> a écrit :
>>
>> Personally I think that is not correct to do. Some optimization or
>> another is broken if scores differ in this way...
>>
>> Just because differences are "small" does not make them insignificant.
>> Think about the tie-break case to users and so on, especially with
>> smaller documents / less terms / etc.
>>
>> Even 1 ulp is gonna mess stuff up, i do not believe leniency in the
>> tests is the solution.
>>
>>
>>
>> On Fri, Oct 21, 2016 at 3:05 AM, Adrien Grand <jp...@gmail.com> wrote:
>> > It is the same one as the other day, we need to relax a bit the check on
>> > scores somehow.
>> >
>> > Le ven. 21 oct. 2016 à 08:40, Policeman Jenkins Server
>> > <je...@thetaphi.de>
>> > a écrit :
>> >>
>> >> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18103/
>> >> Java: 64bit/jdk-9-ea+140 -XX:+UseCompressedOops -XX:+UseParallelGC
>> >>
>> >> 1 tests failed.
>> >> FAILED: org.apache.lucene.search.TestBooleanRewrites.testRandom
>> >>
>> >> Error Message:
>> >> expected:<2048.99267578125> but was:<2048.992919921875>
>> >>
>> >> Stack Trace:
>> >> java.lang.AssertionError: expected:<2048.99267578125> but
>> >> was:<2048.992919921875>
>> >> at
>> >>
>> >> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
>> >> at org.junit.Assert.fail(Assert.java:93)
>> >> at org.junit.Assert.failNotEquals(Assert.java:647)
>> >> at org.junit.Assert.assertEquals(Assert.java:443)
>> >> at org.junit.Assert.assertEquals(Assert.java:512)
>> >> at
>> >>
>> >> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
>> >> at
>> >>
>> >> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
>> >> at
>> >>
>> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native
>> >> Method)
>> >> at
>> >>
>> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
>> >> at
>> >>
>> >> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
>> >> at
>> >> java.lang.reflect.Method.invoke(java.base@9-ea/Method.java:535)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> >> at
>> >>
>> >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
>> >> at
>> >>
>> >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> >> at
>> >>
>> >> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >> at
>> >>
>> >> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>> >> at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
>> >>
>> >>
>> >>
>> >>
>> >> Build Log:
>> >> [...truncated 1309 lines...]
>> >> [junit4] Suite: org.apache.lucene.search.TestBooleanRewrites
>> >> [junit4] 2> NOTE: reproduce with: ant test
>> >> -Dtestcase=TestBooleanRewrites -Dtests.method=testRandom
>> >> -Dtests.seed=DDF676110AA095BA -Dtests.multiplier=3 -Dtests.slow=true
>> >> -Dtests.locale=qu -Dtests.timezone=JST -Dtests.asserts=true
>> >> -Dtests.file.encoding=UTF-8
>> >> [junit4] FAILURE 0.05s J1 | TestBooleanRewrites.testRandom <<<
>> >> [junit4] > Throwable #1: java.lang.AssertionError:
>> >> expected:<2048.99267578125> but was:<2048.992919921875>
>> >> [junit4] > at
>> >>
>> >> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
>> >> [junit4] > at
>> >>
>> >> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
>> >> [junit4] > at
>> >>
>> >> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
>> >> [junit4] > at
>> >>
>> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native
>> >> Method)
>> >> [junit4] > at
>> >>
>> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
>> >> [junit4] > at
>> >>
>> >> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
>> >> [junit4] > at
>> >> java.lang.Thread.run(java.base@9-ea/Thread.java:843)
>> >> [junit4] 2> NOTE: test params are:
>> >>
>> >> codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
>> >> chunkSize=16269, maxDocsPerChunk=9, blockSize=4),
>> >>
>> >> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
>> >> chunkSize=16269, blockSize=4)), sim=ClassicSimilarity, locale=qu,
>> >> timezone=JST
>> >> [junit4] 2> NOTE: Linux 4.4.0-42-generic amd64/Oracle Corporation
>> >> 9-ea (64-bit)/cpus=12,threads=1,free=153179392,total=333971456
>> >> [junit4] 2> NOTE: All tests run in this JVM:
>> >> [TestStandardAnalyzer,
>> >> TestByteBlockPool, TestNumericUtils, Test2BPostingsBytes,
>> >> TestSumDocFreq,
>> >> TestCharTermAttributeImpl, TestByteArrayDataInput,
>> >> TestLucene50StoredFieldsFormat, TestPhraseQuery, MultiCollectorTest,
>> >> TestShardSearching, TestQueryRescorer, Test2BBKDPoints,
>> >> TestIndexReaderClose, TestSpanContainQuery, TestSloppyMath,
>> >> TestLongPostings, TestSmallFloat, TestTimSorterWorstCase,
>> >> TestStressNRT,
>> >> TestMultiDocValues, TestFieldCacheRewriteMethod,
>> >> TestSameTokenSamePosition,
>> >> TestCheckIndex, TestHugeRamFile, TestPagedBytes, TestEarlyTermination,
>> >> TestTermVectorsWriter, TestDemoParallelLeafReader,
>> >> TestDocumentsWriterStallControl, TestAutomatonQueryUnicode,
>> >> TestOmitNorms,
>> >> TestIntBlockPool, TestMultiset, TestSearcherManager, TestIndexSearcher,
>> >> TestIndexWriterDelete, TestLiveFieldValues,
>> >> TestScoreCachingWrappingScorer,
>> >> TestDocument, TestDirectPacked, TestFieldsReader,
>> >> TestSimpleFSDirectory,
>> >> TestPayloads, TestAutomaton, FuzzyTermOnShortTermsTest,
>> >> TestSortedSetSortField, TestSortRandom, TestBooleanQuery,
>> >> TestIntArrayDocIdSet, TestCharArraySet, TestRadixSelector,
>> >> TestSleepingLockWrapper, TestTermdocPerf, TestDocsAndPositions,
>> >> TestNamedSPILoader, TestRecyclingIntBlockAllocator,
>> >> TestIndexWriterUnicode,
>> >> TestStressAdvance, TestFixedLengthBytesRefArray,
>> >> TestConsistentFieldNumbers,
>> >> Test2BDocs, TestMultiFields, TestDocumentsWriterDeleteQueue,
>> >> TestMutablePointsReaderUtils, TestIndexableField,
>> >> TestExitableDirectoryReader, TestSortRescorer, TestDuelingCodecs,
>> >> TestNRTReaderCleanup, TestCharsRef, TestIndexFileDeleter,
>> >> TestIndexWriterMerging, TestFSTs, TestIndexWriterWithThreads,
>> >> TestMultiMMap,
>> >> TestBasics, TestIndexWriterMergePolicy, TestAtomicUpdate,
>> >> TestHighCompressionMode, TestTopDocsMerge, TestTieredMergePolicy,
>> >> TestLevenshteinAutomata, TestByteSlices, TestNRTCachingDirectory,
>> >> TestParallelCompositeReader, TestIndexWriterNRTIsCurrent, TestCrash,
>> >> TestSegmentTermDocs, TestPerFieldPostingsFormat2, TestTermsEnum2,
>> >> TestPostingsOffsets, TestTransactionRollback, TestFlex,
>> >> TestStressIndexing2,
>> >> TestBagOfPostings, TestWildcard, TestSimilarity2,
>> >> TestFieldMaskingSpanQuery,
>> >> TestExternalCodecs, TestNoDeletionPolicy, TestRegexpQuery,
>> >> TestPerSegmentDeletes, TestSegmentTermEnum,
>> >> TestComplexExplanationsOfNonMatches, TestPrefixCodedTerms,
>> >> TestAllFilesHaveCodecHeader, TestTermScorer, TestMultiLevelSkipList,
>> >> TestSearchForDuplicates, TestCompiledAutomaton,
>> >> TestElevationComparator,
>> >> TestSubScorerFreqs, TestConjunctions, TestPositionIncrement,
>> >> TestSpanExplanationsOfNonMatches, TestSetOnce, TestFilterIterator,
>> >> TestPriorityQueue, TestAttributeSource, TestBooleanScorer,
>> >> TestAssertions,
>> >> TestTwoPhaseCommitTool, TestIndexWriterOnJRECrash, Test4GBStoredFields,
>> >> TestNGramPhraseQuery, TestSimpleAttributeImpl, TestIndexCommit,
>> >> TestIOUtils,
>> >> TestNewestSegment, Test2BPagedBytes, TestStopFilter,
>> >> TestPackedTokenAttributeImpl, TestCodecUtil,
>> >> TestGrowableByteArrayDataOutput, TestLucene50TermVectorsFormat,
>> >> TestAllFilesHaveChecksumFooter, TestDuelingCodecsAtNight,
>> >> TestFilterDirectoryReader, TestIndexWriterMaxDocs,
>> >> TestIndexWriterOnVMError,
>> >> TestIndexWriterOutOfFileDescriptors, TestInfoStream, TestManyFields,
>> >> TestMaxPosition, TestMergePolicyWrapper, TestMergeRateLimiter,
>> >> TestMultiTermsEnum, TestNumericDocValuesUpdates, TestOrdinalMap,
>> >> TestPointValues, TestReadOnlyIndex, TestReaderWrapperDVTypeCheck,
>> >> TestSegmentInfos, TestSwappedIndexFiles, TestTermVectors, TestTerms,
>> >> TestTragicIndexWriterDeadlock, TestTryDelete, TestBlendedTermQuery,
>> >> TestBooleanRewrites]
>> >> [junit4] Completed [340/434 (1!)] on J1 in 0.06s, 10 tests, 1
>> >> failure
>> >> <<< FAILURES!
>> >>
>> >> [...truncated 61242 lines...]
>> >>
>> >>
>> >> ---------------------------------------------------------------------
>> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> >> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Adrien Grand <jp...@gmail.com>.
I don't think this test failure proves that the optimization is broken. The
other failure is a bit easier to understand so I'll use it as an example,
but this one is the same. We have an initial query which is ((((#body:d
(+body:b (body:d body:a))^4.0 +body:c body:d)^4.0)^8.0)^3.0)^9.0 and we are
trying to check that we get the same scores if we rewrite it or if we don't.
For that particular query, the rewritten form is:
((+body:b (body:d body:a))^4.0 +body:c +body:d)^864.0
The only boolean simplification that happened is that body:d was made a
MUST clause since it was both a FILTER and a SHOULD clause. The rest is
only about simplifications of nested BoostQueries. The score is different
due to the fact that additions are performed in a different order, which is
expected with floats. And then the difference is amplified by the fact that
this particular query has a high boost.
Le ven. 21 oct. 2016 à 11:30, Robert Muir <rc...@gmail.com> a écrit :
> Personally I think that is not correct to do. Some optimization or
> another is broken if scores differ in this way...
>
> Just because differences are "small" does not make them insignificant.
> Think about the tie-break case to users and so on, especially with
> smaller documents / less terms / etc.
>
> Even 1 ulp is gonna mess stuff up, i do not believe leniency in the
> tests is the solution.
>
>
>
> On Fri, Oct 21, 2016 at 3:05 AM, Adrien Grand <jp...@gmail.com> wrote:
> > It is the same one as the other day, we need to relax a bit the check on
> > scores somehow.
> >
> > Le ven. 21 oct. 2016 à 08:40, Policeman Jenkins Server <
> jenkins@thetaphi.de>
> > a écrit :
> >>
> >> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18103/
> >> Java: 64bit/jdk-9-ea+140 -XX:+UseCompressedOops -XX:+UseParallelGC
> >>
> >> 1 tests failed.
> >> FAILED: org.apache.lucene.search.TestBooleanRewrites.testRandom
> >>
> >> Error Message:
> >> expected:<2048.99267578125> but was:<2048.992919921875>
> >>
> >> Stack Trace:
> >> java.lang.AssertionError: expected:<2048.99267578125> but
> >> was:<2048.992919921875>
> >> at
> >> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
> >> at org.junit.Assert.fail(Assert.java:93)
> >> at org.junit.Assert.failNotEquals(Assert.java:647)
> >> at org.junit.Assert.assertEquals(Assert.java:443)
> >> at org.junit.Assert.assertEquals(Assert.java:512)
> >> at
> >>
> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
> >> at
> >>
> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
> >> at
> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea
> /Native
> >> Method)
> >> at
> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea
> /NativeMethodAccessorImpl.java:62)
> >> at
> >> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea
> /DelegatingMethodAccessorImpl.java:43)
> >> at java.lang.reflect.Method.invoke(java.base@9-ea
> /Method.java:535)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
> >> at
> >>
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> >> at
> >>
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >> at
> >>
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> >> at
> >>
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >> at
> >>
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >> at
> >>
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> >> at
> >>
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
> >> at
> >>
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
> >> at
> >>
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
> >> at
> >>
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >> at
> >>
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >> at
> >>
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> >> at
> >>
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> >> at
> >>
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> >> at
> >>
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> >> at
> >>
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >> at
> >>
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> >> at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
> >>
> >>
> >>
> >>
> >> Build Log:
> >> [...truncated 1309 lines...]
> >> [junit4] Suite: org.apache.lucene.search.TestBooleanRewrites
> >> [junit4] 2> NOTE: reproduce with: ant test
> >> -Dtestcase=TestBooleanRewrites -Dtests.method=testRandom
> >> -Dtests.seed=DDF676110AA095BA -Dtests.multiplier=3 -Dtests.slow=true
> >> -Dtests.locale=qu -Dtests.timezone=JST -Dtests.asserts=true
> >> -Dtests.file.encoding=UTF-8
> >> [junit4] FAILURE 0.05s J1 | TestBooleanRewrites.testRandom <<<
> >> [junit4] > Throwable #1: java.lang.AssertionError:
> >> expected:<2048.99267578125> but was:<2048.992919921875>
> >> [junit4] > at
> >> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
> >> [junit4] > at
> >>
> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
> >> [junit4] > at
> >>
> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
> >> [junit4] > at
> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea
> /Native
> >> Method)
> >> [junit4] > at
> >> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea
> /NativeMethodAccessorImpl.java:62)
> >> [junit4] > at
> >> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea
> /DelegatingMethodAccessorImpl.java:43)
> >> [junit4] > at
> >> java.lang.Thread.run(java.base@9-ea/Thread.java:843)
> >> [junit4] 2> NOTE: test params are:
> >>
> codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
> >> chunkSize=16269, maxDocsPerChunk=9, blockSize=4),
> >>
> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
> >> chunkSize=16269, blockSize=4)), sim=ClassicSimilarity, locale=qu,
> >> timezone=JST
> >> [junit4] 2> NOTE: Linux 4.4.0-42-generic amd64/Oracle Corporation
> >> 9-ea (64-bit)/cpus=12,threads=1,free=153179392,total=333971456
> >> [junit4] 2> NOTE: All tests run in this JVM: [TestStandardAnalyzer,
> >> TestByteBlockPool, TestNumericUtils, Test2BPostingsBytes,
> TestSumDocFreq,
> >> TestCharTermAttributeImpl, TestByteArrayDataInput,
> >> TestLucene50StoredFieldsFormat, TestPhraseQuery, MultiCollectorTest,
> >> TestShardSearching, TestQueryRescorer, Test2BBKDPoints,
> >> TestIndexReaderClose, TestSpanContainQuery, TestSloppyMath,
> >> TestLongPostings, TestSmallFloat, TestTimSorterWorstCase, TestStressNRT,
> >> TestMultiDocValues, TestFieldCacheRewriteMethod,
> TestSameTokenSamePosition,
> >> TestCheckIndex, TestHugeRamFile, TestPagedBytes, TestEarlyTermination,
> >> TestTermVectorsWriter, TestDemoParallelLeafReader,
> >> TestDocumentsWriterStallControl, TestAutomatonQueryUnicode,
> TestOmitNorms,
> >> TestIntBlockPool, TestMultiset, TestSearcherManager, TestIndexSearcher,
> >> TestIndexWriterDelete, TestLiveFieldValues,
> TestScoreCachingWrappingScorer,
> >> TestDocument, TestDirectPacked, TestFieldsReader, TestSimpleFSDirectory,
> >> TestPayloads, TestAutomaton, FuzzyTermOnShortTermsTest,
> >> TestSortedSetSortField, TestSortRandom, TestBooleanQuery,
> >> TestIntArrayDocIdSet, TestCharArraySet, TestRadixSelector,
> >> TestSleepingLockWrapper, TestTermdocPerf, TestDocsAndPositions,
> >> TestNamedSPILoader, TestRecyclingIntBlockAllocator,
> TestIndexWriterUnicode,
> >> TestStressAdvance, TestFixedLengthBytesRefArray,
> TestConsistentFieldNumbers,
> >> Test2BDocs, TestMultiFields, TestDocumentsWriterDeleteQueue,
> >> TestMutablePointsReaderUtils, TestIndexableField,
> >> TestExitableDirectoryReader, TestSortRescorer, TestDuelingCodecs,
> >> TestNRTReaderCleanup, TestCharsRef, TestIndexFileDeleter,
> >> TestIndexWriterMerging, TestFSTs, TestIndexWriterWithThreads,
> TestMultiMMap,
> >> TestBasics, TestIndexWriterMergePolicy, TestAtomicUpdate,
> >> TestHighCompressionMode, TestTopDocsMerge, TestTieredMergePolicy,
> >> TestLevenshteinAutomata, TestByteSlices, TestNRTCachingDirectory,
> >> TestParallelCompositeReader, TestIndexWriterNRTIsCurrent, TestCrash,
> >> TestSegmentTermDocs, TestPerFieldPostingsFormat2, TestTermsEnum2,
> >> TestPostingsOffsets, TestTransactionRollback, TestFlex,
> TestStressIndexing2,
> >> TestBagOfPostings, TestWildcard, TestSimilarity2,
> TestFieldMaskingSpanQuery,
> >> TestExternalCodecs, TestNoDeletionPolicy, TestRegexpQuery,
> >> TestPerSegmentDeletes, TestSegmentTermEnum,
> >> TestComplexExplanationsOfNonMatches, TestPrefixCodedTerms,
> >> TestAllFilesHaveCodecHeader, TestTermScorer, TestMultiLevelSkipList,
> >> TestSearchForDuplicates, TestCompiledAutomaton, TestElevationComparator,
> >> TestSubScorerFreqs, TestConjunctions, TestPositionIncrement,
> >> TestSpanExplanationsOfNonMatches, TestSetOnce, TestFilterIterator,
> >> TestPriorityQueue, TestAttributeSource, TestBooleanScorer,
> TestAssertions,
> >> TestTwoPhaseCommitTool, TestIndexWriterOnJRECrash, Test4GBStoredFields,
> >> TestNGramPhraseQuery, TestSimpleAttributeImpl, TestIndexCommit,
> TestIOUtils,
> >> TestNewestSegment, Test2BPagedBytes, TestStopFilter,
> >> TestPackedTokenAttributeImpl, TestCodecUtil,
> >> TestGrowableByteArrayDataOutput, TestLucene50TermVectorsFormat,
> >> TestAllFilesHaveChecksumFooter, TestDuelingCodecsAtNight,
> >> TestFilterDirectoryReader, TestIndexWriterMaxDocs,
> TestIndexWriterOnVMError,
> >> TestIndexWriterOutOfFileDescriptors, TestInfoStream, TestManyFields,
> >> TestMaxPosition, TestMergePolicyWrapper, TestMergeRateLimiter,
> >> TestMultiTermsEnum, TestNumericDocValuesUpdates, TestOrdinalMap,
> >> TestPointValues, TestReadOnlyIndex, TestReaderWrapperDVTypeCheck,
> >> TestSegmentInfos, TestSwappedIndexFiles, TestTermVectors, TestTerms,
> >> TestTragicIndexWriterDeadlock, TestTryDelete, TestBlendedTermQuery,
> >> TestBooleanRewrites]
> >> [junit4] Completed [340/434 (1!)] on J1 in 0.06s, 10 tests, 1 failure
> >> <<< FAILURES!
> >>
> >> [...truncated 61242 lines...]
> >>
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> >> For additional commands, e-mail: dev-help@lucene.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Robert Muir <rc...@gmail.com>.
Personally I think that is not correct to do. Some optimization or
another is broken if scores differ in this way...
Just because differences are "small" does not make them insignificant.
Think about the tie-break case to users and so on, especially with
smaller documents / less terms / etc.
Even 1 ulp is gonna mess stuff up, i do not believe leniency in the
tests is the solution.
On Fri, Oct 21, 2016 at 3:05 AM, Adrien Grand <jp...@gmail.com> wrote:
> It is the same one as the other day, we need to relax a bit the check on
> scores somehow.
>
> Le ven. 21 oct. 2016 à 08:40, Policeman Jenkins Server <je...@thetaphi.de>
> a écrit :
>>
>> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18103/
>> Java: 64bit/jdk-9-ea+140 -XX:+UseCompressedOops -XX:+UseParallelGC
>>
>> 1 tests failed.
>> FAILED: org.apache.lucene.search.TestBooleanRewrites.testRandom
>>
>> Error Message:
>> expected:<2048.99267578125> but was:<2048.992919921875>
>>
>> Stack Trace:
>> java.lang.AssertionError: expected:<2048.99267578125> but
>> was:<2048.992919921875>
>> at
>> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
>> at org.junit.Assert.fail(Assert.java:93)
>> at org.junit.Assert.failNotEquals(Assert.java:647)
>> at org.junit.Assert.assertEquals(Assert.java:443)
>> at org.junit.Assert.assertEquals(Assert.java:512)
>> at
>> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
>> at
>> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
>> at
>> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native
>> Method)
>> at
>> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
>> at
>> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(java.base@9-ea/Method.java:535)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
>> at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
>> at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
>> at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
>> at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
>> at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
>> at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
>> at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
>> at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 1309 lines...]
>> [junit4] Suite: org.apache.lucene.search.TestBooleanRewrites
>> [junit4] 2> NOTE: reproduce with: ant test
>> -Dtestcase=TestBooleanRewrites -Dtests.method=testRandom
>> -Dtests.seed=DDF676110AA095BA -Dtests.multiplier=3 -Dtests.slow=true
>> -Dtests.locale=qu -Dtests.timezone=JST -Dtests.asserts=true
>> -Dtests.file.encoding=UTF-8
>> [junit4] FAILURE 0.05s J1 | TestBooleanRewrites.testRandom <<<
>> [junit4] > Throwable #1: java.lang.AssertionError:
>> expected:<2048.99267578125> but was:<2048.992919921875>
>> [junit4] > at
>> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
>> [junit4] > at
>> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
>> [junit4] > at
>> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
>> [junit4] > at
>> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native
>> Method)
>> [junit4] > at
>> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea/NativeMethodAccessorImpl.java:62)
>> [junit4] > at
>> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea/DelegatingMethodAccessorImpl.java:43)
>> [junit4] > at
>> java.lang.Thread.run(java.base@9-ea/Thread.java:843)
>> [junit4] 2> NOTE: test params are:
>> codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
>> chunkSize=16269, maxDocsPerChunk=9, blockSize=4),
>> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
>> chunkSize=16269, blockSize=4)), sim=ClassicSimilarity, locale=qu,
>> timezone=JST
>> [junit4] 2> NOTE: Linux 4.4.0-42-generic amd64/Oracle Corporation
>> 9-ea (64-bit)/cpus=12,threads=1,free=153179392,total=333971456
>> [junit4] 2> NOTE: All tests run in this JVM: [TestStandardAnalyzer,
>> TestByteBlockPool, TestNumericUtils, Test2BPostingsBytes, TestSumDocFreq,
>> TestCharTermAttributeImpl, TestByteArrayDataInput,
>> TestLucene50StoredFieldsFormat, TestPhraseQuery, MultiCollectorTest,
>> TestShardSearching, TestQueryRescorer, Test2BBKDPoints,
>> TestIndexReaderClose, TestSpanContainQuery, TestSloppyMath,
>> TestLongPostings, TestSmallFloat, TestTimSorterWorstCase, TestStressNRT,
>> TestMultiDocValues, TestFieldCacheRewriteMethod, TestSameTokenSamePosition,
>> TestCheckIndex, TestHugeRamFile, TestPagedBytes, TestEarlyTermination,
>> TestTermVectorsWriter, TestDemoParallelLeafReader,
>> TestDocumentsWriterStallControl, TestAutomatonQueryUnicode, TestOmitNorms,
>> TestIntBlockPool, TestMultiset, TestSearcherManager, TestIndexSearcher,
>> TestIndexWriterDelete, TestLiveFieldValues, TestScoreCachingWrappingScorer,
>> TestDocument, TestDirectPacked, TestFieldsReader, TestSimpleFSDirectory,
>> TestPayloads, TestAutomaton, FuzzyTermOnShortTermsTest,
>> TestSortedSetSortField, TestSortRandom, TestBooleanQuery,
>> TestIntArrayDocIdSet, TestCharArraySet, TestRadixSelector,
>> TestSleepingLockWrapper, TestTermdocPerf, TestDocsAndPositions,
>> TestNamedSPILoader, TestRecyclingIntBlockAllocator, TestIndexWriterUnicode,
>> TestStressAdvance, TestFixedLengthBytesRefArray, TestConsistentFieldNumbers,
>> Test2BDocs, TestMultiFields, TestDocumentsWriterDeleteQueue,
>> TestMutablePointsReaderUtils, TestIndexableField,
>> TestExitableDirectoryReader, TestSortRescorer, TestDuelingCodecs,
>> TestNRTReaderCleanup, TestCharsRef, TestIndexFileDeleter,
>> TestIndexWriterMerging, TestFSTs, TestIndexWriterWithThreads, TestMultiMMap,
>> TestBasics, TestIndexWriterMergePolicy, TestAtomicUpdate,
>> TestHighCompressionMode, TestTopDocsMerge, TestTieredMergePolicy,
>> TestLevenshteinAutomata, TestByteSlices, TestNRTCachingDirectory,
>> TestParallelCompositeReader, TestIndexWriterNRTIsCurrent, TestCrash,
>> TestSegmentTermDocs, TestPerFieldPostingsFormat2, TestTermsEnum2,
>> TestPostingsOffsets, TestTransactionRollback, TestFlex, TestStressIndexing2,
>> TestBagOfPostings, TestWildcard, TestSimilarity2, TestFieldMaskingSpanQuery,
>> TestExternalCodecs, TestNoDeletionPolicy, TestRegexpQuery,
>> TestPerSegmentDeletes, TestSegmentTermEnum,
>> TestComplexExplanationsOfNonMatches, TestPrefixCodedTerms,
>> TestAllFilesHaveCodecHeader, TestTermScorer, TestMultiLevelSkipList,
>> TestSearchForDuplicates, TestCompiledAutomaton, TestElevationComparator,
>> TestSubScorerFreqs, TestConjunctions, TestPositionIncrement,
>> TestSpanExplanationsOfNonMatches, TestSetOnce, TestFilterIterator,
>> TestPriorityQueue, TestAttributeSource, TestBooleanScorer, TestAssertions,
>> TestTwoPhaseCommitTool, TestIndexWriterOnJRECrash, Test4GBStoredFields,
>> TestNGramPhraseQuery, TestSimpleAttributeImpl, TestIndexCommit, TestIOUtils,
>> TestNewestSegment, Test2BPagedBytes, TestStopFilter,
>> TestPackedTokenAttributeImpl, TestCodecUtil,
>> TestGrowableByteArrayDataOutput, TestLucene50TermVectorsFormat,
>> TestAllFilesHaveChecksumFooter, TestDuelingCodecsAtNight,
>> TestFilterDirectoryReader, TestIndexWriterMaxDocs, TestIndexWriterOnVMError,
>> TestIndexWriterOutOfFileDescriptors, TestInfoStream, TestManyFields,
>> TestMaxPosition, TestMergePolicyWrapper, TestMergeRateLimiter,
>> TestMultiTermsEnum, TestNumericDocValuesUpdates, TestOrdinalMap,
>> TestPointValues, TestReadOnlyIndex, TestReaderWrapperDVTypeCheck,
>> TestSegmentInfos, TestSwappedIndexFiles, TestTermVectors, TestTerms,
>> TestTragicIndexWriterDeadlock, TestTryDelete, TestBlendedTermQuery,
>> TestBooleanRewrites]
>> [junit4] Completed [340/434 (1!)] on J1 in 0.06s, 10 tests, 1 failure
>> <<< FAILURES!
>>
>> [...truncated 61242 lines...]
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+140) -
Build # 18103 - Unstable!
Posted by Adrien Grand <jp...@gmail.com>.
It is the same one as the other day, we need to relax a bit the check on
scores somehow.
Le ven. 21 oct. 2016 à 08:40, Policeman Jenkins Server <je...@thetaphi.de>
a écrit :
> Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18103/
> Java: 64bit/jdk-9-ea+140 -XX:+UseCompressedOops -XX:+UseParallelGC
>
> 1 tests failed.
> FAILED: org.apache.lucene.search.TestBooleanRewrites.testRandom
>
> Error Message:
> expected:<2048.99267578125> but was:<2048.992919921875>
>
> Stack Trace:
> java.lang.AssertionError: expected:<2048.99267578125> but
> was:<2048.992919921875>
> at
> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
> at org.junit.Assert.fail(Assert.java:93)
> at org.junit.Assert.failNotEquals(Assert.java:647)
> at org.junit.Assert.assertEquals(Assert.java:443)
> at org.junit.Assert.assertEquals(Assert.java:512)
> at
> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
> at
> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
> at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native
> Method)
> at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea
> /NativeMethodAccessorImpl.java:62)
> at
> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea
> /DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(java.base@9-ea/Method.java:535)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
> at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
> at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
> at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
> at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
> at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
> at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
> at java.lang.Thread.run(java.base@9-ea/Thread.java:843)
>
>
>
>
> Build Log:
> [...truncated 1309 lines...]
> [junit4] Suite: org.apache.lucene.search.TestBooleanRewrites
> [junit4] 2> NOTE: reproduce with: ant test
> -Dtestcase=TestBooleanRewrites -Dtests.method=testRandom
> -Dtests.seed=DDF676110AA095BA -Dtests.multiplier=3 -Dtests.slow=true
> -Dtests.locale=qu -Dtests.timezone=JST -Dtests.asserts=true
> -Dtests.file.encoding=UTF-8
> [junit4] FAILURE 0.05s J1 | TestBooleanRewrites.testRandom <<<
> [junit4] > Throwable #1: java.lang.AssertionError:
> expected:<2048.99267578125> but was:<2048.992919921875>
> [junit4] > at
> __randomizedtesting.SeedInfo.seed([DDF676110AA095BA:AFBA531EBBC023C9]:0)
> [junit4] > at
> org.apache.lucene.search.TestBooleanRewrites.assertEquals(TestBooleanRewrites.java:427)
> [junit4] > at
> org.apache.lucene.search.TestBooleanRewrites.testRandom(TestBooleanRewrites.java:367)
> [junit4] > at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(java.base@9-ea/Native
> Method)
> [junit4] > at
> jdk.internal.reflect.NativeMethodAccessorImpl.invoke(java.base@9-ea
> /NativeMethodAccessorImpl.java:62)
> [junit4] > at
> jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(java.base@9-ea
> /DelegatingMethodAccessorImpl.java:43)
> [junit4] > at java.lang.Thread.run(java.base@9-ea
> /Thread.java:843)
> [junit4] 2> NOTE: test params are:
> codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
> chunkSize=16269, maxDocsPerChunk=9, blockSize=4),
> termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
> chunkSize=16269, blockSize=4)), sim=ClassicSimilarity, locale=qu,
> timezone=JST
> [junit4] 2> NOTE: Linux 4.4.0-42-generic amd64/Oracle Corporation
> 9-ea (64-bit)/cpus=12,threads=1,free=153179392,total=333971456
> [junit4] 2> NOTE: All tests run in this JVM: [TestStandardAnalyzer,
> TestByteBlockPool, TestNumericUtils, Test2BPostingsBytes, TestSumDocFreq,
> TestCharTermAttributeImpl, TestByteArrayDataInput,
> TestLucene50StoredFieldsFormat, TestPhraseQuery, MultiCollectorTest,
> TestShardSearching, TestQueryRescorer, Test2BBKDPoints,
> TestIndexReaderClose, TestSpanContainQuery, TestSloppyMath,
> TestLongPostings, TestSmallFloat, TestTimSorterWorstCase, TestStressNRT,
> TestMultiDocValues, TestFieldCacheRewriteMethod, TestSameTokenSamePosition,
> TestCheckIndex, TestHugeRamFile, TestPagedBytes, TestEarlyTermination,
> TestTermVectorsWriter, TestDemoParallelLeafReader,
> TestDocumentsWriterStallControl, TestAutomatonQueryUnicode, TestOmitNorms,
> TestIntBlockPool, TestMultiset, TestSearcherManager, TestIndexSearcher,
> TestIndexWriterDelete, TestLiveFieldValues, TestScoreCachingWrappingScorer,
> TestDocument, TestDirectPacked, TestFieldsReader, TestSimpleFSDirectory,
> TestPayloads, TestAutomaton, FuzzyTermOnShortTermsTest,
> TestSortedSetSortField, TestSortRandom, TestBooleanQuery,
> TestIntArrayDocIdSet, TestCharArraySet, TestRadixSelector,
> TestSleepingLockWrapper, TestTermdocPerf, TestDocsAndPositions,
> TestNamedSPILoader, TestRecyclingIntBlockAllocator, TestIndexWriterUnicode,
> TestStressAdvance, TestFixedLengthBytesRefArray,
> TestConsistentFieldNumbers, Test2BDocs, TestMultiFields,
> TestDocumentsWriterDeleteQueue, TestMutablePointsReaderUtils,
> TestIndexableField, TestExitableDirectoryReader, TestSortRescorer,
> TestDuelingCodecs, TestNRTReaderCleanup, TestCharsRef,
> TestIndexFileDeleter, TestIndexWriterMerging, TestFSTs,
> TestIndexWriterWithThreads, TestMultiMMap, TestBasics,
> TestIndexWriterMergePolicy, TestAtomicUpdate, TestHighCompressionMode,
> TestTopDocsMerge, TestTieredMergePolicy, TestLevenshteinAutomata,
> TestByteSlices, TestNRTCachingDirectory, TestParallelCompositeReader,
> TestIndexWriterNRTIsCurrent, TestCrash, TestSegmentTermDocs,
> TestPerFieldPostingsFormat2, TestTermsEnum2, TestPostingsOffsets,
> TestTransactionRollback, TestFlex, TestStressIndexing2, TestBagOfPostings,
> TestWildcard, TestSimilarity2, TestFieldMaskingSpanQuery,
> TestExternalCodecs, TestNoDeletionPolicy, TestRegexpQuery,
> TestPerSegmentDeletes, TestSegmentTermEnum,
> TestComplexExplanationsOfNonMatches, TestPrefixCodedTerms,
> TestAllFilesHaveCodecHeader, TestTermScorer, TestMultiLevelSkipList,
> TestSearchForDuplicates, TestCompiledAutomaton, TestElevationComparator,
> TestSubScorerFreqs, TestConjunctions, TestPositionIncrement,
> TestSpanExplanationsOfNonMatches, TestSetOnce, TestFilterIterator,
> TestPriorityQueue, TestAttributeSource, TestBooleanScorer, TestAssertions,
> TestTwoPhaseCommitTool, TestIndexWriterOnJRECrash, Test4GBStoredFields,
> TestNGramPhraseQuery, TestSimpleAttributeImpl, TestIndexCommit,
> TestIOUtils, TestNewestSegment, Test2BPagedBytes, TestStopFilter,
> TestPackedTokenAttributeImpl, TestCodecUtil,
> TestGrowableByteArrayDataOutput, TestLucene50TermVectorsFormat,
> TestAllFilesHaveChecksumFooter, TestDuelingCodecsAtNight,
> TestFilterDirectoryReader, TestIndexWriterMaxDocs,
> TestIndexWriterOnVMError, TestIndexWriterOutOfFileDescriptors,
> TestInfoStream, TestManyFields, TestMaxPosition, TestMergePolicyWrapper,
> TestMergeRateLimiter, TestMultiTermsEnum, TestNumericDocValuesUpdates,
> TestOrdinalMap, TestPointValues, TestReadOnlyIndex,
> TestReaderWrapperDVTypeCheck, TestSegmentInfos, TestSwappedIndexFiles,
> TestTermVectors, TestTerms, TestTragicIndexWriterDeadlock, TestTryDelete,
> TestBlendedTermQuery, TestBooleanRewrites]
> [junit4] Completed [340/434 (1!)] on J1 in 0.06s, 10 tests, 1 failure
> <<< FAILURES!
>
> [...truncated 61242 lines...]
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_102) - Build #
18104 - Failure!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/18104/
Java: 64bit/jdk1.8.0_102 -XX:+UseCompressedOops -XX:+UseSerialGC
All tests passed
Build Log:
[...truncated 12646 lines...]
[junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20161021_085142_433.sysout
[junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
[junit4] java.lang.OutOfMemoryError: Java heap space
[junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps/java_pid7460.hprof ...
[junit4] Heap dump file created [545982654 bytes in 0.695 secs]
[junit4] <<< JVM J0: EOF ----
[...truncated 11045 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:765: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:717: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created:
* java_pid7460.hprof
Total time: 54 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any