You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Patrick Zhai <zh...@gmail.com> on 2023/05/29 04:08:19 UTC
Re: [JENKINS] Lucene-9.x-MacOSX (64bit/hotspot/jdk-16.0.2) - Build # 2385 - Unstable!
Can't reproduce in ~10 tries, the test logic seems ok to me too
On Sun, May 28, 2023 at 6:48 PM Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:
> Build: https://jenkins.thetaphi.de/job/Lucene-9.x-MacOSX/2385/
> Java: 64bit/hotspot/jdk-16.0.2 -XX:+UseCompressedOops -XX:+UseShenandoahGC
>
> 1 tests failed.
> FAILED:
> org.apache.lucene.index.TestSizeBoundedForceMerge.testByteSizeLimit
>
> Error Message:
> java.lang.AssertionError: expected:<3> but was:<5>
>
> Stack Trace:
> java.lang.AssertionError: expected:<3> but was:<5>
> at
> __randomizedtesting.SeedInfo.seed([1BBFFFEF44E9DD39:98843ED5457E86D8]:0)
> at org.junit.Assert.fail(Assert.java:89)
> at org.junit.Assert.failNotEquals(Assert.java:835)
> at org.junit.Assert.assertEquals(Assert.java:647)
> at org.junit.Assert.assertEquals(Assert.java:633)
> at
> org.apache.lucene.index.TestSizeBoundedForceMerge.testByteSizeLimit(TestSizeBoundedForceMerge.java:83)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
> at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:78)
> at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.base/java.lang.reflect.Method.invoke(Method.java:567)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
> at
> org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
> at
> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
> at
> org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
> at
> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
> at
> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
> at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
> at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
> at
> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
> at
> org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
> at
> org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
> at
> org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
> at
> org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
> at org.junit.rules.RunRules.evaluate(RunRules.java:20)
> at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
> at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
> at java.base/java.lang.Thread.run(Thread.java:831)
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org
> For additional commands, e-mail: builds-help@lucene.apache.org
Re: [JENKINS] Lucene-9.x-MacOSX (64bit/hotspot/jdk-16.0.2) - Build # 2385 - Unstable!
Posted by Chris Hostetter <ho...@fucit.org>.
FWIW: This same exact failure (same assertion msg) happened on main
recently as well.
I've included some log snippets shouwing randomization details of both
failures below.
Historically this test (with this name) has existed unmodified since long
before i started keeping records of failure rates, but it has had failure
"blips" ~14 times since 2021-04-12 -- prio to that, i have no record of it
*EVER* failing.
Looking at the log snippets, the few things that jump out at me as being
"common" between them...
- java >= 16
- -XX:+UseCompressedOops
- codec=SimpleText
- sim=Asserting(RandomSimilarity(queryNorm=false)
- common "All tests run in this JVM" ...
- TestOmitPositions
- TestStopFilter
- TestXYShape
- TestAddIndexes
- TestIndexCommit
- TestIndexingSequenceNumbers
- TestDocIDMerger
- TestLatLonMultiLineShapeQueries
- TestLucene90StoredFieldsFormatHighCompression
https://jenkins.thetaphi.de/view/Lucene/job/Lucene-main-Linux/42271/
Checking out Revision 72b91156f3d2049e66a987b9cc435c22d6c9e3af (refs/remotes/origin/main)
[description-setter] Description set: Java: 64bit/hotspot/jdk-17.0.5 -XX:+UseCompressedOops -XX:+UseParallelGC
2> NOTE: reproduce with: gradlew test --tests
TestSizeBoundedForceMerge.testByteSizeLimit -Dtests.seed=AE682DEBC10C54AC
-Dtests.multiplier=3 -Dtests.locale=so-KE -Dtests.timezone=Asia/Kathmandu
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
2> NOTE: test params are: codec=SimpleText,
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=so-KE,
timezone=Asia/Kathmandu
2> NOTE: Linux 5.19.0-42-generic amd64/Eclipse Adoptium 17.0.5
(64-bit)/cpus=16,threads=1,free=191739968,total=335020032
2> NOTE: All tests run in this JVM: [TestDemo, TestAnalysisSPILoader,
TestCharFilter, TestStopFilter, TestPackedTokenAttributeImpl,
TestDeflateWithPresetDictCompressionMode, TestIndexedDISI,
TestLucene90NormsFormat, TestLucene90StoredFieldsFormatHighCompression,
TestStoredFieldsInt, TestBinaryDocument, TestFeatureSort,
TestKeywordField, TestLatLonMultiLineShapeQueries,
TestLatLonPointDistanceSort, TestLatLonShape, TestPerFieldConsistency,
TestXYMultiPointShapeQueries, TestXYShape, TestLine2D,
TestSimpleWKTShapeParsing, TestXYRectangle, Test2BPostings,
TestAddIndexes, TestApproximatePriorityQueue, TestBufferedUpdates,
TestConcurrentMergeScheduler, TestDeletionPolicy, TestDocIDMerger,
TestDocsWithFieldSet, TestDuelingCodecsAtNight, TestFieldUpdatesBuffer,
TestFilterMergePolicy, TestIndexCommit, TestIndexSorting,
TestIndexWriterExceptions, TestIndexWriterMergePolicy,
TestIndexWriterOutOfFileDescriptors, TestIndexingSequenceNumbers,
TestLogMergePolicy, TestMergeRateLimiter, TestMultiTermsEnum,
TestNoDeletionPolicy, TestOmitPositions, TestParallelReaderEmptyIndex,
TestPerSegmentDeletes, TestReaderClosed, TestSegmentInfos,
TestSizeBoundedForceMerge]
The details from the 9.x build were...
https://jenkins.thetaphi.de/view/Lucene/job/Lucene-9.x-MacOSX/2385/
Checking out Revision d96e4ffbb5ae1ef0b599c1a83fdba8cb486dfb65 (refs/remotes/origin/branch_9x)
[description-setter] Description set: Java: 64bit/hotspot/jdk-16.0.2 -XX:+UseCompressedOops -XX:+UseShenandoahGC
2> NOTE: reproduce with: gradlew test --tests
TestSizeBoundedForceMerge.testByteSizeLimit -Dtests.seed=1BBFFFEF44E9DD39
-Dtests.locale=bs-Cyrl-BA -Dtests.timezone=America/Thunder_Bay
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
2> NOTE: test params are: codec=SimpleText,
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=bs-Cyrl-BA,
timezone=America/Thunder_Bay
2> NOTE: Mac OS X 10.14.6 x86_64/Eclipse Foundation 16.0.2
(64-bit)/cpus=6,threads=1,free=156085320,total=471072768
2> NOTE: All tests run in this JVM: [TestSearch,
TestAutomatonToTokenStream, TestCharacterUtils, TestStopFilter,
TestCharTermAttributeImpl, TestCompetitiveFreqNormAccumulator,
TestHighCompressionMode, TestLucene90DocValuesFormat,
TestLucene90NormsFormatMergeInstance,
TestLucene90StoredFieldsFormatHighCompression,
TestCompressingTermVectorsFormat, TestPerFieldPostingsFormat,
TestDoubleRange, TestFieldType, TestLatLonDocValuesField,
TestLatLonMultiLineShapeQueries, TestLatLonPointDistanceFeatureQuery,
TestLatLonPolygonShapeDVQueries, TestLongHashSet,
TestSortedSetDocValuesSetQuery, TestXYMultiPolygonShapeQueries,
TestXYShape, TestGeoUtils, TestPolygon2D, TestXYLine, Test2BDocs,
Test2BPostingsBytes, TestAddIndexes, TestAllFilesHaveCodecHeader,
TestBinaryDocValuesUpdates, TestCodecHoldsOpenFiles, TestCrash,
TestDemoParallelLeafReader, TestDocIDMerger, TestDocsAndPositions,
TestDocumentsWriterStallControl, TestFieldInfos, TestFilterCodecReader,
TestFlex, TestIndexCommit, TestIndexReaderClose, TestIndexWriterConfig,
TestIndexWriterFromReader, TestIndexWriterNRTIsCurrent,
TestIndexWriterReader, TestIndexingSequenceNumbers, TestLazyProxSkipping,
TestMaxTermFrequency, TestMultiDocValues, TestNRTReaderWithThreads,
TestNoMergePolicy, TestOmitPositions, TestParallelLeafReader,
TestPendingDeletes, TestPostingsOffsets, TestReaderWrapperDVTypeCheck,
TestSegmentMerger, TestSizeBoundedForceMerge]
: Date: Sun, 28 May 2023 21:08:19 -0700
: From: Patrick Zhai <zh...@gmail.com>
: Reply-To: dev@lucene.apache.org
: To: dev@lucene.apache.org
: Subject: Re: [JENKINS] Lucene-9.x-MacOSX (64bit/hotspot/jdk-16.0.2) - Build #
: 2385 - Unstable!
:
: Can't reproduce in ~10 tries, the test logic seems ok to me too
:
: On Sun, May 28, 2023 at 6:48 PM Policeman Jenkins Server <
: jenkins@thetaphi.de> wrote:
:
: > Build: https://jenkins.thetaphi.de/job/Lucene-9.x-MacOSX/2385/
: > Java: 64bit/hotspot/jdk-16.0.2 -XX:+UseCompressedOops -XX:+UseShenandoahGC
: >
: > 1 tests failed.
: > FAILED:
: > org.apache.lucene.index.TestSizeBoundedForceMerge.testByteSizeLimit
: >
: > Error Message:
: > java.lang.AssertionError: expected:<3> but was:<5>
: >
: > Stack Trace:
: > java.lang.AssertionError: expected:<3> but was:<5>
: > at
: > __randomizedtesting.SeedInfo.seed([1BBFFFEF44E9DD39:98843ED5457E86D8]:0)
: > at org.junit.Assert.fail(Assert.java:89)
: > at org.junit.Assert.failNotEquals(Assert.java:835)
: > at org.junit.Assert.assertEquals(Assert.java:647)
: > at org.junit.Assert.assertEquals(Assert.java:633)
: > at
: > org.apache.lucene.index.TestSizeBoundedForceMerge.testByteSizeLimit(TestSizeBoundedForceMerge.java:83)
: > at
: > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
: > Method)
: > at
: > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:78)
: > at
: > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: > at java.base/java.lang.reflect.Method.invoke(Method.java:567)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
: > at
: > org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
: > at
: > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
: > at
: > org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
: > at
: > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
: > at
: > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
: > at org.junit.rules.RunRules.evaluate(RunRules.java:20)
: > at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: > at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
: > at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
: > at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
: > at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
: > at
: > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
: > at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: > at
: > org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
: > at
: > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
: > at
: > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
: > at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: > at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: > at
: > org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
: > at
: > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
: > at
: > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
: > at
: > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
: > at
: > org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
: > at org.junit.rules.RunRules.evaluate(RunRules.java:20)
: > at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: > at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
: > at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
: > at java.base/java.lang.Thread.run(Thread.java:831)
: >
: > ---------------------------------------------------------------------
: > To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org
: > For additional commands, e-mail: builds-help@lucene.apache.org
:
-Hoss
http://www.lucidworks.com/