Re: [JENKINS] Lucene-9.x-MacOSX (64bit/hotspot/jdk-16.0.2) - Build # 2385 - Unstable!

[Chris Hostetter <ho...@fucit.org>]

FWIW: This same exact failure (same assertion msg) happened on main 
recently as well.

I've included some log snippets shouwing randomization details of both 
failures below.

Historically this test (with this name) has existed unmodified since long 
before i started keeping records of failure rates, but it has had failure 
"blips" ~14 times since 2021-04-12 -- prio to that, i have no record of it 
*EVER* failing.

Looking at the log snippets, the few things that jump out at me as being 
"common" between them...

 - java >= 16
 - -XX:+UseCompressedOops
 - codec=SimpleText
 - sim=Asserting(RandomSimilarity(queryNorm=false)
 - common "All tests run in this JVM" ...
   - TestOmitPositions
   - TestStopFilter
   - TestXYShape
   - TestAddIndexes
   - TestIndexCommit
   - TestIndexingSequenceNumbers
   - TestDocIDMerger
   - TestLatLonMultiLineShapeQueries
   - TestLucene90StoredFieldsFormatHighCompression



https://jenkins.thetaphi.de/view/Lucene/job/Lucene-main-Linux/42271/
Checking out Revision 72b91156f3d2049e66a987b9cc435c22d6c9e3af (refs/remotes/origin/main)
[description-setter] Description set: Java: 64bit/hotspot/jdk-17.0.5 -XX:+UseCompressedOops -XX:+UseParallelGC

  2> NOTE: reproduce with: gradlew test --tests 
TestSizeBoundedForceMerge.testByteSizeLimit -Dtests.seed=AE682DEBC10C54AC 
-Dtests.multiplier=3 -Dtests.locale=so-KE -Dtests.timezone=Asia/Kathmandu 
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
  2> NOTE: test params are: codec=SimpleText, 
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=so-KE, 
timezone=Asia/Kathmandu
  2> NOTE: Linux 5.19.0-42-generic amd64/Eclipse Adoptium 17.0.5 
(64-bit)/cpus=16,threads=1,free=191739968,total=335020032
  2> NOTE: All tests run in this JVM: [TestDemo, TestAnalysisSPILoader, 
TestCharFilter, TestStopFilter, TestPackedTokenAttributeImpl, 
TestDeflateWithPresetDictCompressionMode, TestIndexedDISI, 
TestLucene90NormsFormat, TestLucene90StoredFieldsFormatHighCompression, 
TestStoredFieldsInt, TestBinaryDocument, TestFeatureSort, 
TestKeywordField, TestLatLonMultiLineShapeQueries, 
TestLatLonPointDistanceSort, TestLatLonShape, TestPerFieldConsistency, 
TestXYMultiPointShapeQueries, TestXYShape, TestLine2D, 
TestSimpleWKTShapeParsing, TestXYRectangle, Test2BPostings, 
TestAddIndexes, TestApproximatePriorityQueue, TestBufferedUpdates, 
TestConcurrentMergeScheduler, TestDeletionPolicy, TestDocIDMerger, 
TestDocsWithFieldSet, TestDuelingCodecsAtNight, TestFieldUpdatesBuffer, 
TestFilterMergePolicy, TestIndexCommit, TestIndexSorting, 
TestIndexWriterExceptions, TestIndexWriterMergePolicy, 
TestIndexWriterOutOfFileDescriptors, TestIndexingSequenceNumbers, 
TestLogMergePolicy, TestMergeRateLimiter, TestMultiTermsEnum, 
TestNoDeletionPolicy, TestOmitPositions, TestParallelReaderEmptyIndex, 
TestPerSegmentDeletes, TestReaderClosed, TestSegmentInfos, 
TestSizeBoundedForceMerge]



The details from the 9.x build were...

https://jenkins.thetaphi.de/view/Lucene/job/Lucene-9.x-MacOSX/2385/
Checking out Revision d96e4ffbb5ae1ef0b599c1a83fdba8cb486dfb65 (refs/remotes/origin/branch_9x)
[description-setter] Description set: Java: 64bit/hotspot/jdk-16.0.2 -XX:+UseCompressedOops -XX:+UseShenandoahGC

  2> NOTE: reproduce with: gradlew test --tests 
TestSizeBoundedForceMerge.testByteSizeLimit -Dtests.seed=1BBFFFEF44E9DD39 
-Dtests.locale=bs-Cyrl-BA -Dtests.timezone=America/Thunder_Bay 
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
  2> NOTE: test params are: codec=SimpleText, 
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=bs-Cyrl-BA, 
timezone=America/Thunder_Bay
  2> NOTE: Mac OS X 10.14.6 x86_64/Eclipse Foundation 16.0.2 
(64-bit)/cpus=6,threads=1,free=156085320,total=471072768
  2> NOTE: All tests run in this JVM: [TestSearch, 
TestAutomatonToTokenStream, TestCharacterUtils, TestStopFilter, 
TestCharTermAttributeImpl, TestCompetitiveFreqNormAccumulator, 
TestHighCompressionMode, TestLucene90DocValuesFormat, 
TestLucene90NormsFormatMergeInstance, 
TestLucene90StoredFieldsFormatHighCompression, 
TestCompressingTermVectorsFormat, TestPerFieldPostingsFormat, 
TestDoubleRange, TestFieldType, TestLatLonDocValuesField, 
TestLatLonMultiLineShapeQueries, TestLatLonPointDistanceFeatureQuery, 
TestLatLonPolygonShapeDVQueries, TestLongHashSet, 
TestSortedSetDocValuesSetQuery, TestXYMultiPolygonShapeQueries, 
TestXYShape, TestGeoUtils, TestPolygon2D, TestXYLine, Test2BDocs, 
Test2BPostingsBytes, TestAddIndexes, TestAllFilesHaveCodecHeader, 
TestBinaryDocValuesUpdates, TestCodecHoldsOpenFiles, TestCrash, 
TestDemoParallelLeafReader, TestDocIDMerger, TestDocsAndPositions, 
TestDocumentsWriterStallControl, TestFieldInfos, TestFilterCodecReader, 
TestFlex, TestIndexCommit, TestIndexReaderClose, TestIndexWriterConfig, 
TestIndexWriterFromReader, TestIndexWriterNRTIsCurrent, 
TestIndexWriterReader, TestIndexingSequenceNumbers, TestLazyProxSkipping, 
TestMaxTermFrequency, TestMultiDocValues, TestNRTReaderWithThreads, 
TestNoMergePolicy, TestOmitPositions, TestParallelLeafReader, 
TestPendingDeletes, TestPostingsOffsets, TestReaderWrapperDVTypeCheck, 
TestSegmentMerger, TestSizeBoundedForceMerge]





: Date: Sun, 28 May 2023 21:08:19 -0700
: From: Patrick Zhai <zh...@gmail.com>
: Reply-To: dev@lucene.apache.org
: To: dev@lucene.apache.org
: Subject: Re: [JENKINS] Lucene-9.x-MacOSX (64bit/hotspot/jdk-16.0.2) - Build #
:     2385 - Unstable!
: 
: Can't reproduce in ~10 tries, the test logic seems ok to me too
: 
: On Sun, May 28, 2023 at 6:48 PM Policeman Jenkins Server <
: jenkins@thetaphi.de> wrote:
: 
: > Build: https://jenkins.thetaphi.de/job/Lucene-9.x-MacOSX/2385/
: > Java: 64bit/hotspot/jdk-16.0.2 -XX:+UseCompressedOops -XX:+UseShenandoahGC
: >
: > 1 tests failed.
: > FAILED:
: > org.apache.lucene.index.TestSizeBoundedForceMerge.testByteSizeLimit
: >
: > Error Message:
: > java.lang.AssertionError: expected:<3> but was:<5>
: >
: > Stack Trace:
: > java.lang.AssertionError: expected:<3> but was:<5>
: >         at
: > __randomizedtesting.SeedInfo.seed([1BBFFFEF44E9DD39:98843ED5457E86D8]:0)
: >         at org.junit.Assert.fail(Assert.java:89)
: >         at org.junit.Assert.failNotEquals(Assert.java:835)
: >         at org.junit.Assert.assertEquals(Assert.java:647)
: >         at org.junit.Assert.assertEquals(Assert.java:633)
: >         at
: > org.apache.lucene.index.TestSizeBoundedForceMerge.testByteSizeLimit(TestSizeBoundedForceMerge.java:83)
: >         at
: > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
: > Method)
: >         at
: > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:78)
: >         at
: > java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: >         at java.base/java.lang.reflect.Method.invoke(Method.java:567)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
: >         at
: > org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
: >         at
: > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
: >         at
: > org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
: >         at
: > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
: >         at
: > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
: >         at org.junit.rules.RunRules.evaluate(RunRules.java:20)
: >         at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: >         at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
: >         at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
: >         at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
: >         at
: > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
: >         at
: > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
: >         at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: >         at
: > org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
: >         at
: > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
: >         at
: > com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
: >         at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: >         at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: >         at
: > org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
: >         at
: > org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
: >         at
: > org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
: >         at
: > org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
: >         at
: > org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
: >         at org.junit.rules.RunRules.evaluate(RunRules.java:20)
: >         at
: > com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: >         at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
: >         at
: > com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
: >         at java.base/java.lang.Thread.run(Thread.java:831)
: >
: > ---------------------------------------------------------------------
: > To unsubscribe, e-mail: builds-unsubscribe@lucene.apache.org
: > For additional commands, e-mail: builds-help@lucene.apache.org
: 

-Hoss
http://www.lucidworks.com/